2024-09-21T02:40:07.076 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T02:40:07.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T02:40:07.193 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913441' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJudrW66adTwoxkL/t7sEga1qljsJl/P40OurXaX0AJY6Mg53279ZRmmawevWSsVOEL6m1oCKU5X/Zxn5gvLitw= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWVjZ57GHqtmREnmXb/RJ1R6xwuwN5HGQevRM0DxqOKVbPYiCyd6BDpDnqkDta6Lon9sU+ruS29hGS17QiyI4w= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIE3wCw18SRyXD5NMgzDlUpG2ug0b1aYEGfnbP3F4HroxtD6Qu1CbllpTN5oi9FgJ4qQeV5/x+LYlDOt92RDdoA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T02:40:07.193 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T02:40:07.194 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T02:40:07.194 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T02:40:07.196 INFO:teuthology.task.internal:Checking packages... 2024-09-21T02:40:07.214 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T02:40:07.214 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T02:40:07.215 INFO:teuthology.packaging:ref: None 2024-09-21T02:40:07.215 INFO:teuthology.packaging:tag: None 2024-09-21T02:40:07.215 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T02:40:07.215 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:40:07.215 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T02:40:07.364 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T02:40:07.365 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T02:40:07.371 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T02:40:07.371 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T02:40:07.375 INFO:teuthology.task.internal:Saving configuration 2024-09-21T02:40:07.393 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T02:40:07.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T02:40:07.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:35:03.409433', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJudrW66adTwoxkL/t7sEga1qljsJl/P40OurXaX0AJY6Mg53279ZRmmawevWSsVOEL6m1oCKU5X/Zxn5gvLitw='} 2024-09-21T02:40:07.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:35:03.407672', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWVjZ57GHqtmREnmXb/RJ1R6xwuwN5HGQevRM0DxqOKVbPYiCyd6BDpDnqkDta6Lon9sU+ruS29hGS17QiyI4w='} 2024-09-21T02:40:07.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:35:03.411059', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIE3wCw18SRyXD5NMgzDlUpG2ug0b1aYEGfnbP3F4HroxtD6Qu1CbllpTN5oi9FgJ4qQeV5/x+LYlDOt92RDdoA='} 2024-09-21T02:40:07.466 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T02:40:07.472 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T02:40:07.472 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T02:40:07.472 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T02:40:07.472 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T02:40:07.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff1ce474160>, signals=[15]) 2024-09-21T02:40:07.548 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T02:40:07.555 INFO:teuthology.task.internal:Opening connections... 2024-09-21T02:40:07.555 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T02:40:07.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:40:07.632 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-09-21T02:40:07.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:40:07.706 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-21T02:40:07.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:40:07.780 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T02:40:07.787 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-21T02:40:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-21T02:40:07.805 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-21T02:40:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:40:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:40:07.864 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-21T02:40:07.889 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-09-21T02:40:07.907 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-09-21T02:40:07.908 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-09-21T02:40:07.966 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-09-21T02:40:07.966 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:40:07.967 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:40:07.968 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-09-21T02:40:07.980 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-21T02:40:07.998 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-21T02:40:07.999 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-21T02:40:08.056 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-09-21T02:40:08.056 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-09-21T02:40:08.056 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:40:08.057 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:40:08.058 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-21T02:40:08.080 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T02:40:08.090 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T02:40:08.095 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T02:40:08.095 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:40:08.097 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:40:08.100 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:40:08.116 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T02:40:08.121 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T02:40:08.121 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:40:08.155 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:40:08.157 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:40:08.264 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T02:40:08.340 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T02:40:08.354 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T02:40:08.354 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T02:40:08.355 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:40:08.355 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:40:08.356 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:40:08.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:40:08.373 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-21T02:40:08.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:40:08.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:40:08.374 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-21T02:40:08.375 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-21T02:40:08.431 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-503.el9.x86_64 2024-09-21T02:40:08.432 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-503.el9.x86_64 2024-09-21T02:40:08.432 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-09-21T02:40:08.433 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-21T02:40:08.434 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-503.el9.x86_64 2024-09-21T02:40:08.434 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-21T02:40:08.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-21T02:40:08.434 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-503.el9.x86_64 2024-09-21T02:40:08.434 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2024-09-21T02:40:10.828 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T02:40:11.989 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T02:40:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.3 MB 00:01 2024-09-21T02:40:13.958 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T02:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-09-21T02:40:15.128 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-21T02:40:18.250 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T02:40:19.488 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T02:40:19.561 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-21T02:40:19.643 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-21T02:40:20.538 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T02:40:21.037 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-21T02:40:21.180 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-21T02:40:21.908 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T02:40:22.143 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T02:40:26.078 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T02:40:27.230 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-09-21T02:40:27.465 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-21T02:40:27.984 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T02:40:27.984 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T02:40:28.075 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T02:40:28.087 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T02:40:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:40:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-21T02:40:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T02:40:28.088 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-21T02:40:28.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:40:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-21T02:40:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-21T02:40:28.089 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-21T02:40:28.237 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 345 kB/s | 36 kB 00:00 2024-09-21T02:40:28.621 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-21T02:40:28.996 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 38 MB/s | 29 MB 00:00 2024-09-21T02:40:29.146 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T02:40:29.146 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T02:40:29.250 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T02:40:29.266 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T02:40:29.267 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:40:29.267 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-21T02:40:29.267 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-21T02:40:29.267 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-09-21T02:40:29.267 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:40:29.267 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 79 M 2024-09-21T02:40:29.268 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 126 M 2024-09-21T02:40:29.268 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-21T02:40:29.330 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T02:40:29.330 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T02:40:29.330 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-21T02:40:29.330 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:40:29.330 INFO:teuthology.orchestra.run.smithi081.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-21T02:40:29.416 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T02:40:29.424 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:40:29.425 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-21T02:40:29.425 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-21T02:40:29.425 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-09-21T02:40:29.425 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:40:29.425 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 79 M 2024-09-21T02:40:29.425 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 126 M 2024-09-21T02:40:29.425 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-21T02:40:29.516 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 521 kB/s | 36 kB 00:00 2024-09-21T02:40:29.607 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 124 kB/s | 36 kB 00:00 2024-09-21T02:40:29.984 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T02:40:30.012 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-21T02:40:30.371 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-21T02:40:30.371 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-21T02:40:30.742 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-21T02:40:31.309 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-21T02:40:31.309 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:40:31.309 INFO:teuthology.orchestra.run.smithi181.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-21T02:40:31.335 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-21T02:40:31.336 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-21T02:40:31.990 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-21T02:40:32.335 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-21T02:40:32.336 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-21T02:40:33.320 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-21T02:40:33.320 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-21T02:40:33.751 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-21T02:40:34.404 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T02:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:40:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-21T02:40:36.462 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T02:40:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:40:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:40:37.361 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:40:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:40:39.455 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:40:39.631 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.5 MB/s | 16 MB 00:10 2024-09-21T02:40:40.006 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.7 MB/s | 29 MB 00:10 2024-09-21T02:40:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.0 MB/s | 35 MB 00:11 2024-09-21T02:40:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:40:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:Total 6.8 MB/s | 79 MB 00:11 2024-09-21T02:40:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-21T02:40:41.830 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-21T02:40:41.830 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-21T02:40:42.177 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:40:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:40:42.780 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-21T02:40:42.781 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-21T02:40:44.292 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:40:44.396 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:40:45.213 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-21T02:40:45.855 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T02:40:45.948 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:40:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:40:48.723 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:40:48.851 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:40:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:40:53.707 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:40:53.826 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:40:58.687 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:25.551 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:25.601 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:26.014 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:26.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T02:41:26.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:41:26.014 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T02:41:26.891 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:41:26.892 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-21T02:41:27.225 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T02:41:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:27.273 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:27.343 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:27.344 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T02:41:27.344 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T02:41:27.344 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T02:41:27.345 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T02:41:27.345 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T02:41:27.345 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T02:41:27.345 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T02:41:27.403 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:27.403 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T02:41:27.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-21T02:41:27.442 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-21T02:41:27.442 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-21T02:41:27.442 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-21T02:41:27.442 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-21T02:41:27.442 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-21T02:41:27.442 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T02:41:27.443 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T02:41:27.444 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T02:41:27.444 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-21T02:41:27.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:41:27.444 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T02:41:27.444 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T02:41:27.445 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-508.el9.x86_64 2024-09-21T02:41:27.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T02:41:27.567 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:27.567 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T02:41:27.568 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:41:27.568 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:41:28.200 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-21T02:41:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:41:28.397 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-21T02:41:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T02:41:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T02:41:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T02:41:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:41:28.398 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-21T02:41:28.747 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T02:41:28.833 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:28.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T02:41:28.834 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T02:41:28.835 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T02:41:28.835 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T02:41:28.835 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-21T02:41:28.835 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T02:41:28.835 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T02:41:28.893 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:28.894 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T02:41:28.895 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 82.el9 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8274670 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T02:41:28.933 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:41:28.934 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T02:41:28.935 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T02:41:28.935 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-508.el9.x86_64 2024-09-21T02:41:28.935 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T02:41:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-09-21T02:41:29.634 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T02:41:29.662 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-21T02:41:29.667 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-21T02:41:29.683 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.bSjSyLT15W 2024-09-21T02:41:29.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bSjSyLT15W 2024-09-21T02:41:29.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.bSjSyLT15W 2024-09-21T02:41:29.886 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.bSjSyLT15W is 6KB 2024-09-21T02:41:29.906 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.bSjSyLT15W 2024-09-21T02:41:29.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T02:41:29.983 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T02:41:29.983 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T02:41:29.983 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T02:41:29.983 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T02:41:29.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T02:41:30.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-21T02:41:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T02:41:30.872 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-09-21T02:41:30.874 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-21T02:41:30.890 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.Ou2M3Dj3Jt 2024-09-21T02:41:30.891 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ou2M3Dj3Jt 2024-09-21T02:41:30.959 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.Ou2M3Dj3Jt 2024-09-21T02:41:31.092 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.Ou2M3Dj3Jt is 6KB 2024-09-21T02:41:31.114 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.Ou2M3Dj3Jt 2024-09-21T02:41:31.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T02:41:31.193 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T02:41:31.193 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T02:41:31.193 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T02:41:31.193 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T02:41:31.195 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T02:41:31.356 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-09-21T02:41:36.635 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:36.675 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:37.004 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T02:41:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T02:41:37.005 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:41:37.845 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-21T02:41:38.213 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T02:41:38.309 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:38.309 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T02:41:38.309 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T02:41:38.310 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T02:41:38.310 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T02:41:38.310 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T02:41:38.310 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T02:41:38.310 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T02:41:38.368 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T02:41:38.369 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T02:41:38.369 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 82.el9 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8274670 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T02:41:38.407 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:41:38.408 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T02:41:38.409 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T02:41:38.409 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 5.14.0-508.el9.x86_64 2024-09-21T02:41:38.409 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T02:41:39.050 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-09-21T02:41:40.359 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T02:41:40.385 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-09-21T02:41:40.387 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-21T02:41:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.IFJyi10GnZ 2024-09-21T02:41:40.403 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IFJyi10GnZ 2024-09-21T02:41:40.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.IFJyi10GnZ 2024-09-21T02:41:40.617 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.IFJyi10GnZ is 6KB 2024-09-21T02:41:40.666 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.IFJyi10GnZ 2024-09-21T02:41:40.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T02:41:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T02:41:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T02:41:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T02:41:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T02:41:40.754 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T02:41:40.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-09-21T02:42:00.170 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T02:42:00.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T02:42:00.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:42:01.360 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-21T02:42:01.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T02:42:01.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:42:10.904 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T02:42:10.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-21T02:42:10.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:42:45.359 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-21T02:42:54.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-21T02:42:54.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:43:00.174 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T02:43:01.362 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T02:43:09.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T02:43:09.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:43:09.547 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-21T02:43:09.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T02:43:09.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T02:43:09.923 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-21T02:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-508.el9.x86_64 2024-09-21T02:43:09.938 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T02:43:09.938 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T02:43:09.938 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T02:43:10.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T02:43:10.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:43:10.752 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-21T02:43:10.939 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T02:43:10.939 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T02:43:11.047 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-21T02:43:11.069 DEBUG:teuthology.parallel:result is None 2024-09-21T02:43:11.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T02:43:11.199 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-21T02:43:11.199 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-21T02:43:11.214 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-508.el9.x86_64 2024-09-21T02:43:11.214 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T02:43:11.214 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T02:43:11.214 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T02:43:12.216 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-21T02:43:12.216 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T02:43:12.322 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-09-21T02:43:12.348 DEBUG:teuthology.parallel:result is None 2024-09-21T02:43:12.754 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-21T02:43:24.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-21T02:43:24.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:43:25.157 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-21T02:43:25.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-21T02:43:25.556 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T02:43:25.557 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-21T02:43:25.571 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-508.el9.x86_64 2024-09-21T02:43:25.571 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T02:43:25.571 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T02:43:25.571 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T02:43:26.572 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T02:43:26.573 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T02:43:26.673 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-09-21T02:43:26.707 DEBUG:teuthology.parallel:result is None 2024-09-21T02:43:26.707 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T02:43:26.720 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T02:43:26.720 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:43:26.723 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:43:26.725 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:43:26.746 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T02:43:26.754 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T02:43:26.778 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T02:43:26.779 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:43:26.783 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:43:26.785 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:43:26.874 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T02:43:26.880 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T02:43:26.880 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:43:26.883 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:43:26.884 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:43:26.912 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:43:26.916 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:43:26.923 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:43:26.924 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:43:26.928 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:43:26.934 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:43:26.936 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T02:43:26.945 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T02:43:26.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:43:26.968 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:43:26.982 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:43:27.010 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T02:43:27.018 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T02:43:27.018 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:43:27.036 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:43:27.051 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:43:27.068 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:43:27.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:43:27.179 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:43:27.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:43:27.304 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:43:27.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:43:27.369 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:43:27.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:43:27.461 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:43:27.549 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:43:27.590 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:43:27.590 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:43:27.658 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:43:27.705 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:43:27.763 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:43:27.848 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:43:27.890 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:43:27.890 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:43:27.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-21T02:43:27.959 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-09-21T02:43:27.961 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-21T02:43:28.020 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:43:28.022 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:43:28.046 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:43:28.539 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T02:43:28.546 INFO:teuthology.task.internal:Starting timer... 2024-09-21T02:43:28.547 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T02:43:28.556 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T02:43:28.564 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T02:43:28.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-21T02:43:28.627 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-21T02:43:28.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-09-21T02:43:28.736 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-09-21T02:43:28.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-09-21T02:43:28.803 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-09-21T02:43:28.805 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T02:43:28.805 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-21T02:43:28.856 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-21T02:43:28.857 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-09-21T02:43:28.886 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-09-21T02:43:28.887 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-09-21T02:43:28.924 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-09-21T02:43:28.924 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-09-21T02:43:28.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:43:28.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:43:28.955 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:43:28.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:43:28.980 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:43:29.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:43:29.008 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T02:43:29.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:43:29.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:43:29.078 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:43:29.115 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T02:43:29.124 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T02:43:29.134 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T02:43:29.134 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi164.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T02:47:11.991 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-09-21T02:47:11.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T02:47:11.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:47:12.082 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-21T02:47:12.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T02:47:12.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-21T02:47:12.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:47:12.240 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-21T02:47:12.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-21T02:47:12.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T02:47:12.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:47:12.397 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-21T02:47:12.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-21T02:47:12.478 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T02:47:12.487 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T02:47:12.488 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:47:12.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:47:12.490 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:47:12.490 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:47:12.493 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:47:12.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:47:12.518 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:47:12.524 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:47:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:47:12.540 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:47:12.548 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:47:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-21T02:47:12.562 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:47:12.567 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-09-21T02:47:12.567 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-21T02:47:12.579 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-09-21T02:47:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:47:12.587 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-09-21T02:47:12.594 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:47:12.595 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:47:12.598 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-09-21T02:47:12.609 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:47:12.612 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:47:12.626 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:47:12.659 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:47:12.662 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:47:12.662 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-21T02:47:12.662 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.662 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.662 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.663 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.668 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:47:12.671 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:47:12.671 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-21T02:47:12.671 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.671 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.672 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.672 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.682 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:47:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:47:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-21T02:47:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.685 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.686 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:47:12.686 INFO:teuthology.run_tasks:Running task install... 2024-09-21T02:47:12.694 DEBUG:teuthology.task.install:project ceph 2024-09-21T02:47:12.694 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T02:47:12.694 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T02:47:12.695 INFO:teuthology.task.install:Using flavor: default 2024-09-21T02:47:12.699 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T02:47:12.700 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T02:47:12.700 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:47:12.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:47:12.702 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:47:12.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:47:12.703 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:47:12.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:47:12.855 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:47:12.855 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:47:12.858 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:47:12.859 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:47:12.861 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:47:12.861 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:47:12.963 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:47:12.964 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:47:12.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:47:12.974 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:47:12.974 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:47:12.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:47:12.976 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:47:12.976 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:47:12.976 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:47:12.989 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:47:12.989 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:47:13.001 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:47:13.001 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:47:13.003 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:47:13.003 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:47:13.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:47:13.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:47:13.069 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:47:13.131 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:47:13.142 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:47:13.144 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:47:13.194 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-21T02:47:13.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-21T02:47:13.206 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-09-21T02:47:13.207 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-09-21T02:47:13.208 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-09-21T02:47:13.210 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-09-21T02:47:13.427 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-21T02:47:13.431 INFO:teuthology.orchestra.run.smithi164.stdout:45 files removed 2024-09-21T02:47:13.432 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-09-21T02:47:13.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:47:13.458 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:47:13.460 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:47:14.001 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 326 kB/s | 84 kB 00:00 2024-09-21T02:47:14.005 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-21T02:47:14.010 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-21T02:47:14.352 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 78 kB/s | 24 kB 00:00 2024-09-21T02:47:14.360 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 78 kB/s | 24 kB 00:00 2024-09-21T02:47:14.364 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 76 kB/s | 24 kB 00:00 2024-09-21T02:47:14.819 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-09-21T02:47:14.820 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-09-21T02:47:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-09-21T02:47:15.524 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-21T02:47:15.605 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T02:47:16.853 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.3 MB 00:01 2024-09-21T02:47:18.683 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-21T02:47:19.054 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-21T02:47:20.539 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-21T02:47:23.026 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T02:47:23.321 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T02:47:24.560 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 19 kB 00:00 2024-09-21T02:47:25.206 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 19 kB 00:00 2024-09-21T02:47:25.506 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T02:47:25.823 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-21T02:47:26.051 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-21T02:47:27.515 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-21T02:47:28.578 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T02:47:30.862 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-21T02:47:31.440 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-21T02:47:33.057 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:47:33.058 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:47:33.071 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:47:33.073 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:47:33.073 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:47:33.075 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:47:33.077 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:47:33.079 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:47:33.080 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:47:33.144 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:47:33.160 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:47:33.161 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:47:33.162 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-21T02:47:33.163 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:47:33.164 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:47:33.165 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:47:33.166 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:47:33.167 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:47:33.168 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:47:33.169 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:47:33.170 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout:Install 149 Packages 2024-09-21T02:47:33.171 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-21T02:47:33.172 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:47:33.172 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 228 M 2024-09-21T02:47:33.172 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-21T02:47:33.651 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:47:33.652 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:47:33.663 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:47:33.664 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:47:33.665 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:47:33.666 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:47:33.667 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:47:33.670 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:47:33.671 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:47:33.734 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:47:33.752 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:47:33.753 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:47:33.754 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:47:33.755 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:47:33.756 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:47:33.757 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:47:33.758 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:47:33.759 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:47:33.760 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:47:33.761 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:47:33.762 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout:Install 149 Packages 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 8 Packages 2024-09-21T02:47:33.763 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:47:33.764 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 228 M 2024-09-21T02:47:33.764 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-21T02:47:33.975 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-21T02:47:34.163 INFO:teuthology.orchestra.run.smithi081.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-21T02:47:34.357 INFO:teuthology.orchestra.run.smithi081.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.5 MB/s | 873 kB 00:00 2024-09-21T02:47:34.405 INFO:teuthology.orchestra.run.smithi081.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T02:47:34.459 INFO:teuthology.orchestra.run.smithi181.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T02:47:34.639 INFO:teuthology.orchestra.run.smithi081.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-21T02:47:34.709 INFO:teuthology.orchestra.run.smithi181.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.4 MB/s | 873 kB 00:00 2024-09-21T02:47:34.714 INFO:teuthology.orchestra.run.smithi081.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 8.1 MB/s | 5.5 MB 00:00 2024-09-21T02:47:34.767 INFO:teuthology.orchestra.run.smithi181.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T02:47:34.848 INFO:teuthology.orchestra.run.smithi081.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.3 MB/s | 1.5 MB 00:00 2024-09-21T02:47:35.084 INFO:teuthology.orchestra.run.smithi181.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 7.2 MB/s | 5.5 MB 00:00 2024-09-21T02:47:35.190 INFO:teuthology.orchestra.run.smithi081.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-21T02:47:35.259 INFO:teuthology.orchestra.run.smithi181.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-21T02:47:35.318 INFO:teuthology.orchestra.run.smithi181.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.1 MB/s | 2.3 MB 00:00 2024-09-21T02:47:35.832 INFO:teuthology.orchestra.run.smithi081.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 11 MB/s | 20 MB 00:01 2024-09-21T02:47:35.877 INFO:teuthology.orchestra.run.smithi181.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 8.1 MB/s | 5.0 MB 00:00 2024-09-21T02:47:35.899 INFO:teuthology.orchestra.run.smithi081.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 379 kB/s | 25 kB 00:00 2024-09-21T02:47:36.107 INFO:teuthology.orchestra.run.smithi081.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 11 MB/s | 10 MB 00:00 2024-09-21T02:47:36.191 INFO:teuthology.orchestra.run.smithi081.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.7 MB/s | 226 kB 00:00 2024-09-21T02:47:36.204 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:47:36.204 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:47:36.218 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:47:36.219 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:47:36.220 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:47:36.221 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:47:36.223 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:47:36.225 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:47:36.227 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:47:36.283 INFO:teuthology.orchestra.run.smithi081.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 295 kB/s | 27 kB 00:00 2024-09-21T02:47:36.292 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-21T02:47:36.309 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-21T02:47:36.309 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:47:36.310 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:47:36.311 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:47:36.312 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:47:36.313 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:47:36.314 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:47:36.315 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:47:36.316 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:47:36.317 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:47:36.318 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:47:36.319 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:47:36.320 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout:Install 149 Packages 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 8 Packages 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:47:36.321 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 228 M 2024-09-21T02:47:36.322 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-21T02:47:36.375 INFO:teuthology.orchestra.run.smithi081.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 346 kB/s | 32 kB 00:00 2024-09-21T02:47:36.552 INFO:teuthology.orchestra.run.smithi181.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 8.9 MB/s | 20 MB 00:02 2024-09-21T02:47:36.602 INFO:teuthology.orchestra.run.smithi181.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 505 kB/s | 25 kB 00:00 2024-09-21T02:47:36.667 INFO:teuthology.orchestra.run.smithi081.stdout:(14/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 9.8 MB/s | 18 MB 00:01 2024-09-21T02:47:36.700 INFO:teuthology.orchestra.run.smithi081.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 2.3 MB/s | 766 kB 00:00 2024-09-21T02:47:36.726 INFO:teuthology.orchestra.run.smithi081.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.6 MB/s | 158 kB 00:00 2024-09-21T02:47:36.751 INFO:teuthology.orchestra.run.smithi081.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T02:47:36.801 INFO:teuthology.orchestra.run.smithi081.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T02:47:36.877 INFO:teuthology.orchestra.run.smithi081.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 602 kB/s | 45 kB 00:00 2024-09-21T02:47:36.885 INFO:teuthology.orchestra.run.smithi181.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 10 MB/s | 10 MB 00:01 2024-09-21T02:47:36.960 INFO:teuthology.orchestra.run.smithi081.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T02:47:36.986 INFO:teuthology.orchestra.run.smithi181.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.2 MB/s | 226 kB 00:00 2024-09-21T02:47:37.061 INFO:teuthology.orchestra.run.smithi081.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.6 MB/s | 161 kB 00:00 2024-09-21T02:47:37.086 INFO:teuthology.orchestra.run.smithi181.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 270 kB/s | 27 kB 00:00 2024-09-21T02:47:37.161 INFO:teuthology.orchestra.run.smithi081.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.1 MB/s | 321 kB 00:00 2024-09-21T02:47:37.186 INFO:teuthology.orchestra.run.smithi181.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 317 kB/s | 32 kB 00:00 2024-09-21T02:47:37.218 INFO:teuthology.orchestra.run.smithi164.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-09-21T02:47:37.261 INFO:teuthology.orchestra.run.smithi081.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.0 MB/s | 307 kB 00:00 2024-09-21T02:47:37.353 INFO:teuthology.orchestra.run.smithi081.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 8.8 MB/s | 5.3 MB 00:00 2024-09-21T02:47:37.378 INFO:teuthology.orchestra.run.smithi081.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 850 kB/s | 99 kB 00:00 2024-09-21T02:47:37.404 INFO:teuthology.orchestra.run.smithi081.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:47:37.478 INFO:teuthology.orchestra.run.smithi181.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 2.6 MB/s | 766 kB 00:00 2024-09-21T02:47:37.479 INFO:teuthology.orchestra.run.smithi081.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T02:47:37.563 INFO:teuthology.orchestra.run.smithi081.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 412 kB/s | 34 kB 00:00 2024-09-21T02:47:37.578 INFO:teuthology.orchestra.run.smithi181.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.6 MB/s | 158 kB 00:00 2024-09-21T02:47:37.655 INFO:teuthology.orchestra.run.smithi081.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T02:47:37.662 INFO:teuthology.orchestra.run.smithi181.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.5 MB/s | 127 kB 00:00 2024-09-21T02:47:37.762 INFO:teuthology.orchestra.run.smithi181.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.0 MB/s | 507 kB 00:00 2024-09-21T02:47:37.769 INFO:teuthology.orchestra.run.smithi164.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.6 MB/s | 873 kB 00:00 2024-09-21T02:47:37.878 INFO:teuthology.orchestra.run.smithi164.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.3 MB/s | 148 kB 00:00 2024-09-21T02:47:38.030 INFO:teuthology.orchestra.run.smithi081.stdout:(30/157): ceph-test-19.3.0-5120.g18432218.el9.x 19 MB/s | 40 MB 00:02 2024-09-21T02:47:38.089 INFO:teuthology.orchestra.run.smithi081.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 4.4 MB/s | 3.1 MB 00:00 2024-09-21T02:47:38.189 INFO:teuthology.orchestra.run.smithi081.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.9 MB/s | 292 kB 00:00 2024-09-21T02:47:38.289 INFO:teuthology.orchestra.run.smithi081.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 494 kB/s | 49 kB 00:00 2024-09-21T02:47:38.373 INFO:teuthology.orchestra.run.smithi081.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 197 kB/s | 16 kB 00:00 2024-09-21T02:47:38.395 INFO:teuthology.orchestra.run.smithi164.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 3.7 MB/s | 5.5 MB 00:01 2024-09-21T02:47:38.473 INFO:teuthology.orchestra.run.smithi081.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 2.8 MB/s | 285 kB 00:00 2024-09-21T02:47:38.546 INFO:teuthology.orchestra.run.smithi181.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 6.7 MB/s | 5.3 MB 00:00 2024-09-21T02:47:38.640 INFO:teuthology.orchestra.run.smithi081.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T02:47:38.674 INFO:teuthology.orchestra.run.smithi081.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.8 MB/s | 784 kB 00:00 2024-09-21T02:47:38.686 INFO:teuthology.orchestra.run.smithi164.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 2.3 MB 00:00 2024-09-21T02:47:38.691 INFO:teuthology.orchestra.run.smithi081.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 369 kB/s | 18 kB 00:00 2024-09-21T02:47:38.721 INFO:teuthology.orchestra.run.smithi181.stdout:(19/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 5.2 MB/s | 18 MB 00:03 2024-09-21T02:47:38.728 INFO:teuthology.orchestra.run.smithi164.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 4.5 MB/s | 1.5 MB 00:00 2024-09-21T02:47:38.746 INFO:teuthology.orchestra.run.smithi181.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 225 kB/s | 45 kB 00:00 2024-09-21T02:47:38.771 INFO:teuthology.orchestra.run.smithi181.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T02:47:38.814 INFO:teuthology.orchestra.run.smithi181.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T02:47:38.864 INFO:teuthology.orchestra.run.smithi181.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T02:47:38.914 INFO:teuthology.orchestra.run.smithi181.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.0 MB/s | 307 kB 00:00 2024-09-21T02:47:38.916 INFO:teuthology.orchestra.run.smithi081.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T02:47:38.940 INFO:teuthology.orchestra.run.smithi181.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.3 MB/s | 99 kB 00:00 2024-09-21T02:47:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 299 kB/s | 80 kB 00:00 2024-09-21T02:47:38.965 INFO:teuthology.orchestra.run.smithi181.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:47:39.031 INFO:teuthology.orchestra.run.smithi181.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T02:47:39.041 INFO:teuthology.orchestra.run.smithi081.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-21T02:47:39.067 INFO:teuthology.orchestra.run.smithi081.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-21T02:47:39.082 INFO:teuthology.orchestra.run.smithi181.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 685 kB/s | 34 kB 00:00 2024-09-21T02:47:39.117 INFO:teuthology.orchestra.run.smithi081.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 953 kB/s | 191 kB 00:00 2024-09-21T02:47:39.143 INFO:teuthology.orchestra.run.smithi081.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T02:47:39.149 INFO:teuthology.orchestra.run.smithi181.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T02:47:39.176 INFO:teuthology.orchestra.run.smithi081.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 9.1 MB/s | 1.2 MB 00:00 2024-09-21T02:47:39.226 INFO:teuthology.orchestra.run.smithi081.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-21T02:47:39.252 INFO:teuthology.orchestra.run.smithi081.stdout:(47/157): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-21T02:47:39.253 INFO:teuthology.orchestra.run.smithi164.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 8.8 MB/s | 5.0 MB 00:00 2024-09-21T02:47:39.316 INFO:teuthology.orchestra.run.smithi181.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 8.3 MB/s | 3.1 MB 00:00 2024-09-21T02:47:39.344 INFO:teuthology.orchestra.run.smithi081.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-21T02:47:39.411 INFO:teuthology.orchestra.run.smithi081.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-21T02:47:39.444 INFO:teuthology.orchestra.run.smithi081.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-21T02:47:39.478 INFO:teuthology.orchestra.run.smithi081.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-21T02:47:39.487 INFO:teuthology.orchestra.run.smithi164.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 7.7 MB/s | 20 MB 00:02 2024-09-21T02:47:39.503 INFO:teuthology.orchestra.run.smithi081.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 672 kB/s | 107 kB 00:00 2024-09-21T02:47:39.528 INFO:teuthology.orchestra.run.smithi081.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-21T02:47:39.545 INFO:teuthology.orchestra.run.smithi081.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-21T02:47:39.546 INFO:teuthology.orchestra.run.smithi164.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 432 kB/s | 25 kB 00:00 2024-09-21T02:47:39.604 INFO:teuthology.orchestra.run.smithi081.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-21T02:47:39.620 INFO:teuthology.orchestra.run.smithi081.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-21T02:47:39.680 INFO:teuthology.orchestra.run.smithi081.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T02:47:39.705 INFO:teuthology.orchestra.run.smithi081.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-21T02:47:39.755 INFO:teuthology.orchestra.run.smithi081.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-21T02:47:39.789 INFO:teuthology.orchestra.run.smithi081.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-09-21T02:47:39.848 INFO:teuthology.orchestra.run.smithi081.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T02:47:39.873 INFO:teuthology.orchestra.run.smithi081.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-21T02:47:39.940 INFO:teuthology.orchestra.run.smithi081.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 517 kB/s | 47 kB 00:00 2024-09-21T02:47:39.965 INFO:teuthology.orchestra.run.smithi081.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T02:47:40.023 INFO:teuthology.orchestra.run.smithi081.stdout:(65/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.7 MB/s | 3.0 MB 00:00 2024-09-21T02:47:40.049 INFO:teuthology.orchestra.run.smithi081.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-21T02:47:40.074 INFO:teuthology.orchestra.run.smithi081.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-21T02:47:40.104 INFO:teuthology.orchestra.run.smithi164.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T02:47:40.154 INFO:teuthology.orchestra.run.smithi164.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T02:47:40.205 INFO:teuthology.orchestra.run.smithi164.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 540 kB/s | 27 kB 00:00 2024-09-21T02:47:40.216 INFO:teuthology.orchestra.run.smithi081.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-21T02:47:40.255 INFO:teuthology.orchestra.run.smithi164.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 637 kB/s | 32 kB 00:00 2024-09-21T02:47:40.267 INFO:teuthology.orchestra.run.smithi081.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-21T02:47:40.308 INFO:teuthology.orchestra.run.smithi081.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-21T02:47:40.339 INFO:teuthology.orchestra.run.smithi164.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 766 kB 00:00 2024-09-21T02:47:40.342 INFO:teuthology.orchestra.run.smithi081.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-21T02:47:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T02:47:40.408 INFO:teuthology.orchestra.run.smithi181.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 10 MB/s | 40 MB 00:03 2024-09-21T02:47:40.417 INFO:teuthology.orchestra.run.smithi081.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 13 MB/s | 4.9 MB 00:00 2024-09-21T02:47:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T02:47:40.451 INFO:teuthology.orchestra.run.smithi081.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-21T02:47:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T02:47:40.508 INFO:teuthology.orchestra.run.smithi181.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 6.2 MB/s | 7.4 MB 00:01 2024-09-21T02:47:40.534 INFO:teuthology.orchestra.run.smithi181.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.3 MB/s | 292 kB 00:00 2024-09-21T02:47:40.543 INFO:teuthology.orchestra.run.smithi081.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-21T02:47:40.567 INFO:teuthology.orchestra.run.smithi181.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 846 kB/s | 49 kB 00:00 2024-09-21T02:47:40.568 INFO:teuthology.orchestra.run.smithi081.stdout:(75/157): python3-attrs-20.3.0-7.el9.noarch.rpm 582 kB/s | 87 kB 00:00 2024-09-21T02:47:40.601 INFO:teuthology.orchestra.run.smithi181.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 246 kB/s | 16 kB 00:00 2024-09-21T02:47:40.668 INFO:teuthology.orchestra.run.smithi081.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-09-21T02:47:40.684 INFO:teuthology.orchestra.run.smithi181.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.4 MB/s | 285 kB 00:00 2024-09-21T02:47:40.694 INFO:teuthology.orchestra.run.smithi081.stdout:(77/157): python3-colorama-0.4.6-3.el9.noarch.r 407 kB/s | 61 kB 00:00 2024-09-21T02:47:40.719 INFO:teuthology.orchestra.run.smithi081.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-21T02:47:40.726 INFO:teuthology.orchestra.run.smithi181.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 6.1 MB/s | 784 kB 00:00 2024-09-21T02:47:40.752 INFO:teuthology.orchestra.run.smithi181.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T02:47:40.752 INFO:teuthology.orchestra.run.smithi081.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-21T02:47:40.778 INFO:teuthology.orchestra.run.smithi081.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 306 kB/s | 26 kB 00:00 2024-09-21T02:47:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.3 MB 00:00 2024-09-21T02:47:40.803 INFO:teuthology.orchestra.run.smithi081.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 228 kB/s | 19 kB 00:00 2024-09-21T02:47:40.835 INFO:teuthology.orchestra.run.smithi181.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-21T02:47:40.837 INFO:teuthology.orchestra.run.smithi081.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T02:47:40.862 INFO:teuthology.orchestra.run.smithi081.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 414 kB/s | 35 kB 00:00 2024-09-21T02:47:40.904 INFO:teuthology.orchestra.run.smithi081.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T02:47:40.910 INFO:teuthology.orchestra.run.smithi181.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T02:47:40.944 INFO:teuthology.orchestra.run.smithi181.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-21T02:47:40.954 INFO:teuthology.orchestra.run.smithi081.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-21T02:47:40.988 INFO:teuthology.orchestra.run.smithi081.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 920 kB/s | 77 kB 00:00 2024-09-21T02:47:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:(19/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 7.9 MB/s | 18 MB 00:02 2024-09-21T02:47:41.013 INFO:teuthology.orchestra.run.smithi081.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 719 kB/s | 42 kB 00:00 2024-09-21T02:47:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 200 kB/s | 45 kB 00:00 2024-09-21T02:47:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T02:47:41.064 INFO:teuthology.orchestra.run.smithi081.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T02:47:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.1 MB/s | 161 kB 00:00 2024-09-21T02:47:41.086 INFO:teuthology.orchestra.run.smithi181.stdout:(42/157): ceph-mgr-dashboard-19.3.0-5120.g18432 7.3 MB/s | 14 MB 00:01 2024-09-21T02:47:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T02:47:41.111 INFO:teuthology.orchestra.run.smithi181.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-21T02:47:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T02:47:41.139 INFO:teuthology.orchestra.run.smithi081.stdout:(89/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-21T02:47:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T02:47:41.145 INFO:teuthology.orchestra.run.smithi181.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-21T02:47:41.164 INFO:teuthology.orchestra.run.smithi081.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-21T02:47:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:47:41.194 INFO:teuthology.orchestra.run.smithi181.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-21T02:47:41.198 INFO:teuthology.orchestra.run.smithi081.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T02:47:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T02:47:41.220 INFO:teuthology.orchestra.run.smithi181.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T02:47:41.223 INFO:teuthology.orchestra.run.smithi081.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-21T02:47:41.246 INFO:teuthology.orchestra.run.smithi181.stdout:(47/157): python3-ply-3.11-14.el9.noarch.rpm 670 kB/s | 106 kB 00:00 2024-09-21T02:47:41.248 INFO:teuthology.orchestra.run.smithi081.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 638 kB/s | 54 kB 00:00 2024-09-21T02:47:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 827 kB/s | 34 kB 00:00 2024-09-21T02:47:41.271 INFO:teuthology.orchestra.run.smithi181.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.7 MB/s | 215 kB 00:00 2024-09-21T02:47:41.290 INFO:teuthology.orchestra.run.smithi081.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-21T02:47:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T02:47:41.316 INFO:teuthology.orchestra.run.smithi081.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-09-21T02:47:41.383 INFO:teuthology.orchestra.run.smithi081.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-09-21T02:47:41.388 INFO:teuthology.orchestra.run.smithi181.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 107 kB 00:00 2024-09-21T02:47:41.416 INFO:teuthology.orchestra.run.smithi081.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-21T02:47:41.421 INFO:teuthology.orchestra.run.smithi181.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-21T02:47:41.447 INFO:teuthology.orchestra.run.smithi181.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-21T02:47:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 9.8 MB/s | 3.1 MB 00:00 2024-09-21T02:47:41.466 INFO:teuthology.orchestra.run.smithi081.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 569 kB/s | 47 kB 00:00 2024-09-21T02:47:41.472 INFO:teuthology.orchestra.run.smithi181.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-21T02:47:41.492 INFO:teuthology.orchestra.run.smithi081.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-09-21T02:47:41.497 INFO:teuthology.orchestra.run.smithi181.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-21T02:47:41.522 INFO:teuthology.orchestra.run.smithi181.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-21T02:47:41.573 INFO:teuthology.orchestra.run.smithi181.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-21T02:47:41.598 INFO:teuthology.orchestra.run.smithi181.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-21T02:47:41.642 INFO:teuthology.orchestra.run.smithi081.stdout:(100/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-21T02:47:41.657 INFO:teuthology.orchestra.run.smithi181.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-21T02:47:41.667 INFO:teuthology.orchestra.run.smithi081.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 288 kB/s | 58 kB 00:00 2024-09-21T02:47:41.682 INFO:teuthology.orchestra.run.smithi181.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T02:47:41.693 INFO:teuthology.orchestra.run.smithi081.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 477 kB/s | 96 kB 00:00 2024-09-21T02:47:41.707 INFO:teuthology.orchestra.run.smithi181.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-21T02:47:41.718 INFO:teuthology.orchestra.run.smithi081.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-21T02:47:41.732 INFO:teuthology.orchestra.run.smithi181.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-21T02:47:41.743 INFO:teuthology.orchestra.run.smithi081.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 593 kB/s | 45 kB 00:00 2024-09-21T02:47:41.793 INFO:teuthology.orchestra.run.smithi081.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T02:47:41.808 INFO:teuthology.orchestra.run.smithi181.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-21T02:47:41.825 INFO:teuthology.orchestra.run.smithi181.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 265 kB/s | 24 kB 00:00 2024-09-21T02:47:41.835 INFO:teuthology.orchestra.run.smithi081.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.3 MB/s | 308 kB 00:00 2024-09-21T02:47:41.858 INFO:teuthology.orchestra.run.smithi181.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-21T02:47:41.860 INFO:teuthology.orchestra.run.smithi164.stdout:(31/157): ceph-mgr-dashboard-19.3.0-5120.g18432 26 MB/s | 14 MB 00:00 2024-09-21T02:47:41.861 INFO:teuthology.orchestra.run.smithi081.stdout:(107/157): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-09-21T02:47:41.875 INFO:teuthology.orchestra.run.smithi181.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-21T02:47:41.894 INFO:teuthology.orchestra.run.smithi081.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-21T02:47:41.917 INFO:teuthology.orchestra.run.smithi181.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T02:47:41.919 INFO:teuthology.orchestra.run.smithi164.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T02:47:41.919 INFO:teuthology.orchestra.run.smithi081.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-21T02:47:41.937 INFO:teuthology.orchestra.run.smithi081.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T02:47:41.943 INFO:teuthology.orchestra.run.smithi181.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T02:47:41.962 INFO:teuthology.orchestra.run.smithi081.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T02:47:41.968 INFO:teuthology.orchestra.run.smithi181.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-21T02:47:41.969 INFO:teuthology.orchestra.run.smithi164.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 987 kB/s | 49 kB 00:00 2024-09-21T02:47:41.987 INFO:teuthology.orchestra.run.smithi081.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T02:47:42.012 INFO:teuthology.orchestra.run.smithi081.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-09-21T02:47:42.019 INFO:teuthology.orchestra.run.smithi164.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 330 kB/s | 16 kB 00:00 2024-09-21T02:47:42.060 INFO:teuthology.orchestra.run.smithi181.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T02:47:42.063 INFO:teuthology.orchestra.run.smithi081.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T02:47:42.078 INFO:teuthology.orchestra.run.smithi164.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T02:47:42.088 INFO:teuthology.orchestra.run.smithi081.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-09-21T02:47:42.102 INFO:teuthology.orchestra.run.smithi181.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-21T02:47:42.113 INFO:teuthology.orchestra.run.smithi081.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T02:47:42.139 INFO:teuthology.orchestra.run.smithi081.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T02:47:42.153 INFO:teuthology.orchestra.run.smithi164.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 10 MB/s | 784 kB 00:00 2024-09-21T02:47:42.164 INFO:teuthology.orchestra.run.smithi081.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T02:47:42.177 INFO:teuthology.orchestra.run.smithi181.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-21T02:47:42.198 INFO:teuthology.orchestra.run.smithi081.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-21T02:47:42.202 INFO:teuthology.orchestra.run.smithi181.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-21T02:47:42.231 INFO:teuthology.orchestra.run.smithi081.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T02:47:42.236 INFO:teuthology.orchestra.run.smithi181.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T02:47:42.262 INFO:teuthology.orchestra.run.smithi164.stdout:(37/157): ceph-mgr-diskprediction-local-19.3.0- 9.2 MB/s | 7.4 MB 00:00 2024-09-21T02:47:42.265 INFO:teuthology.orchestra.run.smithi081.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-21T02:47:42.286 INFO:teuthology.orchestra.run.smithi181.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-21T02:47:42.287 INFO:teuthology.orchestra.run.smithi164.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 138 kB/s | 18 kB 00:00 2024-09-21T02:47:42.298 INFO:teuthology.orchestra.run.smithi081.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-21T02:47:42.311 INFO:teuthology.orchestra.run.smithi181.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-21T02:47:42.382 INFO:teuthology.orchestra.run.smithi081.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-09-21T02:47:42.386 INFO:teuthology.orchestra.run.smithi181.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-09-21T02:47:42.412 INFO:teuthology.orchestra.run.smithi181.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 610 kB/s | 61 kB 00:00 2024-09-21T02:47:42.416 INFO:teuthology.orchestra.run.smithi081.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-09-21T02:47:42.441 INFO:teuthology.orchestra.run.smithi081.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 187 kB/s | 11 kB 00:00 2024-09-21T02:47:42.466 INFO:teuthology.orchestra.run.smithi081.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 365 kB/s | 18 kB 00:00 2024-09-21T02:47:42.491 INFO:teuthology.orchestra.run.smithi081.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T02:47:42.512 INFO:teuthology.orchestra.run.smithi181.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-09-21T02:47:42.537 INFO:teuthology.orchestra.run.smithi081.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 276 kB/s | 19 kB 00:00 2024-09-21T02:47:42.538 INFO:teuthology.orchestra.run.smithi181.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-21T02:47:42.562 INFO:teuthology.orchestra.run.smithi181.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T02:47:42.567 INFO:teuthology.orchestra.run.smithi081.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-21T02:47:42.587 INFO:teuthology.orchestra.run.smithi181.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-21T02:47:42.592 INFO:teuthology.orchestra.run.smithi081.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T02:47:42.626 INFO:teuthology.orchestra.run.smithi081.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T02:47:42.638 INFO:teuthology.orchestra.run.smithi181.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-09-21T02:47:42.646 INFO:teuthology.orchestra.run.smithi164.stdout:(39/157): ceph-test-19.3.0-5120.g18432218.el9.x 13 MB/s | 40 MB 00:03 2024-09-21T02:47:42.651 INFO:teuthology.orchestra.run.smithi081.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T02:47:42.663 INFO:teuthology.orchestra.run.smithi181.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-21T02:47:42.688 INFO:teuthology.orchestra.run.smithi181.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-21T02:47:42.710 INFO:teuthology.orchestra.run.smithi081.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-09-21T02:47:42.735 INFO:teuthology.orchestra.run.smithi081.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-21T02:47:42.739 INFO:teuthology.orchestra.run.smithi181.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-21T02:47:42.761 INFO:teuthology.orchestra.run.smithi081.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-21T02:47:42.794 INFO:teuthology.orchestra.run.smithi081.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2024-09-21T02:47:42.806 INFO:teuthology.orchestra.run.smithi181.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 5.1 MB 00:00 2024-09-21T02:47:42.819 INFO:teuthology.orchestra.run.smithi081.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 484 kB/s | 28 kB 00:00 2024-09-21T02:47:42.831 INFO:teuthology.orchestra.run.smithi181.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 839 kB/s | 77 kB 00:00 2024-09-21T02:47:42.845 INFO:teuthology.orchestra.run.smithi081.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-09-21T02:47:42.856 INFO:teuthology.orchestra.run.smithi181.stdout:(87/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-09-21T02:47:42.870 INFO:teuthology.orchestra.run.smithi081.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-21T02:47:42.881 INFO:teuthology.orchestra.run.smithi181.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 562 kB/s | 42 kB 00:00 2024-09-21T02:47:42.895 INFO:teuthology.orchestra.run.smithi081.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T02:47:42.907 INFO:teuthology.orchestra.run.smithi181.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T02:47:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T02:47:42.932 INFO:teuthology.orchestra.run.smithi181.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T02:47:42.946 INFO:teuthology.orchestra.run.smithi081.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-21T02:47:42.957 INFO:teuthology.orchestra.run.smithi181.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-21T02:47:42.971 INFO:teuthology.orchestra.run.smithi081.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 984 kB/s | 74 kB 00:00 2024-09-21T02:47:42.982 INFO:teuthology.orchestra.run.smithi181.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-21T02:47:43.005 INFO:teuthology.orchestra.run.smithi081.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-21T02:47:43.008 INFO:teuthology.orchestra.run.smithi181.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 708 kB/s | 54 kB 00:00 2024-09-21T02:47:43.030 INFO:teuthology.orchestra.run.smithi081.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T02:47:43.050 INFO:teuthology.orchestra.run.smithi181.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-09-21T02:47:43.055 INFO:teuthology.orchestra.run.smithi081.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T02:47:43.081 INFO:teuthology.orchestra.run.smithi081.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T02:47:43.092 INFO:teuthology.orchestra.run.smithi181.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 529 kB/s | 44 kB 00:00 2024-09-21T02:47:43.106 INFO:teuthology.orchestra.run.smithi081.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T02:47:43.117 INFO:teuthology.orchestra.run.smithi181.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-21T02:47:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T02:47:43.213 INFO:teuthology.orchestra.run.smithi164.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 84 kB/s | 80 kB 00:00 2024-09-21T02:47:43.309 INFO:teuthology.orchestra.run.smithi181.stdout:(97/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-09-21T02:47:43.349 INFO:teuthology.orchestra.run.smithi081.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T02:47:43.393 INFO:teuthology.orchestra.run.smithi181.stdout:(98/157): qatlib-service-24.02.0-1.el9.x86_64.r 119 kB/s | 36 kB 00:00 2024-09-21T02:47:43.418 INFO:teuthology.orchestra.run.smithi181.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 158 kB/s | 47 kB 00:00 2024-09-21T02:47:43.438 INFO:teuthology.orchestra.run.smithi164.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 241 kB/s | 191 kB 00:00 2024-09-21T02:47:43.443 INFO:teuthology.orchestra.run.smithi181.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-21T02:47:43.468 INFO:teuthology.orchestra.run.smithi181.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-09-21T02:47:43.474 INFO:teuthology.orchestra.run.smithi081.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.6 MB/s | 3.2 MB 00:00 2024-09-21T02:47:43.519 INFO:teuthology.orchestra.run.smithi181.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 953 kB/s | 96 kB 00:00 2024-09-21T02:47:43.544 INFO:teuthology.orchestra.run.smithi181.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-21T02:47:43.557 INFO:teuthology.orchestra.run.smithi081.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 491 kB/s | 41 kB 00:00 2024-09-21T02:47:43.569 INFO:teuthology.orchestra.run.smithi181.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 506 kB/s | 64 kB 00:00 2024-09-21T02:47:43.619 INFO:teuthology.orchestra.run.smithi181.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T02:47:43.641 INFO:teuthology.orchestra.run.smithi081.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T02:47:43.645 INFO:teuthology.orchestra.run.smithi181.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-21T02:47:43.683 INFO:teuthology.orchestra.run.smithi081.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.4 MB/s | 1.8 MB 00:00 2024-09-21T02:47:43.697 INFO:teuthology.orchestra.run.smithi181.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.9 MB/s | 308 kB 00:00 2024-09-21T02:47:43.720 INFO:teuthology.orchestra.run.smithi181.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-09-21T02:47:43.737 INFO:teuthology.orchestra.run.smithi181.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T02:47:43.754 INFO:teuthology.orchestra.run.smithi181.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T02:47:43.788 INFO:teuthology.orchestra.run.smithi181.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T02:47:43.825 INFO:teuthology.orchestra.run.smithi081.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.5 MB/s | 2.3 MB 00:00 2024-09-21T02:47:43.829 INFO:teuthology.orchestra.run.smithi181.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-21T02:47:43.905 INFO:teuthology.orchestra.run.smithi181.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-21T02:47:43.908 INFO:teuthology.orchestra.run.smithi081.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 1.4 MB 00:00 2024-09-21T02:47:43.938 INFO:teuthology.orchestra.run.smithi181.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T02:47:43.964 INFO:teuthology.orchestra.run.smithi181.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T02:47:43.989 INFO:teuthology.orchestra.run.smithi181.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T02:47:44.000 INFO:teuthology.orchestra.run.smithi081.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.5 MB/s | 2.4 MB 00:00 2024-09-21T02:47:44.007 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:47:44.007 INFO:teuthology.orchestra.run.smithi081.stdout:Total 21 MB/s | 228 MB 00:10 2024-09-21T02:47:44.014 INFO:teuthology.orchestra.run.smithi181.stdout:(117/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-21T02:47:44.048 INFO:teuthology.orchestra.run.smithi181.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-21T02:47:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 447 kB/s | 801 kB 00:01 2024-09-21T02:47:44.082 INFO:teuthology.orchestra.run.smithi181.stdout:(119/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-09-21T02:47:44.105 INFO:teuthology.orchestra.run.smithi164.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 284 kB/s | 253 kB 00:00 2024-09-21T02:47:44.107 INFO:teuthology.orchestra.run.smithi181.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.2 MB/s | 358 kB 00:00 2024-09-21T02:47:44.132 INFO:teuthology.orchestra.run.smithi181.stdout:(121/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-09-21T02:47:44.157 INFO:teuthology.orchestra.run.smithi181.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-21T02:47:44.191 INFO:teuthology.orchestra.run.smithi181.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-21T02:47:44.217 INFO:teuthology.orchestra.run.smithi181.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-21T02:47:44.242 INFO:teuthology.orchestra.run.smithi181.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-21T02:47:44.267 INFO:teuthology.orchestra.run.smithi181.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T02:47:44.292 INFO:teuthology.orchestra.run.smithi181.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T02:47:44.317 INFO:teuthology.orchestra.run.smithi181.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-21T02:47:44.343 INFO:teuthology.orchestra.run.smithi181.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T02:47:44.368 INFO:teuthology.orchestra.run.smithi181.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T02:47:44.393 INFO:teuthology.orchestra.run.smithi181.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T02:47:44.419 INFO:teuthology.orchestra.run.smithi181.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T02:47:44.477 INFO:teuthology.orchestra.run.smithi181.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-21T02:47:44.502 INFO:teuthology.orchestra.run.smithi181.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-21T02:47:44.536 INFO:teuthology.orchestra.run.smithi181.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-21T02:47:44.561 INFO:teuthology.orchestra.run.smithi181.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T02:47:44.587 INFO:teuthology.orchestra.run.smithi181.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-21T02:47:44.612 INFO:teuthology.orchestra.run.smithi181.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T02:47:44.637 INFO:teuthology.orchestra.run.smithi181.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T02:47:44.663 INFO:teuthology.orchestra.run.smithi181.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T02:47:44.688 INFO:teuthology.orchestra.run.smithi181.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T02:47:44.713 INFO:teuthology.orchestra.run.smithi181.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T02:47:44.738 INFO:teuthology.orchestra.run.smithi181.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T02:47:44.755 INFO:teuthology.orchestra.run.smithi164.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2024-09-21T02:47:44.789 INFO:teuthology.orchestra.run.smithi181.stdout:(144/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T02:47:44.805 INFO:teuthology.orchestra.run.smithi164.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 193 kB/s | 135 kB 00:00 2024-09-21T02:47:44.814 INFO:teuthology.orchestra.run.smithi181.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-21T02:47:44.831 INFO:teuthology.orchestra.run.smithi181.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 480 kB/s | 20 kB 00:00 2024-09-21T02:47:44.856 INFO:teuthology.orchestra.run.smithi181.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T02:47:44.898 INFO:teuthology.orchestra.run.smithi181.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-21T02:47:44.940 INFO:teuthology.orchestra.run.smithi181.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T02:47:45.132 INFO:teuthology.orchestra.run.smithi181.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T02:47:45.199 INFO:teuthology.orchestra.run.smithi181.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-21T02:47:45.230 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-21T02:47:45.258 INFO:teuthology.orchestra.run.smithi181.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 8.5 MB/s | 3.4 MB 00:00 2024-09-21T02:47:45.291 INFO:teuthology.orchestra.run.smithi181.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 445 kB/s | 41 kB 00:00 2024-09-21T02:47:45.358 INFO:teuthology.orchestra.run.smithi181.stdout:(154/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.9 MB/s | 3.2 MB 00:00 2024-09-21T02:47:45.382 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-21T02:47:45.382 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-21T02:47:45.384 INFO:teuthology.orchestra.run.smithi181.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-21T02:47:45.425 INFO:teuthology.orchestra.run.smithi181.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-21T02:47:45.506 INFO:teuthology.orchestra.run.smithi164.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 609 kB/s | 1.2 MB 00:02 2024-09-21T02:47:45.531 INFO:teuthology.orchestra.run.smithi164.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 161 kB/s | 125 kB 00:00 2024-09-21T02:47:45.602 INFO:teuthology.orchestra.run.smithi181.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-09-21T02:47:45.607 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:47:45.607 INFO:teuthology.orchestra.run.smithi181.stdout:Total 19 MB/s | 228 MB 00:11 2024-09-21T02:47:45.623 INFO:teuthology.orchestra.run.smithi164.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 263 kB/s | 215 kB 00:00 2024-09-21T02:47:45.665 INFO:teuthology.orchestra.run.smithi164.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 689 kB 00:00 2024-09-21T02:47:45.707 INFO:teuthology.orchestra.run.smithi164.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 943 kB 00:00 2024-09-21T02:47:45.724 INFO:teuthology.orchestra.run.smithi164.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-21T02:47:45.749 INFO:teuthology.orchestra.run.smithi164.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-09-21T02:47:45.774 INFO:teuthology.orchestra.run.smithi164.stdout:(53/157): boost-program-options-1.75.0-8.el9.x8 709 kB/s | 107 kB 00:00 2024-09-21T02:47:45.800 INFO:teuthology.orchestra.run.smithi164.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 433 kB/s | 33 kB 00:00 2024-09-21T02:47:45.833 INFO:teuthology.orchestra.run.smithi164.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 551 kB/s | 18 kB 00:00 2024-09-21T02:47:45.859 INFO:teuthology.orchestra.run.smithi164.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-21T02:47:45.884 INFO:teuthology.orchestra.run.smithi164.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T02:47:45.943 INFO:teuthology.orchestra.run.smithi164.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-21T02:47:45.968 INFO:teuthology.orchestra.run.smithi164.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-21T02:47:45.993 INFO:teuthology.orchestra.run.smithi164.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T02:47:46.027 INFO:teuthology.orchestra.run.smithi164.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-21T02:47:46.052 INFO:teuthology.orchestra.run.smithi164.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T02:47:46.077 INFO:teuthology.orchestra.run.smithi164.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-21T02:47:46.102 INFO:teuthology.orchestra.run.smithi164.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-21T02:47:46.128 INFO:teuthology.orchestra.run.smithi164.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T02:47:46.153 INFO:teuthology.orchestra.run.smithi164.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-21T02:47:46.178 INFO:teuthology.orchestra.run.smithi164.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-21T02:47:46.279 INFO:teuthology.orchestra.run.smithi164.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-21T02:47:46.321 INFO:teuthology.orchestra.run.smithi164.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T02:47:46.388 INFO:teuthology.orchestra.run.smithi164.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-21T02:47:46.421 INFO:teuthology.orchestra.run.smithi164.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-21T02:47:46.446 INFO:teuthology.orchestra.run.smithi164.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T02:47:46.488 INFO:teuthology.orchestra.run.smithi164.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T02:47:46.513 INFO:teuthology.orchestra.run.smithi164.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T02:47:46.556 INFO:teuthology.orchestra.run.smithi164.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T02:47:46.631 INFO:teuthology.orchestra.run.smithi164.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-21T02:47:46.656 INFO:teuthology.orchestra.run.smithi164.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T02:47:46.681 INFO:teuthology.orchestra.run.smithi164.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-21T02:47:46.707 INFO:teuthology.orchestra.run.smithi164.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-21T02:47:46.732 INFO:teuthology.orchestra.run.smithi164.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-21T02:47:46.757 INFO:teuthology.orchestra.run.smithi164.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T02:47:46.782 INFO:teuthology.orchestra.run.smithi164.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-21T02:47:46.861 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-21T02:47:46.874 INFO:teuthology.orchestra.run.smithi164.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T02:47:46.899 INFO:teuthology.orchestra.run.smithi164.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T02:47:46.925 INFO:teuthology.orchestra.run.smithi164.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T02:47:46.950 INFO:teuthology.orchestra.run.smithi164.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T02:47:46.976 INFO:teuthology.orchestra.run.smithi164.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 836 kB/s | 42 kB 00:00 2024-09-21T02:47:47.001 INFO:teuthology.orchestra.run.smithi164.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T02:47:47.017 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-21T02:47:47.017 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-21T02:47:47.026 INFO:teuthology.orchestra.run.smithi164.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T02:47:47.051 INFO:teuthology.orchestra.run.smithi164.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T02:47:47.077 INFO:teuthology.orchestra.run.smithi164.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T02:47:47.102 INFO:teuthology.orchestra.run.smithi164.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T02:47:47.169 INFO:teuthology.orchestra.run.smithi164.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T02:47:47.186 INFO:teuthology.orchestra.run.smithi164.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-09-21T02:47:47.203 INFO:teuthology.orchestra.run.smithi164.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T02:47:47.245 INFO:teuthology.orchestra.run.smithi164.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T02:47:47.261 INFO:teuthology.orchestra.run.smithi164.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-21T02:47:47.278 INFO:teuthology.orchestra.run.smithi164.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-21T02:47:47.312 INFO:teuthology.orchestra.run.smithi164.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T02:47:47.329 INFO:teuthology.orchestra.run.smithi164.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T02:47:47.354 INFO:teuthology.orchestra.run.smithi164.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-21T02:47:47.380 INFO:teuthology.orchestra.run.smithi164.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T02:47:47.397 INFO:teuthology.orchestra.run.smithi164.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T02:47:47.514 INFO:teuthology.orchestra.run.smithi164.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-21T02:47:47.632 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-21T02:47:47.632 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-21T02:47:47.681 INFO:teuthology.orchestra.run.smithi164.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-21T02:47:47.722 INFO:teuthology.orchestra.run.smithi164.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-21T02:47:47.773 INFO:teuthology.orchestra.run.smithi164.stdout:(107/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-09-21T02:47:47.798 INFO:teuthology.orchestra.run.smithi164.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-21T02:47:47.823 INFO:teuthology.orchestra.run.smithi164.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 208 kB/s | 19 kB 00:00 2024-09-21T02:47:47.849 INFO:teuthology.orchestra.run.smithi164.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-21T02:47:47.874 INFO:teuthology.orchestra.run.smithi164.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-21T02:47:47.899 INFO:teuthology.orchestra.run.smithi164.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T02:47:47.933 INFO:teuthology.orchestra.run.smithi164.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-21T02:47:47.983 INFO:teuthology.orchestra.run.smithi164.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-21T02:47:48.008 INFO:teuthology.orchestra.run.smithi164.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T02:47:48.042 INFO:teuthology.orchestra.run.smithi164.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 958 kB/s | 32 kB 00:00 2024-09-21T02:47:48.076 INFO:teuthology.orchestra.run.smithi164.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-09-21T02:47:48.101 INFO:teuthology.orchestra.run.smithi164.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-21T02:47:48.135 INFO:teuthology.orchestra.run.smithi164.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T02:47:48.160 INFO:teuthology.orchestra.run.smithi164.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T02:47:48.250 INFO:teuthology.orchestra.run.smithi164.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-21T02:47:48.277 INFO:teuthology.orchestra.run.smithi164.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-09-21T02:47:48.311 INFO:teuthology.orchestra.run.smithi164.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.4 MB/s | 220 kB 00:00 2024-09-21T02:47:48.336 INFO:teuthology.orchestra.run.smithi164.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-21T02:47:48.353 INFO:teuthology.orchestra.run.smithi164.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-09-21T02:47:48.370 INFO:teuthology.orchestra.run.smithi164.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 527 kB/s | 18 kB 00:00 2024-09-21T02:47:48.395 INFO:teuthology.orchestra.run.smithi164.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 550 kB/s | 23 kB 00:00 2024-09-21T02:47:48.420 INFO:teuthology.orchestra.run.smithi164.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-21T02:47:48.446 INFO:teuthology.orchestra.run.smithi164.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-21T02:47:48.471 INFO:teuthology.orchestra.run.smithi164.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T02:47:48.496 INFO:teuthology.orchestra.run.smithi164.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T02:47:48.522 INFO:teuthology.orchestra.run.smithi164.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T02:47:48.555 INFO:teuthology.orchestra.run.smithi164.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T02:47:48.589 INFO:teuthology.orchestra.run.smithi164.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-21T02:47:48.614 INFO:teuthology.orchestra.run.smithi164.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-21T02:47:48.640 INFO:teuthology.orchestra.run.smithi164.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T02:47:48.665 INFO:teuthology.orchestra.run.smithi164.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T02:47:48.690 INFO:teuthology.orchestra.run.smithi164.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T02:47:48.715 INFO:teuthology.orchestra.run.smithi164.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T02:47:48.805 INFO:teuthology.orchestra.run.smithi164.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-21T02:47:48.841 INFO:teuthology.orchestra.run.smithi164.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 286 kB/s | 36 kB 00:00 2024-09-21T02:47:48.866 INFO:teuthology.orchestra.run.smithi164.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T02:47:48.900 INFO:teuthology.orchestra.run.smithi164.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T02:47:48.925 INFO:teuthology.orchestra.run.smithi164.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T02:47:48.984 INFO:teuthology.orchestra.run.smithi164.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-09-21T02:47:49.009 INFO:teuthology.orchestra.run.smithi164.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-09-21T02:47:49.035 INFO:teuthology.orchestra.run.smithi164.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T02:47:49.060 INFO:teuthology.orchestra.run.smithi164.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-21T02:47:49.110 INFO:teuthology.orchestra.run.smithi164.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T02:47:49.277 INFO:teuthology.orchestra.run.smithi164.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T02:47:49.277 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-21T02:47:49.278 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-21T02:47:49.436 INFO:teuthology.orchestra.run.smithi164.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.4 MB/s | 3.2 MB 00:00 2024-09-21T02:47:50.019 INFO:teuthology.orchestra.run.smithi164.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 70 kB/s | 41 kB 00:00 2024-09-21T02:47:50.161 INFO:teuthology.orchestra.run.smithi164.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-09-21T02:47:50.287 INFO:teuthology.orchestra.run.smithi164.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-09-21T02:47:50.778 INFO:teuthology.orchestra.run.smithi164.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 328 kB/s | 249 kB 00:00 2024-09-21T02:47:51.753 INFO:teuthology.orchestra.run.smithi164.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 2.4 MB 00:01 2024-09-21T02:47:52.104 INFO:teuthology.orchestra.run.smithi164.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 714 kB/s | 1.4 MB 00:01 2024-09-21T02:47:52.110 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:47:52.110 INFO:teuthology.orchestra.run.smithi164.stdout:Total 14 MB/s | 228 MB 00:15 2024-09-21T02:47:53.326 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-21T02:47:53.483 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-21T02:47:53.483 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-21T02:47:54.155 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-21T02:47:54.280 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:47:54.318 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:47:54.371 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:47:54.407 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:47:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:47:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:47:54.834 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:47:54.950 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:47:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:47:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:47:55.176 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:47:55.205 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:47:55.236 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:47:55.410 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:47:55.470 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:47:55.498 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:47:55.604 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:47:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:47:55.669 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-21T02:47:55.706 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:47:55.711 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-21T02:47:55.711 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-21T02:47:55.733 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:47:55.755 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:47:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:47:55.910 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:47:56.089 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:47:56.123 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:47:56.147 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:47:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:47:56.218 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:47:56.406 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:47:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:47:56.577 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:47:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:47:56.682 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:47:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:47:56.810 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:47:56.842 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:47:56.916 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:47:56.947 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:47:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:47:56.977 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:47:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:47:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:47:57.146 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:47:57.147 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:47:57.202 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:47:57.210 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:47:57.230 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:47:57.255 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:47:57.297 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:47:57.335 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:47:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:47:57.364 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:47:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:47:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:47:57.428 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:47:57.457 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:47:57.480 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:47:57.485 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:47:57.539 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:47:57.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:47:57.614 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:47:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:47:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:47:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:47:57.776 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:47:57.805 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:47:57.864 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:47:57.873 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:47:57.928 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:47:57.989 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:47:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:47:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:47:58.133 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:47:58.182 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:47:58.189 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:47:58.406 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:47:58.527 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:47:58.570 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:47:58.613 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:47:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:47:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:47:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:47:58.792 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:47:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:47:58.822 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:47:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:47:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:47:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:47:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:47:58.911 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:47:58.953 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:47:58.977 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:47:59.031 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:47:59.061 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:47:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:47:59.116 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:47:59.187 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:47:59.189 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:47:59.224 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:47:59.267 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:47:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:47:59.296 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:47:59.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:47:59.367 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:47:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:47:59.419 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:47:59.457 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:47:59.493 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:47:59.494 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:47:59.540 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:47:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:47:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:47:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:47:59.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:47:59.680 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:47:59.796 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:48:00.047 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:48:00.207 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:48:00.241 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:48:00.291 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:48:00.321 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:48:00.348 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:48:00.364 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:48:00.381 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:48:00.402 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:48:00.430 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:48:00.453 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:48:00.463 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:48:00.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:48:00.590 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:48:00.613 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:48:00.671 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:48:00.712 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:48:00.761 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:48:00.762 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:48:00.807 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:48:00.835 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:48:00.843 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:48:00.882 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:48:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:48:00.914 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:48:00.940 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:48:00.952 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:48:00.976 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:48:00.995 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:48:01.023 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:48:01.028 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:48:01.067 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:48:01.070 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:48:01.105 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:48:01.190 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:48:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:48:01.265 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:48:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:48:01.311 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:48:01.376 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:48:01.433 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:48:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:48:01.496 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:48:01.537 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:48:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:48:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:48:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:48:01.753 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:48:01.778 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:48:01.863 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:48:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:48:02.026 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:48:02.056 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:48:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-21T02:48:02.089 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:48:02.128 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:48:02.136 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:48:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:48:02.189 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:48:02.190 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:48:02.207 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:48:02.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:48:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:48:02.251 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:48:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:48:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:48:02.322 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:48:02.323 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:48:02.337 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:48:02.357 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:48:02.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:48:02.383 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:48:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:48:02.431 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:48:02.444 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:48:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:48:02.501 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:48:02.515 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:48:02.535 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:48:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:48:02.665 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:48:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:48:02.740 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:48:02.818 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:48:02.873 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:48:02.995 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:48:03.105 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:48:03.129 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:48:03.220 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:48:03.251 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:48:03.289 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:48:03.387 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:48:03.438 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:48:03.456 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:48:03.472 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:48:03.474 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:48:03.532 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:48:03.560 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:48:03.571 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:48:03.572 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:48:03.627 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:48:03.672 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:48:03.672 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:48:03.702 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:48:03.761 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:48:03.765 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:48:03.795 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:48:03.800 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:48:03.817 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:48:03.984 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:48:03.989 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:48:04.013 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:48:04.110 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:48:04.150 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:48:04.286 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:48:04.401 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:48:04.479 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:48:04.692 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:48:04.773 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:48:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:48:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:48:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:48:04.871 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:48:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:48:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:48:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:48:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:48:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:48:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:48:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:48:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:48:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:48:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:48:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:48:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:48:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:48:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:48:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:48:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:48:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:48:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:48:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:48:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:48:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:48:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:48:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:48:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:48:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:48:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:48:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:48:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:48:06.085 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:48:06.108 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:48:06.138 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:48:06.162 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:48:06.185 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:48:06.235 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:48:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:48:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:48:06.405 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:48:06.480 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:48:06.517 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:48:06.555 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:48:06.590 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:48:06.621 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:48:06.632 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:48:06.659 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:48:06.783 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:48:06.835 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:48:06.853 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:48:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:48:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:48:06.926 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:48:06.990 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:48:07.071 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:48:07.103 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:48:07.139 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:48:07.187 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:48:07.222 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:48:07.265 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:48:07.307 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:48:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:48:07.442 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:48:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:48:07.484 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:48:07.516 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:48:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:48:07.547 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:48:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:48:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:48:07.751 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:48:07.991 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:48:08.124 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:48:08.317 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:48:08.444 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:48:08.452 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:08.482 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:48:08.490 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:08.510 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:48:08.544 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:48:08.591 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:48:08.623 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:48:08.653 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:48:08.688 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:48:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:48:08.762 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:48:08.797 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:48:08.879 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:48:08.922 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:48:08.954 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:48:09.065 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:48:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:09.110 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:48:09.122 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:48:09.214 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:48:09.215 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:48:09.215 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:48:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:09.253 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:48:09.836 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:48:09.837 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:09.877 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:48:09.911 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:48:10.009 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:48:10.066 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:48:10.110 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:48:10.198 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:48:10.239 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:48:10.426 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:48:10.446 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:10.453 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:48:10.482 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:48:10.531 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:48:10.560 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:48:10.560 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:48:10.560 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:48:10.561 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:10.600 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:48:11.187 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:48:11.295 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:48:12.543 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:48:12.627 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:48:12.654 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:48:12.688 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:48:13.013 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:48:13.051 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:48:13.141 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:48:13.172 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:48:13.208 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:48:13.707 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:48:13.737 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:48:13.807 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:48:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:48:16.062 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:16.093 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:16.682 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:48:16.715 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:48:16.797 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:48:16.797 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:48:16.797 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:48:16.797 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:16.833 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-21T02:48:21.083 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:21.256 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:48:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:48:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:48:21.272 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-09-21T02:48:22.411 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:22.586 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:48:22.602 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:48:22.603 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:22.603 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:48:22.603 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:48:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:48:22.885 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:22.885 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:48:22.885 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:48:22.885 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:48:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:23.119 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:48:23.142 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:48:23.142 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:23.142 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:48:23.143 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:48:23.143 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:48:23.143 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:23.612 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:48:23.635 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:48:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:48:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:48:23.635 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:48:23.636 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:23.750 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:48:23.807 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:48:23.862 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:48:24.045 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:48:24.104 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:48:24.190 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:48:24.206 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:48:24.233 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:48:24.233 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:24.233 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:48:24.233 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:48:24.233 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:48:24.233 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:24.286 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:48:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:48:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:48:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:48:24.480 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:48:24.480 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:24.481 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:48:24.481 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:48:24.481 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:48:24.481 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:48:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:48:24.949 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:48:24.973 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:48:24.973 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:24.973 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:48:24.973 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:48:24.973 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:48:24.973 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:48:25.021 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:48:25.053 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:48:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:48:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:48:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:48:25.144 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:48:25.200 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:48:25.386 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:48:25.433 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:48:25.513 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:48:25.608 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:48:25.758 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:48:25.808 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:48:25.840 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:48:25.868 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:48:26.236 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:48:26.266 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:48:26.299 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:48:26.365 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:48:26.389 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:48:28.297 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:48:28.367 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-09-21T02:48:28.640 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:28.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:48:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:48:28.838 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:28.838 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:48:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:29.326 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:48:29.350 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:48:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:48:29.593 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:48:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:48:29.654 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:48:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:48:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:48:29.686 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:29.686 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:48:29.686 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:48:29.686 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:48:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:48:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:48:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:48:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:48:30.457 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:48:30.483 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:48:30.483 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:30.484 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:48:30.484 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:48:30.484 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:48:30.484 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:30.615 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:48:30.646 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:48:30.708 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:48:30.732 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:48:30.732 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:30.732 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:48:30.732 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:48:30.732 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:48:30.732 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:30.760 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:48:30.855 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:48:30.881 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:48:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:48:30.905 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:30.905 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:48:30.905 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:48:30.905 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:48:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:30.921 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:48:30.948 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:48:30.964 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:48:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:48:30.971 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:30.971 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:48:30.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:30.988 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:48:30.988 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:30.988 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:48:30.988 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:48:30.989 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:48:30.989 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:48:31.041 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:48:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:48:31.047 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:31.047 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:48:31.047 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:48:31.047 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:48:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:31.052 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:48:31.151 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:48:31.200 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:48:31.211 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:48:31.223 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:48:31.224 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:31.224 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:48:31.224 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:48:31.224 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:48:31.224 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:31.331 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:48:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:48:31.387 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:48:31.389 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:48:31.389 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:31.389 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:48:31.389 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:48:31.390 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:48:31.390 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:31.442 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:48:31.630 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:48:31.685 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:48:31.763 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:48:31.860 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:48:32.006 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:48:32.043 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:48:32.075 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:48:32.103 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:48:32.179 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:48:32.209 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:48:32.232 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:48:32.233 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:32.233 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:48:32.233 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:48:32.233 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:48:32.233 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:32.277 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:48:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:48:32.300 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:32.300 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:48:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:32.352 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:48:32.375 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:48:32.375 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:32.375 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:48:32.375 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:48:32.375 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:48:32.375 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:32.565 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:48:32.593 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:48:32.634 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:48:32.700 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:48:32.703 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:48:32.725 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:48:32.726 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:48:32.727 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:32.727 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:48:32.727 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:48:32.727 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:48:32.727 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:35.396 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:48:35.437 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:48:35.477 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:48:35.509 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:48:35.536 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:48:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:48:35.800 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:48:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:48:35.860 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:48:35.894 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:48:35.906 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:48:35.939 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:48:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:36.579 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:48:36.782 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:48:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:48:36.863 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:48:36.890 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:48:36.900 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:48:36.931 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:48:37.046 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:48:37.116 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:48:37.162 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:48:37.192 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:48:37.206 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:48:37.222 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:48:37.233 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:48:37.258 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:48:37.258 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:37.258 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:48:37.258 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:48:37.258 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:48:37.258 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:37.268 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:48:37.309 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:48:37.320 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:48:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:48:37.419 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:48:37.475 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:48:37.501 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:48:37.554 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:48:37.647 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:48:37.679 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:48:37.704 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:48:37.730 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:48:37.731 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:48:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:48:37.814 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:48:37.850 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:37.890 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:48:37.911 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:37.932 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:48:37.937 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:37.937 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:48:38.234 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:48:38.299 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:38.440 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:48:38.470 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:48:38.494 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:48:38.494 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:38.494 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:48:38.494 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:48:38.494 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:48:38.494 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:38.538 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:48:38.560 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:48:38.560 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:38.560 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:48:38.560 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:38.621 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:48:38.645 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:48:38.645 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:38.645 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:48:38.645 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:48:38.645 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:48:38.645 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:38.749 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:48:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:48:38.870 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:48:38.962 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:48:38.964 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:48:38.987 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:48:38.987 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:48:38.987 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:48:38.987 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:48:38.987 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:48:38.987 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:48:39.015 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:48:39.041 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:48:39.041 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:48:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:48:39.134 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:48:39.218 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:48:39.243 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:48:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:39.248 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:39.436 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:39.436 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:48:39.529 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:48:39.594 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:43.002 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:48:43.042 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:48:43.083 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:48:43.116 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:48:43.143 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:48:43.349 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:48:43.406 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:48:43.436 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:48:43.466 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:48:43.504 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:48:44.100 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:44.143 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:44.164 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:48:45.020 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:48:45.099 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:48:45.151 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:48:45.252 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:48:45.285 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:48:45.310 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:48:45.336 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:48:45.337 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:48:45.404 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:48:45.404 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:48:45.449 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:45.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:48:45.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:48:45.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:48:45.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:48:45.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:48:45.449 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:48:45.450 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:48:45.451 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:48:45.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:48:45.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:48:45.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:48:45.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:48:45.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:48:45.463 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:48:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:48:45.465 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:48:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:48:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:48:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:48:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:48:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:48:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:48:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:48:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:48:45.504 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:48:45.530 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:48:45.534 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:45.535 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:45.715 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:48:45.715 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:48:45.799 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:48:45.864 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:48:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:48:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:48:46.136 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:48:46.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:48:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:48:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:48:46.140 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:48:46.141 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:48:46.142 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:48:46.143 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:48:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:48:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:48:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:48:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:48:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:48:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:48:46.144 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:48:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:48:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:48:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:48:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:48:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:48:46.145 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:48:46.146 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:48:46.147 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:48:46.148 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:48:46.149 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:48:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:48:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:48:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:48:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:48:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:48:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:48:46.150 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:48:46.151 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:48:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:48:46.152 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:48:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:48.049 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-21T02:48:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.051 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:48:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.053 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:48:48.054 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:48:48.056 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:48:48.057 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:48:48.058 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:48:48.059 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:48:48.060 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:48:48.061 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:48:48.061 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:48:48.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:48:48.061 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-21T02:48:48.474 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:48.475 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.476 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:48.477 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.478 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:48:48.479 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:48:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:48:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:48:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:48:48.483 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:48:48.484 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:48:48.485 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:48:48.486 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:48:48.487 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:48:48.487 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-21T02:48:48.505 DEBUG:teuthology.parallel:result is None 2024-09-21T02:48:48.903 DEBUG:teuthology.parallel:result is None 2024-09-21T02:48:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:48:52.330 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:48:52.331 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:48:52.332 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:48:52.333 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:48:52.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:48:52.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:48:52.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:48:52.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:48:52.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:48:52.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:48:52.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:48:52.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:48:52.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:48:52.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:48:52.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:48:52.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:48:52.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:48:52.352 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:48:52.353 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:48:52.354 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:48:52.354 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:48:52.354 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:48:55.059 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:48:55.059 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:55.059 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:48:55.060 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.061 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:48:55.062 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:48:55.063 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:48:55.064 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:48:55.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:48:55.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:48:55.068 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:48:55.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:48:55.070 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:48:55.071 INFO:teuthology.orchestra.run.smithi164.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:48:55.071 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:48:55.071 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:48:55.071 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:48:55.071 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:48:55.071 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-21T02:48:55.495 DEBUG:teuthology.parallel:result is None 2024-09-21T02:48:55.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:48:55.636 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:48:55.663 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:48:55.664 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:48:55.664 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:48:55.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:48:55.802 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:48:55.825 INFO:teuthology.orchestra.run.smithi164.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:48:55.825 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:48:55.825 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:48:55.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:48:55.966 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:48:55.992 INFO:teuthology.orchestra.run.smithi181.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:48:55.992 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:48:55.993 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:48:55.994 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T02:48:55.994 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:48:55.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:48:56.027 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:48:56.027 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:48:56.055 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:48:56.055 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:48:56.088 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T02:48:56.088 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:48:56.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:48:56.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:48:56.184 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:48:56.184 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:48:56.209 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:48:56.275 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:48:56.275 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:48:56.305 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:48:56.373 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T02:48:56.373 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:48:56.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:48:56.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:48:56.468 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:48:56.468 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:48:56.493 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:48:56.558 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:48:56.558 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:48:56.587 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:48:56.657 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T02:48:56.657 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:48:56.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:48:56.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:48:56.753 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:48:56.753 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:48:56.778 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:48:56.843 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:48:56.843 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:48:56.873 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:48:56.942 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T02:48:57.027 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T02:48:57.027 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:48:57.028 INFO:tasks.cephadm:Cluster fsid is 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:48:57.028 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T02:48:57.028 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.81', 'mon.b': '172.21.15.164', 'mon.c': '172.21.15.181'} 2024-09-21T02:48:57.028 INFO:tasks.cephadm:First mon is mon.a on smithi081 2024-09-21T02:48:57.028 INFO:tasks.cephadm:First mgr is x 2024-09-21T02:48:57.028 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T02:48:57.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-09-21T02:48:57.057 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname $(hostname -s) 2024-09-21T02:48:57.082 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-09-21T02:48:57.111 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T02:48:57.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:48:57.252 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T02:48:57.389 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:48:57.391 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T02:48:57.391 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T02:48:57.391 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:57.923 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:48 /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:57.924 DEBUG:teuthology.orchestra.run.smithi164:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:58.455 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:48 /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:58.455 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:58.978 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:48 /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:58.978 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:58.997 DEBUG:teuthology.orchestra.run.smithi164:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:59.017 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:48:59.050 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T02:48:59.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:48:59.052 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:48:59.060 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:49:00.711 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:49:00.739 INFO:teuthology.orchestra.run.smithi164.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:49:00.932 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:49:34.366 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T02:49:34.366 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:49:34.366 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:49:34.366 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-09-21T02:49:34.366 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:49:34.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T02:49:34.367 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T02:49:43.816 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-21T02:49:43.816 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:49:43.817 INFO:teuthology.orchestra.run.smithi164.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:49:43.817 INFO:teuthology.orchestra.run.smithi164.stdout: "repo_digests": [ 2024-09-21T02:49:43.817 INFO:teuthology.orchestra.run.smithi164.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:49:43.817 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-09-21T02:49:43.817 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-21T02:49:44.470 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T02:49:44.470 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:49:44.470 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:49:44.470 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-09-21T02:49:44.471 INFO:teuthology.orchestra.run.smithi181.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:49:44.471 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-21T02:49:44.471 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T02:49:44.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-09-21T02:49:44.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph 2024-09-21T02:49:44.561 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-09-21T02:49:44.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-09-21T02:49:44.617 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /etc/ceph 2024-09-21T02:49:44.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-09-21T02:49:44.669 INFO:tasks.cephadm:Writing seed config... 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T02:49:44.670 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T02:49:44.671 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T02:49:44.672 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T02:49:44.672 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T02:49:44.672 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T02:49:44.672 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T02:49:44.672 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T02:49:44.672 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T02:49:44.673 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:49:44.673 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T02:49:44.691 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0bfe3ac0-77c4-11ef-baf5-efdc52797490 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-21T02:49:44.691 DEBUG:teuthology.orchestra.run.smithi081:mon.a> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T02:49:44.734 DEBUG:teuthology.orchestra.run.smithi081:mgr.x> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T02:49:44.776 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T02:49:44.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.81 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:49:44.977 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:49:44.977 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.81', '--skip-admin-label'] 2024-09-21T02:49:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T02:49:44.978 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying podman|docker is present... 2024-09-21T02:49:45.002 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-21T02:49:45.002 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying lvm2 is present... 2024-09-21T02:49:45.002 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying time synchronization is in place... 2024-09-21T02:49:45.010 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T02:49:45.010 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T02:49:45.016 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T02:49:45.016 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-21T02:49:45.022 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-21T02:49:45.029 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-21T02:49:45.029 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-21T02:49:45.029 INFO:teuthology.orchestra.run.smithi081.stdout:Repeating the final host check... 2024-09-21T02:49:45.051 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-21T02:49:45.051 INFO:teuthology.orchestra.run.smithi081.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T02:49:45.051 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl is present 2024-09-21T02:49:45.051 INFO:teuthology.orchestra.run.smithi081.stdout:lvcreate is present 2024-09-21T02:49:45.057 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T02:49:45.057 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T02:49:45.064 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T02:49:45.064 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-21T02:49:45.070 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-21T02:49:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-21T02:49:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-21T02:49:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:Host looks OK 2024-09-21T02:49:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:Cluster fsid: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:49:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:Acquiring lock 140293760506512 on /run/cephadm/0bfe3ac0-77c4-11ef-baf5-efdc52797490.lock 2024-09-21T02:49:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:Lock 140293760506512 acquired on /run/cephadm/0bfe3ac0-77c4-11ef-baf5-efdc52797490.lock 2024-09-21T02:49:45.077 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 3300 ... 2024-09-21T02:49:45.078 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 6789 ... 2024-09-21T02:49:45.078 INFO:teuthology.orchestra.run.smithi081.stdout:Base mon IP(s) is [172.21.15.81:3300, 172.21.15.81:6789], mon addrv is [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-21T02:49:45.081 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.81 metric 100 2024-09-21T02:49:45.081 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.81 metric 100 2024-09-21T02:49:45.083 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T02:49:45.083 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T02:49:45.083 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T02:49:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T02:49:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T02:49:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T02:49:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T02:49:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T02:49:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T02:49:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-21T02:49:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-21T02:49:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T02:49:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T02:49:45.088 INFO:teuthology.orchestra.run.smithi081.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:49:45.516 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T02:49:45.517 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:49:45.517 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T02:49:45.517 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T02:49:45.517 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T02:49:45.517 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T02:49:45.517 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T02:49:46.422 INFO:teuthology.orchestra.run.smithi081.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T02:49:46.422 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T02:49:46.422 INFO:teuthology.orchestra.run.smithi081.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T02:49:47.427 INFO:teuthology.orchestra.run.smithi081.stdout:stat: stdout 167 167 2024-09-21T02:49:47.428 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial keys... 2024-09-21T02:49:48.334 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBLNO5m20YCLhAA8BaIQtW+b0tcOBayqG51OQ== 2024-09-21T02:49:49.256 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBMNO5m43h0JhAA0AbjIxn2E26PpqOgyoAKWQ== 2024-09-21T02:49:50.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBNNO5mSRVUJBAAUcBWc8Etbh1FIK5gr77iMQ== 2024-09-21T02:49:50.221 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial monmap... 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool for a [v2:172.21.15.81:3300,v1:172.21.15.81:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: set fsid to 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:49:51.126 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mon... 2024-09-21T02:49:52.040 INFO:teuthology.orchestra.run.smithi081.stdout:create mon.a on 2024-09-21T02:49:52.235 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T02:49:52.397 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T02:49:52.607 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490.target. 2024-09-21T02:49:52.607 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490.target. 2024-09-21T02:49:52.844 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a 2024-09-21T02:49:52.844 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T02:49:53.012 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490.target.wants/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@.service. 2024-09-21T02:49:53.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:53 smithi081 podman[30593]: 2024-09-21 02:49:53.148024273 +0000 UTC m=+0.016496512 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:49:53.507 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:49:53.507 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-21T02:49:53.514 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:49:53.514 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-21T02:49:53.514 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-21T02:49:53.514 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T02:49:53.515 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon to start... 2024-09-21T02:49:53.515 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon... 2024-09-21T02:49:53.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:53 smithi081 podman[30593]: 2024-09-21 02:49:53.433346379 +0000 UTC m=+0.301818606 container init 0c5c2f07f52002dc33e826c975746fe9862f66caa49524e0827e381e9098697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:49:53.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:53 smithi081 podman[30593]: 2024-09-21 02:49:53.436465373 +0000 UTC m=+0.304937600 container start 0c5c2f07f52002dc33e826c975746fe9862f66caa49524e0827e381e9098697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T02:49:53.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:53 smithi081 ceph-mon[30612]: mkfs 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:49:53.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:53 smithi081 ceph-mon[30612]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:49:53.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:53 smithi081 bash[30593]: 0c5c2f07f52002dc33e826c975746fe9862f66caa49524e0827e381e9098697b 2024-09-21T02:49:53.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:53 smithi081 systemd[1]: Started Ceph mon.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout id: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout services: 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.515861s) 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:49:54.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout data: 2024-09-21T02:49:54.505 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T02:49:54.505 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T02:49:54.505 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T02:49:54.505 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T02:49:54.505 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:49:54.505 INFO:teuthology.orchestra.run.smithi081.stdout:mon is available 2024-09-21T02:49:54.505 INFO:teuthology.orchestra.run.smithi081.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T02:49:54.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: monmap epoch 1 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: last_changed 2024-09-21T02:49:50.579009+0000 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: created 2024-09-21T02:49:50.579009+0000 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: min_mon_release 19 (squid) 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: election_strategy: 1 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: fsmap 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: mgrmap e1: no daemons active 2024-09-21T02:49:54.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:54 smithi081 ceph-mon[30612]: from='client.? 172.21.15.81:0/1936179306' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T02:49:55.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T02:49:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T02:49:55.488 INFO:teuthology.orchestra.run.smithi081.stdout:Generating new minimal ceph.conf... 2024-09-21T02:49:55.733 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:55 smithi081 ceph-mon[30612]: from='client.? 172.21.15.81:0/3254280905' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T02:49:55.733 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:55 smithi081 ceph-mon[30612]: from='client.? 172.21.15.81:0/3254280905' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T02:49:56.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:56 smithi081 ceph-mon[30612]: from='client.? 172.21.15.81:0/1684744428' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:49:56.616 INFO:teuthology.orchestra.run.smithi081.stdout:Restarting the monitor... 2024-09-21T02:49:57.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:56 smithi081 systemd[1]: Stopping Ceph mon.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:49:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a[30608]: 2024-09-21T02:49:57.734+0000 7ff947cf9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a[30608]: 2024-09-21T02:49:57.734+0000 7ff947cf9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T02:49:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:49:57 smithi081 podman[30861]: 2024-09-21 02:49:57.949323902 +0000 UTC m=+1.164671515 container died 0c5c2f07f52002dc33e826c975746fe9862f66caa49524e0827e381e9098697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T02:50:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:01 smithi081 podman[30861]: 2024-09-21 02:50:01.585342728 +0000 UTC m=+4.800690341 container cleanup 0c5c2f07f52002dc33e826c975746fe9862f66caa49524e0827e381e9098697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T02:50:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:01 smithi081 bash[30861]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a 2024-09-21T02:50:03.900 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:03 smithi081 podman[30874]: 2024-09-21 02:50:03.769793311 +0000 UTC m=+5.816631344 container remove 0c5c2f07f52002dc33e826c975746fe9862f66caa49524e0827e381e9098697b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T02:50:04.241 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:04 smithi081 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T02:50:04.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:04 smithi081 systemd[1]: Stopped Ceph mon.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:50:04.242 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:04 smithi081 systemd[1]: Starting Ceph mon.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:50:04.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:04 smithi081 podman[30970]: 2024-09-21 02:50:04.143547864 +0000 UTC m=+0.016501017 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:04 smithi081 podman[30970]: 2024-09-21 02:50:04.764667499 +0000 UTC m=+0.637620644 container create 4868ece53fa78f269a1a809b862b9f7c8eca2866832c35c063639c02a13416b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:04 smithi081 podman[30970]: 2024-09-21 02:50:04.975137403 +0000 UTC m=+0.848090554 container init 4868ece53fa78f269a1a809b862b9f7c8eca2866832c35c063639c02a13416b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:04 smithi081 podman[30970]: 2024-09-21 02:50:04.97842551 +0000 UTC m=+0.851378656 container start 4868ece53fa78f269a1a809b862b9f7c8eca2866832c35c063639c02a13416b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: pidfile_write: ignore empty --pid-file 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: load: jerasure load: lrc 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: RocksDB version: 7.9.2 2024-09-21T02:50:05.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Git sha 0 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: DB SUMMARY 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: DB Session ID: 635ZUKH3XIR18B0OSDZ9 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: CURRENT file: CURRENT 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94292 ; 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.error_if_exists: 0 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.create_if_missing: 0 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.paranoid_checks: 1 2024-09-21T02:50:05.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T02:50:05.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T02:50:05.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T02:50:05.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.env: 0x55dbb7de3d60 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.info_log: 0x55dbbdc33360 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.statistics: (nil) 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.use_fsync: 0 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_log_file_size: 0 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.allow_fallocate: 1 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T02:50:05.019 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.use_direct_reads: 0 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.db_log_dir: 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.wal_dir: 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.write_buffer_manager: 0x55dbbdc37d60 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T02:50:05.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.unordered_write: 0 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.row_cache: None 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.wal_filter: None 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T02:50:05.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.two_write_queues: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.wal_compression: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.atomic_flush: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.log_readahead_size: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T02:50:05.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_background_jobs: 2 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_background_compactions: -1 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_subcompactions: 1 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_open_files: -1 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T02:50:05.023 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_background_flushes: -1 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Compression algorithms supported: 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kZSTD supported: 0 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kXpressCompression supported: 0 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kBZip2Compression supported: 0 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kLZ4Compression supported: 1 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kZlibCompression supported: 1 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: kSnappyCompression supported: 1 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T02:50:05.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.merge_operator: 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_filter: None 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dbbdc32fa0) 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-09-21T02:50:05.025 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_type: 0 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_index_type: 0 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_shortening: 1 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: checksum: 4 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: no_block_cache: 0 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache: 0x55dbb9bf7610 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_options: 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: capacity : 536870912 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_shard_bits : 4 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: strict_capacity_limit : 0 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-09-21T02:50:05.026 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_compressed: (nil) 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: persistent_cache: (nil) 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size: 4096 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size_deviation: 10 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_restart_interval: 16 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_block_restart_interval: 1 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: metadata_block_size: 4096 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: partition_filters: 0 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: use_delta_encoding: 1 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: filter_policy: bloomfilter 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: whole_key_filtering: 1 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: verify_compression: 0 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-09-21T02:50:05.027 INFO:journalctl@ceph.mon.a.smithi081.stdout: format_version: 5 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_index_compression: 1 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_align: 0 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout: max_auto_readahead_size: 262144 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout: prepopulate_block_cache: 0 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout: initial_auto_readahead_size: 8192 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression: NoCompression 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.num_levels: 7 2024-09-21T02:50:05.028 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T02:50:05.029 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T02:50:05.030 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T02:50:05.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T02:50:05.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T02:50:05.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T02:50:05.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T02:50:05.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T02:50:05.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T02:50:05.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T02:50:05.032 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.inplace_update_support: 0 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T02:50:05.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.bloom_locality: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.max_successive_merges: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.ttl: 2592000 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.enable_blob_files: false 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.min_blob_size: 0 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T02:50:05.034 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 44461e4f-b1b7-4b96-a223-ce5bc01ec0a5 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726887005014731, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726887005016364, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90596, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 281, "table_properties": {"data_size": 88637, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11462, "raw_average_key_size": 47, "raw_value_size": 82117, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 240, "num_filter_entries": 240, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726887005, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "44461e4f-b1b7-4b96-a223-ce5bc01ec0a5", "db_session_id": "635ZUKH3XIR18B0OSDZ9", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726887005016530, "job": 1, "event": "recovery_finished"} 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T02:50:05.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dbbdc56a80 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: DB pointer 0x55dbbe9fc000 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** DB Stats ** 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-21T02:50:05.036 INFO:journalctl@ceph.mon.a.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: L0 2/0 90.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: Sum 2/0 90.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 91.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T02:50:05.037 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative compaction: 0.00 GB write, 19.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval compaction: 0.00 GB write, 19.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache BinnedLRUCache@0x55dbb9bf7610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T02:50:05.038 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: starting mon.a rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:05.084 INFO:teuthology.orchestra.run.smithi081.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???) e1 preinit fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???).mds e1 new map 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???).mds e1 print_map 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: e1 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: btime 2024-09-21T02:49:53:484787+0000 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: legacy client fscid: -1 2024-09-21T02:50:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: No filesystems configured 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 bash[30970]: 4868ece53fa78f269a1a809b862b9f7c8eca2866832c35c063639c02a13416b2 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: monmap epoch 1 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: last_changed 2024-09-21T02:49:50.579009+0000 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: created 2024-09-21T02:49:50.579009+0000 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: min_mon_release 19 (squid) 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: election_strategy: 1 2024-09-21T02:50:05.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T02:50:05.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: fsmap 2024-09-21T02:50:05.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T02:50:05.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 ceph-mon[30991]: mgrmap e1: no daemons active 2024-09-21T02:50:05.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:05 smithi081 systemd[1]: Started Ceph mon.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:50:06.135 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T02:50:06.157 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:50:06.157 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mgr... 2024-09-21T02:50:06.157 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T02:50:06.158 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T02:50:06.391 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.x 2024-09-21T02:50:06.391 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T02:50:06.539 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490.target.wants/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@.service. 2024-09-21T02:50:06.769 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:06 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3540593902' entity='client.admin' 2024-09-21T02:50:07.029 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:06 smithi081 podman[31202]: 2024-09-21 02:50:06.972661592 +0000 UTC m=+0.317484418 container start 6f2af48afde9e80815a33464a3cb1eaf7a40399ab1ef0d7dc3e0b3ba9672cd06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T02:50:07.029 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:07 smithi081 bash[31202]: 6f2af48afde9e80815a33464a3cb1eaf7a40399ab1ef0d7dc3e0b3ba9672cd06 2024-09-21T02:50:07.043 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:50:07.043 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-21T02:50:07.050 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:50:07.050 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-21T02:50:07.050 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-21T02:50:07.050 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T02:50:07.060 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:50:07.060 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-21T02:50:07.069 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:50:07.069 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-21T02:50:07.069 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-21T02:50:07.069 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T02:50:07.069 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr to start... 2024-09-21T02:50:07.069 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr... 2024-09-21T02:50:07.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:07 smithi081 systemd[1]: Started Ceph mgr.x for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:50:07.944 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:07 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3651653817' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:50:08.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:50:08.241 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:50:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:50:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:08.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:50:08.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:50:08.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:50:08.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:50:08.244 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:50:08.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:50:08.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:50:08.246 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:49:53:484787+0000", 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:50:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:49:53.486913+0000", 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:50:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (1/15)... 2024-09-21T02:50:12.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: Activating manager daemon x 2024-09-21T02:50:12.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: mgrmap e2: x(active, starting, since 0.00384233s) 2024-09-21T02:50:12.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:50:12.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:50:12.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: Manager daemon x is now available 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' 2024-09-21T02:50:12.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:12 smithi081 ceph-mon[30991]: from='mgr.14100 172.21.15.81:0/3860109293' entity='mgr.x' 2024-09-21T02:50:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:13 smithi081 ceph-mon[30991]: mgrmap e3: x(active, since 1.00752s) 2024-09-21T02:50:14.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:50:14.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:50:14.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T02:50:14.779 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:50:14.780 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:50:14.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:50:14.784 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:50:14.784 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:50:14.784 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:50:14.784 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:14.784 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:49:53:484787+0000", 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:50:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:50:14.786 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:49:53.486913+0000", 2024-09-21T02:50:14.787 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:50:14.787 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:50:14.787 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:50:14.787 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:50:14.787 INFO:teuthology.orchestra.run.smithi081.stdout:mgr is available 2024-09-21T02:50:15.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:14 smithi081 ceph-mon[30991]: mgrmap e4: x(active, since 2s) 2024-09-21T02:50:15.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:14 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1704041108' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:50:15.977 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-21T02:50:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T02:50:15.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T02:50:15.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T02:50:15.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T02:50:15.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T02:50:15.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T02:50:15.979 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling cephadm module... 2024-09-21T02:50:16.300 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:15 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2214164004' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T02:50:17.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:16 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3182309142' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T02:50:17.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:17 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: ignoring --setuser ceph since I am not root 2024-09-21T02:50:17.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:17 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: ignoring --setgroup ceph since I am not root 2024-09-21T02:50:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:17 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3182309142' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T02:50:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:17 smithi081 ceph-mon[30991]: mgrmap e5: x(active, since 5s) 2024-09-21T02:50:18.883 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:50:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T02:50:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:50:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T02:50:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T02:50:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:50:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-21T02:50:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 5... 2024-09-21T02:50:19.014 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:18 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4102972284' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: Active manager daemon x restarted 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: Activating manager daemon x 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: mgrmap e6: x(active, starting, since 0.00420741s) 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:50:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:22 smithi081 ceph-mon[30991]: Manager daemon x is now available 2024-09-21T02:50:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:50:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T02:50:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T02:50:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:50:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 5 is available 2024-09-21T02:50:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying orchestrator module is enabled... 2024-09-21T02:50:23.832 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: Found migration_current of "None". Setting to last migration. 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: mgrmap e7: x(active, since 1.00651s) 2024-09-21T02:50:23.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T02:50:23.834 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:23.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:50:23.688+0000 7f4a038b5640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:02:50:23] ENGINE Error in HTTPServer.serve 2024-09-21T02:50:23.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: Traceback (most recent call last): 2024-09-21T02:50:23.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:50:23.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self._connections.run(self.expiration_interval) 2024-09-21T02:50:23.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:50:23.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self._run(expiration_interval) 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: s = self.context.wrap_socket( 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: return self.sslsocket_class._create( 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self.do_handshake() 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:50:23.835 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self._sslobj.do_handshake() 2024-09-21T02:50:23.836 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:50:23.836 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:50:25.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:24 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:23] ENGINE Bus STARTING 2024-09-21T02:50:25.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:24 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:23] ENGINE Serving on http://172.21.15.81:8765 2024-09-21T02:50:25.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:24 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:23] ENGINE Serving on https://172.21.15.81:7150 2024-09-21T02:50:25.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:24 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:23] ENGINE Bus STARTED 2024-09-21T02:50:25.043 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:24 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:23] ENGINE Error in HTTPServer.serve 2024-09-21T02:50:25.043 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-21T02:50:25.044 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:50:25.045 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-21T02:50:25.045 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:50:25.045 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:24 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1344506456' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T02:50:25.313 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T02:50:25.313 INFO:teuthology.orchestra.run.smithi081.stdout:Setting orchestrator backend to cephadm... 2024-09-21T02:50:25.939 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:25 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1344506456' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T02:50:25.939 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:25 smithi081 ceph-mon[30991]: mgrmap e8: x(active, since 2s) 2024-09-21T02:50:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:26 smithi081 ceph-mon[30991]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:26 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:26 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:27.700 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T02:50:27.700 INFO:teuthology.orchestra.run.smithi081.stdout:Generating ssh key... 2024-09-21T02:50:28.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-mon[30991]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:28.970 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: Generating public/private rsa key pair. 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: Your identification has been saved in /tmp/tmpcocnhrgz/key 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: Your public key has been saved in /tmp/tmpcocnhrgz/key.pub 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: The key fingerprint is: 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: SHA256:TYNZGXb9nvYWAyAuCKbuUjm8pj55/UjI+bL/E9To8uo ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: The key's randomart image is: 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: +---[RSA 3072]----+ 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: | +o.. | 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: | o *.o . | 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: | o . . * + . . | 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: | . . + = . . .| 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: |.. . o S . ...| 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: | .* o. o =.| 2024-09-21T02:50:28.971 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: |...*..o . . +| 2024-09-21T02:50:28.972 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: |.+ooo..o o| 2024-09-21T02:50:28.972 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: |++o.=E+o. . | 2024-09-21T02:50:28.972 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: +----[SHA256]-----+ 2024-09-21T02:50:29.884 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:29 smithi081 ceph-mon[30991]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:29.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:29 smithi081 ceph-mon[30991]: Generating ssh key... 2024-09-21T02:50:29.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:29 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:29.885 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:29 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:30.463 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfHOIysxFlAdjFoB179duSQcu6QfYy6UBqk4GA7DIxTH8USHgxBRtqQchi6NmjtOTHSSFgJVluVVYnOiZc+eGOaCIkVcoCQ6REYWqiDRO4aeUygAW1756oVm3hxKsH07yegk9n5hvWdV4L9iQrejSSdgiwzGjvCFJnoT25Gp42tV2+yaXLJEGdULDYIBQAEG0331DxuxhZ9/v7oPhTWnJ40DcIg5yqzmkpSGxbxwBQXb0uwK2DAeUKDPAvpiL+Qa/cfU6gc+aSzAaiC4qyoCzTypGSming7uG6CIiJnC8bY+tTdGKZH7iDl3d7Hk3fMziBOkKLKIPq/YRRFv25Js4HjFnJlJHssgSLfo5Q9sB+OmMWRs3iVjRhpowEzCMe47klWuTOKgtX30do2AslS2UHgj/Bj/DmiRj0VtJylLHgM8L2KEbRk/g0b0P8NMsCSch+t5eqTCvb/q4nLjZlMZj5n3zLcEkfadT78cEipFfA4z949s/WffR/WW+nYobw2mk= ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:30.463 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:50:30.463 INFO:teuthology.orchestra.run.smithi081.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T02:50:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:Adding host smithi081... 2024-09-21T02:50:30.780 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:30 smithi081 ceph-mon[30991]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:31.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:31 smithi081 ceph-mon[30991]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:32.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:32 smithi081 ceph-mon[30991]: Deploying cephadm binary to smithi081 2024-09-21T02:50:34.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Added host 'smithi081' with addr '172.21.15.81' 2024-09-21T02:50:34.823 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mon service... 2024-09-21T02:50:35.350 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:35 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:35.350 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:35 smithi081 ceph-mon[30991]: Added host smithi081 2024-09-21T02:50:35.350 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:35 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:36.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T02:50:36.577 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mgr service... 2024-09-21T02:50:36.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:36 smithi081 ceph-mon[30991]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:36.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:36 smithi081 ceph-mon[30991]: Saving service mon spec with placement count:5 2024-09-21T02:50:36.668 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:36 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:38.248 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:37 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:38.249 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:37 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:38.249 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:37 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:38.748 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T02:50:39.132 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:38 smithi081 ceph-mon[30991]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:39.132 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:38 smithi081 ceph-mon[30991]: Saving service mgr spec with placement count:2 2024-09-21T02:50:40.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:40 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:40.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:40 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/942606985' entity='client.admin' 2024-09-21T02:50:41.111 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling the dashboard module... 2024-09-21T02:50:41.769 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:41 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/160823174' entity='client.admin' 2024-09-21T02:50:41.769 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:41 smithi081 ceph-mon[30991]: from='mgr.14116 172.21.15.81:0/2271464511' entity='mgr.x' 2024-09-21T02:50:42.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:42 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1818315411' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T02:50:42.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:42 smithi081 ceph-mon[30991]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:50:42.805 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:42 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: ignoring --setuser ceph since I am not root 2024-09-21T02:50:42.805 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:42 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: ignoring --setgroup ceph since I am not root 2024-09-21T02:50:43.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:43 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1818315411' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T02:50:43.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:43 smithi081 ceph-mon[30991]: mgrmap e9: x(active, since 20s) 2024-09-21T02:50:44.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:50:44.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T02:50:44.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:50:44.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T02:50:44.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T02:50:44.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:50:44.434 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-21T02:50:44.434 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 9... 2024-09-21T02:50:44.682 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:44 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2236344390' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T02:50:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: Active manager daemon x restarted 2024-09-21T02:50:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: Activating manager daemon x 2024-09-21T02:50:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T02:50:47.990 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: mgrmap e10: x(active, starting, since 0.0043413s) 2024-09-21T02:50:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:50:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:50:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:50:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:50:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:50:47.991 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:47 smithi081 ceph-mon[30991]: Manager daemon x is now available 2024-09-21T02:50:48.913 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:50:48.913 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:50:48.913 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:50:48.913 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-mon[30991]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T02:50:48.913 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-mon[30991]: mgrmap e11: x(active, since 1.00686s) 2024-09-21T02:50:49.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:50:48.910+0000 7fe858d8a640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:02:50:48] ENGINE Error in HTTPServer.serve 2024-09-21T02:50:49.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: Traceback (most recent call last): 2024-09-21T02:50:49.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:50:49.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self._connections.run(self.expiration_interval) 2024-09-21T02:50:49.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self._run(expiration_interval) 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: s = self.context.wrap_socket( 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: return self.sslsocket_class._create( 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self.do_handshake() 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: self._sslobj.do_handshake() 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:50:49.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:50:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:50:49.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:50:49.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T02:50:49.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T02:50:49.643 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:50:49.643 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 9 is available 2024-09-21T02:50:49.643 INFO:teuthology.orchestra.run.smithi081.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:50 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:48] ENGINE Bus STARTING 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:50 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:48] ENGINE Serving on https://172.21.15.81:7150 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:50 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:48] ENGINE Error in HTTPServer.serve 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-21T02:50:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:50 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:49] ENGINE Serving on http://172.21.15.81:8765 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:50 smithi081 ceph-mon[30991]: [21/Sep/2024:02:50:49] ENGINE Bus STARTED 2024-09-21T02:50:50.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:50:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:51 smithi081 ceph-mon[30991]: mgrmap e12: x(active, since 2s) 2024-09-21T02:50:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:51 smithi081 ceph-mon[30991]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:51 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:50:52.154 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUNCymB46D/8FIVtRdqnVljz4HFwAwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAyNTA1MVoXDTM0\nMDkyMjAyNTA1MVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjgxMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAifiGbeLJC+XfYtzIgJl88ZNWwxZehjzPNwSk\nUIXqrRspjJXvCXRfsEGMj3ro+OZrGESs5yrA2w/pzkTy/kcolYO3fLCOOgBs6x4A\njS5FRilpRrZjxuRMCvN4osH3RtEQpAbv7EyyY2cTG2wdSLwhv4UOu6mgVdZXBUuS\nirHOJHCY/k6CKTRw4j9ZLM0h5KI/yr0HHzsoTKabcxqW+RYA1flFNvoR8eFmwBW7\nzjzUMlSGs88U3L7UoNQoLCi9ASatGwokRlL96Wh8B4CLAko15vsy0GoDqxMQ1Oyf\n2vh+03oROIskvstGo37TurH1XOwPW7RGckMRWzC5ueHb/FGwql65G90Qbzb0T8OY\nIfbr017WwKOb1DYXGEwMHeZ/DoN1CxCj9EBiNwMLWvGrJp+OlLG17vP3XKO+QrLM\ncIuucrAiG7QAfU4tYVuWYfqOYnswl8AGvj6G1hz5XxD8dRYdJtyl0EftmMk6yIsT\npp9AvQX33ejKRzLWtDRWruaMCabghtI/KqfoI+QoqSAqPDOnO732ZK0PGAJOxb9t\nelIJecgjUlWDH8jb+JViivuVqtPMKHM3azykfkTQyVCcLSC37RKcEESmXLWRD3P9\n/6/ueOY3Ubw6tnz3TiYDkDasCEKeG1xnsw8+owVLQEqGCx9c7a5zYVWhgiZr4hTW\nYfkf5BcCAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDgxLmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPUTAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQAoMgrG2w0ns/evORFuseXjIpydxSBBjiDZFaC5\niOzyo4NgpQF6Qz96jxM5s6lAm7HQqHOYIy2JqvhXyFgsBz4DZHvl2lGYVGDs7U72\nHP2uqFgIvkgzWgPwOb9N7vofRPC3oOofwoGz1VNhG5jEekvU+2tg9Ftx+vqgyWRb\nBQGDODqgjpIe14D1NNvmjpdYiHPtcB7DJsC9sDs5zDbkBXEZdEGEFQt0ySPEpwVp\ng+hQCGhVg8qJrzCAOt13qQymT/qDXpBxSr+KTM/WWZ8lI3ERnmVScQWV2vizGd28\nak+VMtHZSnHhEfPdzjzAlwykeVGKQn0leeOgCnPo0v+aeRsOwzL5DfWuOKsL1tGq\nKjCy1X7YCtbUmTButHNWZGgwIdWYIuggLn6UOnix06RtoOcV06lq+g8kl9zoK0mK\n17W4deVjEk9x8MyZ8n6RrIstbMK6HOsI5x930zHZO5G4tn4M344oUydOZsW6NtR5\njt4Po8sOCqmCYY4iWQRZ/Ss3yhA8EReQCDOfi9HiOs0U18I2QC1Sr/tWd4/KQ8FU\nIRzj0JgShb9IewFKzSBNs35vfUacmIgGeUxvcMcQqOYFsUU1EFoT8NSd9vVvbIAr\n4X105iNa1Bkxq2gYIrnwgigQnFz0IOpWQR93A1YJU3jcalrgzvrLl43wDIhz4HDD\nxlo7Yg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAifiGbeLJC+XfYtzIgJl88ZNWwxZehjzPNwSkUIXqrRspjJXv\nCXRfsEGMj3ro+OZrGESs5yrA2w/pzkTy/kcolYO3fLCOOgBs6x4AjS5FRilpRrZj\nxuRMCvN4osH3RtEQpAbv7EyyY2cTG2wdSLwhv4UOu6mgVdZXBUuSirHOJHCY/k6C\nKTRw4j9ZLM0h5KI/yr0HHzsoTKabcxqW+RYA1flFNvoR8eFmwBW7zjzUMlSGs88U\n3L7UoNQoLCi9ASatGwokRlL96Wh8B4CLAko15vsy0GoDqxMQ1Oyf2vh+03oROIsk\nvstGo37TurH1XOwPW7RGckMRWzC5ueHb/FGwql65G90Qbzb0T8OYIfbr017WwKOb\n1DYXGEwMHeZ/DoN1CxCj9EBiNwMLWvGrJp+OlLG17vP3XKO+QrLMcIuucrAiG7QA\nfU4tYVuWYfqOYnswl8AGvj6G1hz5XxD8dRYdJtyl0EftmMk6yIsTpp9AvQX33ejK\nRzLWtDRWruaMCabghtI/KqfoI+QoqSAqPDOnO732ZK0PGAJOxb9telIJecgjUlWD\nH8jb+JViivuVqtPMKHM3azykfkTQyVCcLSC37RKcEESmXLWRD3P9/6/ueOY3Ubw6\ntnz3TiYDkDasCEKeG1xnsw8+owVLQEqGCx9c7a5zYVWhgiZr4hTWYfkf5BcCAwEA\nAQKCAgATQ02Rff5P2PJNXUHpIoTdPZL5feAIoejUZ6OBUpEnRgmRBUXwbf0GIMC9\nL43jYlhFdSEmzUNL0nb0Q5AhjFHQPimaERRqaLDMSs4M6A7n8tQt+T0JAcrUJJYN\nM0OQ8ZN/MzDALx0g3709MOUNyKZ1lOAvt0kZcumHZbu5/YUodUgHCXMGybmQ/QM4\nTBOVVknNxoJ+C8ZenUxKz8WQVVAcj8boHBXxTWUJIH+uFbQSqtZ7uEfTYhlRsw1A\nzRdGV94HTm0uHFwzAFGAwqOl2DKaYyv/CS4l7m2FLNxMuDEM2ZgZ6uNgeAUOwqBR\nCpOVO6gRR6QmQ9LihnUHzM7n9YfSrRgFYSO0+BwolkgkYQYR7u0inN3BG3HCmxzO\nCVBEJzNgvhHvqagUJg/NqLf5lUYWyJmsjAq7YL7UBXTrFTUbbozKftfkXOiP5TDr\nlM++dtqBkejSHmDkmqdpGwsu+t0EF9e3Eq81HkA6Y8ZobLlglFCb/YKZ5B7hQCog\nVA+s+WYVH1kBtRdyX7twdzVTiEr8XHu0xx6WrrcC6mWxe0d9DkMfFrBslQ/gs7RE\nzhdDAGX1lS1lWO127Coar0WjaMOiZcD3/x3XCv53fN/TzhmP8vbRbS4S7TmzXcDo\nyRg0mys5Q4F4kK6GD7HXuZ9IYRGmmjdZwOJcw8ulHvR693GYgQKCAQEAvToymbrz\nhh8LPPOiW8KTOwWs8Wgmk4cD5w70Y2At+oTkzOXMfCn67q5F7agxZHwsUuIrnpEW\nxNbjNeVbmPxv25jiCNHFzt8XYHDgGL+NCVukGhGvPK/t/3oYSZLU/837nusWeplF\nzlS9v/QpdcuIfmu+KH9u6IKdQuej8ObyvWuH7Thet9mH7piq3p46+cwzidgm6S2/\ngqEomVK5jPe+FIXAC+hSf2z6rSW7RTdE2/pBC/Yt+8qGCxJBSrRFMoxriGogYNGI\nFoBaRJCiMQXFVsl2XefsHkA41GI9GwO/UWtbOtV8PWpGaonVO3piXSDvv78thUsN\npuEnLb0MHdr/oQKCAQEAuqgU7rKXZOy/9ARG8hrJfBX41kiM+p0dtvs6PWP/fmAe\nnTKp7qRKriIABHgtizXh41/1FjBnPDute6U0yJxk4A6KMzONHbEyfH6fxS1dO9zi\nvONufbLJk2WLFsAiEoEccdR++xgCQBQwLBKrWaRIrq75692ijVewO+3TchdvZ5ve\n51EwYGKPABZlB5T+NwsUh2ES4SnCODsGlkeiIm7kG+m/AHvEPH6qi0RZ6hILGsQG\n/KF4Ko7hZ+Ek/3Y9XUUZ+1s9YxSdwsdyj0yq8PcxVdQiUjHinmA4+nFMj6CD8Acm\nAdLJJBxbT7iJkeYrIIUUfI3t3KUVXjyIlMxlzmIotwKCAQBdpdm4/y7aJ672IVUu\nuGMJCMwIRRUiWeVyipIkREs8+lwJk4jZwiTvzsvIzD51joaZFlmkBgYQsJCN8c6d\nLgFl2omy964/rWTyU6p0VQhFo1bZl/rzu9W7Y/91GffUCWsHwSzEy+oiLQojX4DN\nTUdl2YionjiTVWDi5aTa6lEjsX35xrYJotyFFoUp24EwcwDmrVTEfeGTkpJ3Htu5\nijpGCdN7kSSS76o32r6NiMbJX1alxtYHELm57PTnNcQxOhFV17/iapBBIpCJ8lJy\nlHqPcvDjlI3kgsAdS+kV34rljo391f3An0HuI/yljPH1SQGeEc1DdFtzRWaQWkkO\n1X1BAoIBABGnymsVm3phZnq3WNqXrA0/qsziCeu+psvjEYwzBDy47MxjuW0oPyQf\ndS73Cx/K1fYC4pTZuToaTvuOEeMT3/rNhUb4jlWLqEHcXFJzSwlZiFzjilT7b1Ow\n3ConvFFRwxYFSomHqNbU0gWpMmoFPxa+2Eb2LOT/sVzJzyFQlCoRtVDd/hxv1iTk\n+WNxNWaRdryjcvy3TXayJppaZjypjowRXQ63pkUumgUYTwTz9fbvKdYFk+86mpmP\n00cSsRU8bwu2gqT3k0CUSwLA9r5aM2Fx8lkh/NSMN3eA9gPz4+b1ViQAAySWRhDR\nXLnfMp8d12U8q44eU1oZkbW5a7vMzxsCggEALXZ+FlU+AwawZ6QEhsxekZZHkRMb\nNEwg27Rcrg0UkjLCxL3lavJUxKZlgA2BsBQYG48rdF80sXRUiBNx5WL0go+TPMYB\nR4c/PeD4a6Wl4WcIx1eJhMgUYHg7h8l6pwG2y+y84PnaPcr2KuJy8+kRRC5jnNpx\nqGreELcvLyyRGgY6WHiz+SNlqV0r0zfxjELDOoqWx2vkOnMKdlTrY/LvupLMwvKa\n5DLwZCHSS4Ny9a05X5sv9FRVrhphVYH8fpd55rz/vqCuDIhUnc7R/RPqUzNXE7Qm\nHho/anmouogRh1b0TcQmg8iyKvDJYb9RFXcOL1DIQVYKO96TBCOTFCpzHw==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T02:50:53.621 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T02:50:53.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:53 smithi081 ceph-mon[30991]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:53.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:53 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:50:54.828 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T02:50:54.828 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial admin user... 2024-09-21T02:50:55.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:55 smithi081 ceph-mon[30991]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:55.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:50:56.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$SEh6JY68bcbAQkbxwv8qlOedWZ/nhF8KOyP/CW6u9wT95SllQAmgW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726887055, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T02:50:56.268 INFO:teuthology.orchestra.run.smithi081.stdout:Fetching dashboard port number... 2024-09-21T02:50:56.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:56 smithi081 ceph-mon[30991]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:50:56.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:56 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:50:57.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T02:50:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:50:57.445 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-21T02:50:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:50:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-21T02:50:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-21T02:50:57.453 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T02:50:57.455 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph Dashboard is now available at: 2024-09-21T02:50:57.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:57.455 INFO:teuthology.orchestra.run.smithi081.stdout: URL: https://smithi081.front.sepia.ceph.com:8443/ 2024-09-21T02:50:57.455 INFO:teuthology.orchestra.run.smithi081.stdout: User: admin 2024-09-21T02:50:57.455 INFO:teuthology.orchestra.run.smithi081.stdout: Password: hijh52ppho 2024-09-21T02:50:57.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:57.455 INFO:teuthology.orchestra.run.smithi081.stdout:Saving cluster configuration to /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config directory 2024-09-21T02:50:57.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:57 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3066651391' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T02:50:58.832 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T02:50:58.832 INFO:teuthology.orchestra.run.smithi081.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T02:50:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:50:58.832 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: ceph telemetry on 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout:For more information see: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:50:58.833 INFO:teuthology.orchestra.run.smithi081.stdout:Bootstrap complete. 2024-09-21T02:50:58.873 INFO:tasks.cephadm:Fetching config... 2024-09-21T02:50:58.873 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:50:58.874 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T02:50:58.891 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T02:50:58.891 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:50:58.891 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T02:50:58.947 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T02:50:58.947 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:50:58.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T02:50:59.012 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T02:50:59.012 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:50:59.012 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T02:50:59.067 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T02:50:59.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfHOIysxFlAdjFoB179duSQcu6QfYy6UBqk4GA7DIxTH8USHgxBRtqQchi6NmjtOTHSSFgJVluVVYnOiZc+eGOaCIkVcoCQ6REYWqiDRO4aeUygAW1756oVm3hxKsH07yegk9n5hvWdV4L9iQrejSSdgiwzGjvCFJnoT25Gp42tV2+yaXLJEGdULDYIBQAEG0331DxuxhZ9/v7oPhTWnJ40DcIg5yqzmkpSGxbxwBQXb0uwK2DAeUKDPAvpiL+Qa/cfU6gc+aSzAaiC4qyoCzTypGSming7uG6CIiJnC8bY+tTdGKZH7iDl3d7Hk3fMziBOkKLKIPq/YRRFv25Js4HjFnJlJHssgSLfo5Q9sB+OmMWRs3iVjRhpowEzCMe47klWuTOKgtX30do2AslS2UHgj/Bj/DmiRj0VtJylLHgM8L2KEbRk/g0b0P8NMsCSch+t5eqTCvb/q4nLjZlMZj5n3zLcEkfadT78cEipFfA4z949s/WffR/WW+nYobw2mk= ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:50:59.141 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfHOIysxFlAdjFoB179duSQcu6QfYy6UBqk4GA7DIxTH8USHgxBRtqQchi6NmjtOTHSSFgJVluVVYnOiZc+eGOaCIkVcoCQ6REYWqiDRO4aeUygAW1756oVm3hxKsH07yegk9n5hvWdV4L9iQrejSSdgiwzGjvCFJnoT25Gp42tV2+yaXLJEGdULDYIBQAEG0331DxuxhZ9/v7oPhTWnJ40DcIg5yqzmkpSGxbxwBQXb0uwK2DAeUKDPAvpiL+Qa/cfU6gc+aSzAaiC4qyoCzTypGSming7uG6CIiJnC8bY+tTdGKZH7iDl3d7Hk3fMziBOkKLKIPq/YRRFv25Js4HjFnJlJHssgSLfo5Q9sB+OmMWRs3iVjRhpowEzCMe47klWuTOKgtX30do2AslS2UHgj/Bj/DmiRj0VtJylLHgM8L2KEbRk/g0b0P8NMsCSch+t5eqTCvb/q4nLjZlMZj5n3zLcEkfadT78cEipFfA4z949s/WffR/WW+nYobw2mk= ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:59.152 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfHOIysxFlAdjFoB179duSQcu6QfYy6UBqk4GA7DIxTH8USHgxBRtqQchi6NmjtOTHSSFgJVluVVYnOiZc+eGOaCIkVcoCQ6REYWqiDRO4aeUygAW1756oVm3hxKsH07yegk9n5hvWdV4L9iQrejSSdgiwzGjvCFJnoT25Gp42tV2+yaXLJEGdULDYIBQAEG0331DxuxhZ9/v7oPhTWnJ40DcIg5yqzmkpSGxbxwBQXb0uwK2DAeUKDPAvpiL+Qa/cfU6gc+aSzAaiC4qyoCzTypGSming7uG6CIiJnC8bY+tTdGKZH7iDl3d7Hk3fMziBOkKLKIPq/YRRFv25Js4HjFnJlJHssgSLfo5Q9sB+OmMWRs3iVjRhpowEzCMe47klWuTOKgtX30do2AslS2UHgj/Bj/DmiRj0VtJylLHgM8L2KEbRk/g0b0P8NMsCSch+t5eqTCvb/q4nLjZlMZj5n3zLcEkfadT78cEipFfA4z949s/WffR/WW+nYobw2mk= ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:50:59.205 INFO:teuthology.orchestra.run.smithi164.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfHOIysxFlAdjFoB179duSQcu6QfYy6UBqk4GA7DIxTH8USHgxBRtqQchi6NmjtOTHSSFgJVluVVYnOiZc+eGOaCIkVcoCQ6REYWqiDRO4aeUygAW1756oVm3hxKsH07yegk9n5hvWdV4L9iQrejSSdgiwzGjvCFJnoT25Gp42tV2+yaXLJEGdULDYIBQAEG0331DxuxhZ9/v7oPhTWnJ40DcIg5yqzmkpSGxbxwBQXb0uwK2DAeUKDPAvpiL+Qa/cfU6gc+aSzAaiC4qyoCzTypGSming7uG6CIiJnC8bY+tTdGKZH7iDl3d7Hk3fMziBOkKLKIPq/YRRFv25Js4HjFnJlJHssgSLfo5Q9sB+OmMWRs3iVjRhpowEzCMe47klWuTOKgtX30do2AslS2UHgj/Bj/DmiRj0VtJylLHgM8L2KEbRk/g0b0P8NMsCSch+t5eqTCvb/q4nLjZlMZj5n3zLcEkfadT78cEipFfA4z949s/WffR/WW+nYobw2mk= ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:59.218 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfHOIysxFlAdjFoB179duSQcu6QfYy6UBqk4GA7DIxTH8USHgxBRtqQchi6NmjtOTHSSFgJVluVVYnOiZc+eGOaCIkVcoCQ6REYWqiDRO4aeUygAW1756oVm3hxKsH07yegk9n5hvWdV4L9iQrejSSdgiwzGjvCFJnoT25Gp42tV2+yaXLJEGdULDYIBQAEG0331DxuxhZ9/v7oPhTWnJ40DcIg5yqzmkpSGxbxwBQXb0uwK2DAeUKDPAvpiL+Qa/cfU6gc+aSzAaiC4qyoCzTypGSming7uG6CIiJnC8bY+tTdGKZH7iDl3d7Hk3fMziBOkKLKIPq/YRRFv25Js4HjFnJlJHssgSLfo5Q9sB+OmMWRs3iVjRhpowEzCMe47klWuTOKgtX30do2AslS2UHgj/Bj/DmiRj0VtJylLHgM8L2KEbRk/g0b0P8NMsCSch+t5eqTCvb/q4nLjZlMZj5n3zLcEkfadT78cEipFfA4z949s/WffR/WW+nYobw2mk= ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:50:59.374 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfHOIysxFlAdjFoB179duSQcu6QfYy6UBqk4GA7DIxTH8USHgxBRtqQchi6NmjtOTHSSFgJVluVVYnOiZc+eGOaCIkVcoCQ6REYWqiDRO4aeUygAW1756oVm3hxKsH07yegk9n5hvWdV4L9iQrejSSdgiwzGjvCFJnoT25Gp42tV2+yaXLJEGdULDYIBQAEG0331DxuxhZ9/v7oPhTWnJ40DcIg5yqzmkpSGxbxwBQXb0uwK2DAeUKDPAvpiL+Qa/cfU6gc+aSzAaiC4qyoCzTypGSming7uG6CIiJnC8bY+tTdGKZH7iDl3d7Hk3fMziBOkKLKIPq/YRRFv25Js4HjFnJlJHssgSLfo5Q9sB+OmMWRs3iVjRhpowEzCMe47klWuTOKgtX30do2AslS2UHgj/Bj/DmiRj0VtJylLHgM8L2KEbRk/g0b0P8NMsCSch+t5eqTCvb/q4nLjZlMZj5n3zLcEkfadT78cEipFfA4z949s/WffR/WW+nYobw2mk= ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:50:59.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T02:50:59.410 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:50:59 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/444467097' entity='client.admin' 2024-09-21T02:50:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:01.455 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: mgrmap e13: x(active, since 12s) 2024-09-21T02:51:01.455 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:01.455 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:01.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:01.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:01.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:01.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:01.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1216282858' entity='client.admin' 2024-09-21T02:51:01.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:01.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:01 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:01.483 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T02:51:01.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T02:51:01.774 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:03.633 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi164 2024-09-21T02:51:03.634 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:51:03.634 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/etc/ceph/ceph.conf 2024-09-21T02:51:03.653 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:51:03.653 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:03.711 INFO:tasks.cephadm:Adding host smithi164 to orchestrator... 2024-09-21T02:51:03.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch host add smithi164 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: Updating smithi081:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:03.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:03.952 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:04.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:04 smithi081 ceph-mon[30991]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:04.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:04 smithi081 ceph-mon[30991]: Updating smithi081:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:51:05.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:05 smithi081 ceph-mon[30991]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi164", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:06.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:06 smithi081 ceph-mon[30991]: Deploying cephadm binary to smithi164 2024-09-21T02:51:07.591 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi164' with addr '172.21.15.164' 2024-09-21T02:51:08.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T02:51:08.480 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:08.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:08.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:08 smithi081 ceph-mon[30991]: Added host smithi164 2024-09-21T02:51:08.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:08.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:08 smithi081 ceph-mon[30991]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:08.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:08.855 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:09.134 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:51:09.135 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.164", "hostname": "smithi164", "labels": [], "status": ""}] 2024-09-21T02:51:09.762 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-09-21T02:51:09.762 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:51:09.762 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-09-21T02:51:09.782 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:51:09.782 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:09.840 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-09-21T02:51:09.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch host add smithi181 2024-09-21T02:51:10.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:10.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:09 smithi081 ceph-mon[30991]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:51:10.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:09 smithi081 ceph-mon[30991]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:12.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:11 smithi081 ceph-mon[30991]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:12.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:11 smithi081 ceph-mon[30991]: Deploying cephadm binary to smithi181 2024-09-21T02:51:12.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:11 smithi081 ceph-mon[30991]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi164", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: Updating smithi164:/etc/ceph/ceph.conf 2024-09-21T02:51:13.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: Updating smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:13.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:13.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: Updating smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:51:13.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:13.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:13.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:13.711 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-09-21T02:51:14.006 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:13 smithi081 ceph-mon[30991]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:14.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T02:51:14.528 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:14.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:14.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:14 smithi081 ceph-mon[30991]: Added host smithi181 2024-09-21T02:51:14.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:14.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:14.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:15.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:51:15.178 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.164", "hostname": "smithi164", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-09-21T02:51:15.824 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T02:51:15.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T02:51:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:16 smithi081 ceph-mon[30991]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:51:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:16 smithi081 ceph-mon[30991]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-21T02:51:17.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:17 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/230915585' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T02:51:17.649 INFO:tasks.cephadm:Adding mon.a on smithi081 2024-09-21T02:51:17.649 INFO:tasks.cephadm:Adding mon.b on smithi164 2024-09-21T02:51:17.649 INFO:tasks.cephadm:Adding mon.c on smithi181 2024-09-21T02:51:17.649 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi081:172.21.15.81=a;smithi164:172.21.15.164=b;smithi181:172.21.15.181=c' 2024-09-21T02:51:17.902 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/230915585' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T02:51:18.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:18 smithi081 ceph-mon[30991]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:18.527 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-09-21T02:51:19.091 DEBUG:teuthology.orchestra.run.smithi164:mon.b> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T02:51:19.094 DEBUG:teuthology.orchestra.run.smithi181:mon.c> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T02:51:19.097 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:51:19.097 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:51:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: Updating smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: Updating smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:51:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:19.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi164:172.21.15.164=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:19.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi164:172.21.15.164=b;smithi181:172.21.15.181=c;count:3 2024-09-21T02:51:19.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:19.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:19.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:19.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:19.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:19.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:19.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:19.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:19 smithi081 ceph-mon[30991]: Deploying daemon mon.c on smithi181 2024-09-21T02:51:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:20.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:20 smithi081 ceph-mon[30991]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:21.609 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:51:21.610 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","modified":"2024-09-21T02:49:50.579009Z","created":"2024-09-21T02:49:50.579009Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T02:51:21.610 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-09-21T02:51:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:21 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/402669755' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:21 smithi081 ceph-mon[30991]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:22.774 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 podman[34077]: 2024-09-21 02:51:22.741054552 +0000 UTC m=+0.342988419 container start 3737afef4436313025df1a758951d5f72620bbc18c963b8e472909a3ea71f68f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:51:22.774 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T02:51:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T02:51:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: pidfile_write: ignore empty --pid-file 2024-09-21T02:51:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: load: jerasure load: lrc 2024-09-21T02:51:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: RocksDB version: 7.9.2 2024-09-21T02:51:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Git sha 0 2024-09-21T02:51:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: DB SUMMARY 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: DB Session ID: 96FKVC7IG3O3249T4DIW 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: CURRENT file: CURRENT 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T02:51:23.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.error_if_exists: 0 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.create_if_missing: 0 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.paranoid_checks: 1 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.env: 0x56147dd43d60 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T02:51:23.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.info_log: 0x561482e95360 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.statistics: (nil) 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.use_fsync: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_log_file_size: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.allow_fallocate: 1 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.use_direct_reads: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.db_log_dir: 2024-09-21T02:51:23.252 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.wal_dir: 2024-09-21T02:51:23.253 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T02:51:23.253 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T02:51:23.254 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T02:51:23.254 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T02:51:23.254 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T02:51:23.254 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T02:51:23.254 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.write_buffer_manager: 0x561482e99d60 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T02:51:23.255 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.unordered_write: 0 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.row_cache: None 2024-09-21T02:51:23.256 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.wal_filter: None 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.two_write_queues: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.wal_compression: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.atomic_flush: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.log_readahead_size: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T02:51:23.257 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_background_jobs: 2 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_background_compactions: -1 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_subcompactions: 1 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T02:51:23.258 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_open_files: -1 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_background_flushes: -1 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Compression algorithms supported: 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kZSTD supported: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kXpressCompression supported: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kBZip2Compression supported: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kLZ4Compression supported: 1 2024-09-21T02:51:23.259 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kZlibCompression supported: 1 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: kSnappyCompression supported: 1 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.merge_operator: 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_filter: None 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561482e94fa0) 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout: cache_index_and_filter_blocks: 1 2024-09-21T02:51:23.260 INFO:journalctl@ceph.mon.c.smithi181.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: pin_top_level_index_and_filter: 1 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_type: 0 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: data_block_index_type: 0 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_shortening: 1 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: checksum: 4 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: no_block_cache: 0 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache: 0x56147ee59610 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_name: BinnedLRUCache 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_options: 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: capacity : 536870912 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: num_shard_bits : 4 2024-09-21T02:51:23.261 INFO:journalctl@ceph.mon.c.smithi181.stdout: strict_capacity_limit : 0 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: high_pri_pool_ratio: 0.000 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_cache_compressed: (nil) 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: persistent_cache: (nil) 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_size: 4096 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_size_deviation: 10 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_restart_interval: 16 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: index_block_restart_interval: 1 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: metadata_block_size: 4096 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: partition_filters: 0 2024-09-21T02:51:23.262 INFO:journalctl@ceph.mon.c.smithi181.stdout: use_delta_encoding: 1 2024-09-21T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi181.stdout: filter_policy: bloomfilter 2024-09-21T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi181.stdout: whole_key_filtering: 1 2024-09-21T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi181.stdout: verify_compression: 0 2024-09-21T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi181.stdout: read_amp_bytes_per_bit: 0 2024-09-21T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi181.stdout: format_version: 5 2024-09-21T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi181.stdout: enable_index_compression: 1 2024-09-21T02:51:23.263 INFO:journalctl@ceph.mon.c.smithi181.stdout: block_align: 0 2024-09-21T02:51:23.264 INFO:journalctl@ceph.mon.c.smithi181.stdout: max_auto_readahead_size: 262144 2024-09-21T02:51:23.264 INFO:journalctl@ceph.mon.c.smithi181.stdout: prepopulate_block_cache: 0 2024-09-21T02:51:23.264 INFO:journalctl@ceph.mon.c.smithi181.stdout: initial_auto_readahead_size: 8192 2024-09-21T02:51:23.264 INFO:journalctl@ceph.mon.c.smithi181.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T02:51:23.264 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T02:51:23.264 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T02:51:23.264 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression: NoCompression 2024-09-21T02:51:23.265 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T02:51:23.265 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T02:51:23.265 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T02:51:23.265 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.num_levels: 7 2024-09-21T02:51:23.265 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T02:51:23.265 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T02:51:23.265 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:51:23.266 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T02:51:23.267 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T02:51:23.268 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:51:23.268 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T02:51:23.268 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T02:51:23.268 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T02:51:23.268 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T02:51:23.268 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T02:51:23.268 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T02:51:23.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T02:51:23.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T02:51:23.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T02:51:23.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T02:51:23.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T02:51:23.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T02:51:23.269 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T02:51:23.270 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T02:51:23.271 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.inplace_update_support: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.bloom_locality: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.max_successive_merges: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.ttl: 2592000 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T02:51:23.272 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.enable_blob_files: false 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.min_blob_size: 0 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 29561351-5a01-4261-a7c9-729ce30f35e9 2024-09-21T02:51:23.273 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726887082778796, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726887082779226, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726887082, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "29561351-5a01-4261-a7c9-729ce30f35e9", "db_session_id": "96FKVC7IG3O3249T4DIW", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726887082779323, "job": 1, "event": "recovery_finished"} 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561482eb8a80 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: DB pointer 0x561483c5e000 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** DB Stats ** 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:51:23.274 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** Compaction Stats [default] ** 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** Compaction Stats [default] ** 2024-09-21T02:51:23.275 INFO:journalctl@ceph.mon.c.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:51:23.276 INFO:journalctl@ceph.mon.c.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: Block cache BinnedLRUCache@0x56147ee59610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: using public_addr v2:172.21.15.181:0/0 -> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: starting mon.c rank -1 at public addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] at bind addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(???) e0 preinit fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: e1 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: btime 2024-09-21T02:49:53:484787+0000 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:51:23.277 INFO:journalctl@ceph.mon.c.smithi181.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout: legacy client fscid: -1 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout: 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout: No filesystems configured 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:51:23.278 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi164", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi164:/etc/ceph/ceph.conf 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.279 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Added host smithi181 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/230915585' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/230915585' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.280 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"} : dispatch 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Updating smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.281 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi164:172.21.15.164=b;smithi181:172.21.15.181=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi164:172.21.15.164=b;smithi181:172.21.15.181=c;count:3 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: Deploying daemon mon.c on smithi181 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/402669755' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:23.282 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 ceph-mon[34096]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T02:51:23.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 bash[34077]: 3737afef4436313025df1a758951d5f72620bbc18c963b8e472909a3ea71f68f 2024-09-21T02:51:23.283 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:22 smithi181 systemd[1]: Started Ceph mon.c for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:51:23.314 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:51:23.314 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:51:23.560 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:51:28.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:51:28.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: mon.a calling monitor election 2024-09-21T02:51:28.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: mon.c calling monitor election 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: monmap epoch 2 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: last_changed 2024-09-21T02:51:22.806059+0000 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: created 2024-09-21T02:49:50.579009+0000 2024-09-21T02:51:28.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: min_mon_release 19 (squid) 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: election_strategy: 1 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: fsmap 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: mgrmap e13: x(active, since 40s) 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: overall HEALTH_OK 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:28.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:28.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:51:28.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: mon.a calling monitor election 2024-09-21T02:51:28.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:28.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: mon.c calling monitor election 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: monmap epoch 2 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: last_changed 2024-09-21T02:51:22.806059+0000 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: created 2024-09-21T02:49:50.579009+0000 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: min_mon_release 19 (squid) 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: election_strategy: 1 2024-09-21T02:51:28.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: fsmap 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: mgrmap e13: x(active, since 40s) 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: overall HEALTH_OK 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:28.307 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:28.645 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:51:28.645 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","modified":"2024-09-21T02:51:22.806059Z","created":"2024-09-21T02:49:50.579009Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T02:51:28.645 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-09-21T02:51:28.960 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:28 smithi181 ceph-mon[34096]: Deploying daemon mon.b on smithi164 2024-09-21T02:51:28.961 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:28 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/2122269012' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:28.961 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:29.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:28 smithi081 ceph-mon[30991]: Deploying daemon mon.b on smithi164 2024-09-21T02:51:29.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:28 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/2122269012' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:29.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:30.240 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:51:30.240 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:51:30.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:29 smithi181 ceph-mon[34096]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:30.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:29 smithi081 ceph-mon[30991]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:30.508 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:51:31.143 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:51:31.144 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","modified":"2024-09-21T02:51:22.806059Z","created":"2024-09-21T02:49:50.579009Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T02:51:31.144 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-09-21T02:51:31.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:31 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/414994579' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:31.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:31 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/414994579' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:31.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:31 smithi164 systemd[1]: Started Ceph mon.b for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:51:32.714 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:51:32.715 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:51:32.968 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:51:36.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: mon.a calling monitor election 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: mon.c calling monitor election 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: mon.b calling monitor election 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:36.934 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: monmap epoch 3 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: last_changed 2024-09-21T02:51:31.604202+0000 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: created 2024-09-21T02:49:50.579009+0000 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: min_mon_release 19 (squid) 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: election_strategy: 1 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: 2: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: fsmap 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: mgrmap e13: x(active, since 49s) 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: overall HEALTH_OK 2024-09-21T02:51:36.935 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.936 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.936 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.936 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.961 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: mon.a calling monitor election 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: mon.c calling monitor election 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: mon.b calling monitor election 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:36.962 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: monmap epoch 3 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: last_changed 2024-09-21T02:51:31.604202+0000 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: created 2024-09-21T02:49:50.579009+0000 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: min_mon_release 19 (squid) 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: election_strategy: 1 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: 2: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: fsmap 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: mgrmap e13: x(active, since 49s) 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: overall HEALTH_OK 2024-09-21T02:51:36.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.964 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:51:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: mon.a calling monitor election 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: mon.c calling monitor election 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: mon.b calling monitor election 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: monmap epoch 3 2024-09-21T02:51:37.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: last_changed 2024-09-21T02:51:31.604202+0000 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: created 2024-09-21T02:49:50.579009+0000 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: min_mon_release 19 (squid) 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: election_strategy: 1 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: 1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: 2: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: fsmap 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: mgrmap e13: x(active, since 49s) 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: overall HEALTH_OK 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:37.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:37.293 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:51:37.293 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","modified":"2024-09-21T02:51:31.604202Z","created":"2024-09-21T02:49:50.579009Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T02:51:37.294 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 3 2024-09-21T02:51:37.869 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:37.869 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:37 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/769403429' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:37.869 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:37.869 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:37 smithi181 ceph-mon[34096]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:37.869 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:37.869 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:37.896 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T02:51:37.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T02:51:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:37 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/769403429' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:37 smithi081 ceph-mon[30991]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:38.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:38.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:37 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/769403429' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:51:38.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:51:38.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:37 smithi164 ceph-mon[34236]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:38.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:38.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:38.882 INFO:teuthology.orchestra.run.smithi081.stdout:# minimal ceph.conf for 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:38.882 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-21T02:51:38.882 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T02:51:38.882 INFO:teuthology.orchestra.run.smithi081.stdout: mon_host = [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Updating smithi164:/etc/ceph/ceph.conf 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T02:51:39.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Updating smithi081:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Updating smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Updating smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.184 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T02:51:39.184 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:39.184 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:39.184 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.184 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: Reconfiguring daemon mon.a on smithi081 2024-09-21T02:51:39.184 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:38 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1384346820' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.219 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Updating smithi164:/etc/ceph/ceph.conf 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Updating smithi081:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Updating smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Updating smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: Reconfiguring daemon mon.a on smithi081 2024-09-21T02:51:39.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:38 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1384346820' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Updating smithi164:/etc/ceph/ceph.conf 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Updating smithi181:/etc/ceph/ceph.conf 2024-09-21T02:51:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Updating smithi081:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Updating smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Updating smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T02:51:39.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:39.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:39.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:39.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: Reconfiguring daemon mon.a on smithi081 2024-09-21T02:51:39.251 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:38 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1384346820' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:40.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:39 smithi164 ceph-mon[34236]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:40.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:39 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:40.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:39 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:40.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:39 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:40.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:39 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:40.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:39 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:40.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:39 smithi081 ceph-mon[30991]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:40.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:39 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:40.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:39 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:40.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:39 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:40.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:39 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:40.202 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:39 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:40.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:39 smithi181 ceph-mon[34096]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:40.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:39 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:40.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:39 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:40.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:39 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:40.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:39 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:40.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:39 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:40.499 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T02:51:40.499 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:51:40.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:51:40.529 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:51:40.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:40.596 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:51:40.596 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:51:40.624 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:51:40.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:40.689 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:51:40.690 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:51:40.721 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:51:40.721 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:51:40.790 INFO:tasks.cephadm:Adding mgr.x on smithi081 2024-09-21T02:51:40.791 INFO:tasks.cephadm:Adding mgr.y on smithi164 2024-09-21T02:51:40.791 INFO:tasks.cephadm:Adding mgr.z on smithi181 2024-09-21T02:51:40.791 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi081=x;smithi164=y;smithi181=z' 2024-09-21T02:51:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:51:41.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:40 smithi181 ceph-mon[34096]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:51:41.132 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:40 smithi181 ceph-mon[34096]: Reconfiguring daemon mon.b on smithi164 2024-09-21T02:51:41.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:40 smithi164 ceph-mon[34236]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:51:41.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:40 smithi164 ceph-mon[34236]: Reconfiguring daemon mon.b on smithi164 2024-09-21T02:51:41.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:40 smithi081 ceph-mon[30991]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:51:41.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:40 smithi081 ceph-mon[30991]: Reconfiguring daemon mon.b on smithi164 2024-09-21T02:51:41.708 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mgr update... 2024-09-21T02:51:42.364 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.364 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.364 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:51:42.364 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:42.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:42.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:42.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: Reconfiguring daemon mon.c on smithi181 2024-09-21T02:51:42.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:42.365 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: Reconfiguring daemon mon.c on smithi181 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:42.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: Reconfiguring daemon mon.c on smithi181 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:42.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.000 DEBUG:teuthology.orchestra.run.smithi164:mgr.y> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T02:51:43.003 DEBUG:teuthology.orchestra.run.smithi181:mgr.z> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T02:51:43.005 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T02:51:43.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T02:51:43.008 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T02:51:43.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T02:51:43.051 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T02:51:43.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T02:51:43.094 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T02:51:43.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T02:51:43.138 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T02:51:43.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T02:51:43.182 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T02:51:43.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T02:51:43.225 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T02:51:43.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi164=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: Saving service mgr spec with placement smithi081=x;smithi164=y;smithi181=z;count:3 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:43.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:51:43.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:43.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:43.268 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T02:51:43.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi164=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: Saving service mgr spec with placement smithi081=x;smithi164=y;smithi181=z;count:3 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:51:43.302 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:43.303 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:43.303 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T02:51:43.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T02:51:43.335 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:43.342 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T02:51:43.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T02:51:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:43.376 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T02:51:43.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T02:51:43.420 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T02:51:43.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T02:51:43.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi164=y;smithi181=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:51:43.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: Saving service mgr spec with placement smithi081=x;smithi164=y;smithi181=z;count:3 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:43.463 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T02:51:43.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T02:51:43.507 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T02:51:43.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T02:51:43.550 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T02:51:43.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T02:51:43.597 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T02:51:43.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T02:51:43.648 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T02:51:43.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T02:51:43.702 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T02:51:43.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T02:51:43.745 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T02:51:43.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T02:51:43.788 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T02:51:43.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T02:51:43.837 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T02:51:43.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T02:51:43.893 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T02:51:43.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T02:51:43.936 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T02:51:43.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T02:51:43.987 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T02:51:43.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T02:51:44.033 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T02:51:44.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T02:51:44.083 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T02:51:44.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T02:51:44.131 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T02:51:44.131 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi081') 2024-09-21T02:51:44.132 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:44 smithi081 ceph-mon[30991]: Deploying daemon mgr.z on smithi181 2024-09-21T02:51:44.132 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:44 smithi081 ceph-mon[30991]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:44.181 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:44 smithi181 ceph-mon[34096]: Deploying daemon mgr.z on smithi181 2024-09-21T02:51:44.181 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:44 smithi181 ceph-mon[34096]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:44.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:44 smithi164 ceph-mon[34236]: Deploying daemon mgr.z on smithi181 2024-09-21T02:51:44.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:44 smithi164 ceph-mon[34236]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:44.438 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:44.499 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 systemd[1]: Starting Ceph mgr.z for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:51:44.829 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 podman[35346]: 2024-09-21 02:51:44.550701543 +0000 UTC m=+0.103488337 container create 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T02:51:44.830 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 podman[35346]: 2024-09-21 02:51:44.463549356 +0000 UTC m=+0.016336161 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:51:44.830 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 podman[35346]: 2024-09-21 02:51:44.74486845 +0000 UTC m=+0.297655250 container init 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:51:44.830 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 podman[35346]: 2024-09-21 02:51:44.748420342 +0000 UTC m=+0.301207134 container start 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T02:51:44.830 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 ceph-mgr[35364]: -- 172.21.15.181:0/133581835 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a818a50e0 con 0x560a86648480 2024-09-21T02:51:44.830 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 bash[35346]: 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 2024-09-21T02:51:45.248 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 02:51:44 smithi181 systemd[1]: Started Ceph mgr.z for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:51:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 -- 172.21.15.81:0/241253815 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa85403fb20 msgr2=0x7fa854042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 --2- 172.21.15.81:0/241253815 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa85403fb20 0x7fa854042030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa85000bbe0 tx=0x7fa85000b390 comp rx=0 tx=0).stop 2024-09-21T02:51:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 -- 172.21.15.81:0/241253815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa86806c2c0 msgr2=0x7fa868199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 --2- 172.21.15.81:0/241253815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa86806c2c0 0x7fa868199b70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa858005940 tx=0x7fa858004340 comp rx=0 tx=0).stop 2024-09-21T02:51:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 -- 172.21.15.81:0/241253815 shutdown_connections 2024-09-21T02:51:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 --2- 172.21.15.81:0/241253815 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa85403fb20 0x7fa854042030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 --2- 172.21.15.81:0/241253815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa868109540 0x7fa86819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 --2- 172.21.15.81:0/241253815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa868106a00 0x7fa86819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 --2- 172.21.15.81:0/241253815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa86806c2c0 0x7fa868199b70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 -- 172.21.15.81:0/241253815 >> 172.21.15.81:0/241253815 conn(0x7fa8680fe080 msgr2=0x7fa868105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.322+0000 7fa86d2c0640 1 -- 172.21.15.81:0/241253815 shutdown_connections 2024-09-21T02:51:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:45.323+0000 7fa86d2c0640 1 -- 172.21.15.81:0/241253815 wait complete. 2024-09-21T02:51:45.785 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-21T02:51:45.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='client.? ' entity='client.admin' 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: Deploying daemon mgr.y on smithi164 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/241253815' entity='client.admin' 2024-09-21T02:51:46.556 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:45 smithi164 ceph-mon[34236]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='client.? ' entity='client.admin' 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: Deploying daemon mgr.y on smithi164 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/241253815' entity='client.admin' 2024-09-21T02:51:46.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:45 smithi081 ceph-mon[30991]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='client.? ' entity='client.admin' 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: Deploying daemon mgr.y on smithi164 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/241253815' entity='client.admin' 2024-09-21T02:51:46.559 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:45 smithi181 ceph-mon[34096]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:46.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.618+0000 7f460f466640 1 -- 172.21.15.81:0/1912371468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810a3c0 msgr2=0x7f460810c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:46.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.618+0000 7f460f466640 1 --2- 172.21.15.81:0/1912371468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810a3c0 0x7f460810c820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f460401a940 tx=0x7f460403b490 comp rx=0 tx=0).stop 2024-09-21T02:51:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.622+0000 7f460f466640 1 -- 172.21.15.81:0/1912371468 shutdown_connections 2024-09-21T02:51:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.622+0000 7f460f466640 1 --2- 172.21.15.81:0/1912371468 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f460810ce60 0x7f460810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.622+0000 7f460f466640 1 --2- 172.21.15.81:0/1912371468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f460810fa80 0x7f460811ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.622+0000 7f460f466640 1 --2- 172.21.15.81:0/1912371468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810a3c0 0x7f460810c820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.622+0000 7f460f466640 1 -- 172.21.15.81:0/1912371468 >> 172.21.15.81:0/1912371468 conn(0x7f4608070950 msgr2=0x7f4608072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.626+0000 7f460f466640 1 -- 172.21.15.81:0/1912371468 shutdown_connections 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.627+0000 7f460f466640 1 -- 172.21.15.81:0/1912371468 wait complete. 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 Processor -- start 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 -- start start 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f460810a3c0 0x7f46081a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f460810ce60 0x7f46081a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810fa80 0x7f46081a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4608114b10 con 0x7f460810fa80 2024-09-21T02:51:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4608114990 con 0x7f460810a3c0 2024-09-21T02:51:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.628+0000 7f460f466640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4608114c90 con 0x7f460810ce60 2024-09-21T02:51:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810fa80 0x7f46081a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810fa80 0x7f46081a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47232/0 (socket says 172.21.15.81:47232) 2024-09-21T02:51:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 -- 172.21.15.81:0/1982278026 learned_addr learned my addr 172.21.15.81:0/1982278026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 -- 172.21.15.81:0/1982278026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f460810ce60 msgr2=0x7f46081a0cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f460810ce60 0x7f46081a0cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 -- 172.21.15.81:0/1982278026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f460810a3c0 msgr2=0x7f46081a0680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f460810a3c0 0x7f46081a0680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.629+0000 7f460da03640 1 -- 172.21.15.81:0/1982278026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46081a1ea0 con 0x7f460810fa80 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.630+0000 7f460da03640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810fa80 0x7f46081a1680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f460000b990 tx=0x7f460000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.630+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600019070 con 0x7f460810fa80 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.630+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7f4600014440 con 0x7f460810fa80 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.630+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600007370 con 0x7f460810fa80 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.630+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46081a2190 con 0x7f460810fa80 2024-09-21T02:51:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.630+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081ca8a0 con 0x7f460810fa80 2024-09-21T02:51:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.632+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f460001c070 con 0x7f460810fa80 2024-09-21T02:51:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.633+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4608110000 con 0x7f460810fa80 2024-09-21T02:51:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.644+0000 7f45fe7fc640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f45f403fba0 0x7f45f40420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:46.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.644+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4600054760 con 0x7f460810fa80 2024-09-21T02:51:46.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.645+0000 7f460d202640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f45f403fba0 0x7f45f40420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:46.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.646+0000 7f460d202640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f45f403fba0 0x7f45f40420b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4604004bc0 tx=0x7f4604005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.650+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4600007dd0 con 0x7f460810fa80 2024-09-21T02:51:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.864 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.877 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:46 smithi164 systemd[1]: Starting Ceph mgr.y for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:51:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.882 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.884 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.884 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.895 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.914 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:51:46.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.943+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f46081cabf0 con 0x7f460810fa80 2024-09-21T02:51:46.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.954+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v12)=0 v12) ==== 114+0+0 (secure 0 0 0) 0x7f4600014880 con 0x7f460810fa80 2024-09-21T02:51:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.955+0000 7f45fe7fc640 1 -- 172.21.15.81:0/1982278026 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f46000138e0 con 0x7f460810fa80 2024-09-21T02:51:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.958+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f45f403fba0 msgr2=0x7f45f40420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.958+0000 7f460f466640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f45f403fba0 0x7f45f40420b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4604004bc0 tx=0x7f4604005fd0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.958+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810fa80 msgr2=0x7f46081a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.958+0000 7f460f466640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810fa80 0x7f46081a1680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f460000b990 tx=0x7f460000be50 comp rx=0 tx=0).stop 2024-09-21T02:51:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.959+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 shutdown_connections 2024-09-21T02:51:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.959+0000 7f460f466640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f45f403fba0 0x7f45f40420b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.959+0000 7f460f466640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f460810ce60 0x7f46081a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.959+0000 7f460f466640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f460810fa80 0x7f46081a1680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.959+0000 7f460f466640 1 --2- 172.21.15.81:0/1982278026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f460810a3c0 0x7f46081a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.959+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 >> 172.21.15.81:0/1982278026 conn(0x7f4608070950 msgr2=0x7f460810e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.960+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 shutdown_connections 2024-09-21T02:51:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:46.963+0000 7f460f466640 1 -- 172.21.15.81:0/1982278026 wait complete. 2024-09-21T02:51:47.146 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:46 smithi164 podman[35034]: 2024-09-21 02:51:46.77931563 +0000 UTC m=+0.016293426 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:51:47.147 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:46 smithi164 podman[35034]: 2024-09-21 02:51:46.889890544 +0000 UTC m=+0.126868331 container create 5e49aeb605654248a9c36ce7ebf0b8ded82fe6c3f18660b41714f0e0509fca8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T02:51:47.147 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:47 smithi164 podman[35034]: 2024-09-21 02:51:47.100473808 +0000 UTC m=+0.337451596 container init 5e49aeb605654248a9c36ce7ebf0b8ded82fe6c3f18660b41714f0e0509fca8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-y, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T02:51:47.147 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:47 smithi164 podman[35034]: 2024-09-21 02:51:47.111025228 +0000 UTC m=+0.348003030 container start 5e49aeb605654248a9c36ce7ebf0b8ded82fe6c3f18660b41714f0e0509fca8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T02:51:47.147 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mgr[35053]: -- 172.21.15.164:0/2423925180 <== mon.2 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56467146b0e0 con 0x56467620e480 2024-09-21T02:51:47.431 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:47 smithi164 bash[35034]: 5e49aeb605654248a9c36ce7ebf0b8ded82fe6c3f18660b41714f0e0509fca8f 2024-09-21T02:51:47.431 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 02:51:47 smithi164 systemd[1]: Started Ceph mgr.y for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:51:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 -- 172.21.15.81:0/2674008726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0701036e0 msgr2=0x7fa070103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 --2- 172.21.15.81:0/2674008726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0701036e0 0x7fa070103af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa058009900 tx=0x7fa05802a480 comp rx=0 tx=0).stop 2024-09-21T02:51:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 -- 172.21.15.81:0/2674008726 shutdown_connections 2024-09-21T02:51:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 --2- 172.21.15.81:0/2674008726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa070104080 0x7fa07010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 --2- 172.21.15.81:0/2674008726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0701036e0 0x7fa070103af0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 --2- 172.21.15.81:0/2674008726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa070102650 0x7fa070102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:47.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 -- 172.21.15.81:0/2674008726 >> 172.21.15.81:0/2674008726 conn(0x7fa0700fdfe0 msgr2=0x7fa070100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 -- 172.21.15.81:0/2674008726 shutdown_connections 2024-09-21T02:51:47.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.870+0000 7fa074952640 1 -- 172.21.15.81:0/2674008726 wait complete. 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 Processor -- start 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 -- start start 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa070102650 0x7fa070106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0701036e0 0x7fa070104b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa070104080 0x7fa070105050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa07010df20 con 0x7fa070104080 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa07010dda0 con 0x7fa0701036e0 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.871+0000 7fa074952640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa07010e0a0 con 0x7fa070102650 2024-09-21T02:51:47.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa070104080 0x7fa070105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa070104080 0x7fa070105050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47244/0 (socket says 172.21.15.81:47244) 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06e59c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa070102650 0x7fa070106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06dd9b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0701036e0 0x7fa070104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 -- 172.21.15.81:0/3091048843 learned_addr learned my addr 172.21.15.81:0/3091048843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 -- 172.21.15.81:0/3091048843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa070102650 msgr2=0x7fa070106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa070102650 0x7fa070106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 -- 172.21.15.81:0/3091048843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0701036e0 msgr2=0x7fa070104b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0701036e0 0x7fa070104b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 -- 172.21.15.81:0/3091048843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa070105750 con 0x7fa070104080 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa06ed9d640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa070104080 0x7fa070105050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa068009fd0 tx=0x7fa06800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa0677fe640 1 -- 172.21.15.81:0/3091048843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068017070 con 0x7fa070104080 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0701a3e10 con 0x7fa070104080 2024-09-21T02:51:47.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa0677fe640 1 -- 172.21.15.81:0/3091048843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7fa068003dc0 con 0x7fa070104080 2024-09-21T02:51:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa0677fe640 1 -- 172.21.15.81:0/3091048843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680047a0 con 0x7fa070104080 2024-09-21T02:51:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.872+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0701a41b0 con 0x7fa070104080 2024-09-21T02:51:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.873+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa070102ac0 con 0x7fa070104080 2024-09-21T02:51:47.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.873+0000 7fa0677fe640 1 -- 172.21.15.81:0/3091048843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7fa0680104a0 con 0x7fa070104080 2024-09-21T02:51:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.874+0000 7fa0677fe640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa05c03fb20 0x7fa05c042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.874+0000 7fa0677fe640 1 -- 172.21.15.81:0/3091048843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa0680542f0 con 0x7fa070104080 2024-09-21T02:51:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.874+0000 7fa06e59c640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa05c03fb20 0x7fa05c042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:47.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.874+0000 7fa06e59c640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa05c03fb20 0x7fa05c042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa060005fd0 tx=0x7fa06000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:47.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:47.879+0000 7fa0677fe640 1 -- 172.21.15.81:0/3091048843 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa06801e120 con 0x7fa070104080 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1982278026' entity='client.admin' 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:48.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.068+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fa0701a43e0 con 0x7fa070104080 2024-09-21T02:51:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.074+0000 7fa0677fe640 1 -- 172.21.15.81:0/3091048843 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v13)=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7fa068003f70 con 0x7fa070104080 2024-09-21T02:51:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa05c03fb20 msgr2=0x7fa05c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa05c03fb20 0x7fa05c042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa060005fd0 tx=0x7fa06000b390 comp rx=0 tx=0).stop 2024-09-21T02:51:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa070104080 msgr2=0x7fa070105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa070104080 0x7fa070105050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa068009fd0 tx=0x7fa06800b260 comp rx=0 tx=0).stop 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 shutdown_connections 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa05c03fb20 0x7fa05c042030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa070104080 0x7fa070105050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0701036e0 0x7fa070104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 --2- 172.21.15.81:0/3091048843 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa070102650 0x7fa070106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 >> 172.21.15.81:0/3091048843 conn(0x7fa0700fdfe0 msgr2=0x7fa07006bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 shutdown_connections 2024-09-21T02:51:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.077+0000 7fa074952640 1 -- 172.21.15.81:0/3091048843 wait complete. 2024-09-21T02:51:48.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1982278026' entity='client.admin' 2024-09-21T02:51:48.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:48.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:48.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/2237498161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0102650 msgr2=0x7f4ff0102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/2237498161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0102650 0x7f4ff0102ac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009900 tx=0x7f4fe002a480 comp rx=0 tx=0).stop 2024-09-21T02:51:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/2237498161 shutdown_connections 2024-09-21T02:51:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/2237498161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff0104080 0x7f4ff010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/2237498161 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ff01036e0 0x7f4ff0103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/2237498161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff0102650 0x7f4ff0102ac0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/2237498161 >> 172.21.15.81:0/2237498161 conn(0x7f4ff00fdfa0 msgr2=0x7f4ff0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/2237498161 shutdown_connections 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/2237498161 wait complete. 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 Processor -- start 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.135+0000 7f4ff5e1d640 1 -- start start 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4ff5e1d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff0102650 0x7f4ff006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4ff5e1d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff01036e0 0x7f4ff019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4ff5e1d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ff0104080 0x7f4ff01a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4ff5e1d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff010def0 con 0x7f4ff01036e0 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4ff5e1d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff010dd70 con 0x7f4ff0104080 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4ff5e1d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff010e070 con 0x7f4ff0102650 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff01036e0 0x7f4ff019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff01036e0 0x7f4ff019eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47260/0 (socket says 172.21.15.81:47260) 2024-09-21T02:51:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fef7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff0102650 0x7f4ff006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 -- 172.21.15.81:0/638116408 learned_addr learned my addr 172.21.15.81:0/638116408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4feffff640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ff0104080 0x7f4ff01a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 -- 172.21.15.81:0/638116408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff0102650 msgr2=0x7f4ff006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff0102650 0x7f4ff006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 -- 172.21.15.81:0/638116408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ff0104080 msgr2=0x7f4ff01a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ff0104080 0x7f4ff01a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 -- 172.21.15.81:0/638116408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff01a1870 con 0x7f4ff01036e0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fe6ffd640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff01036e0 0x7f4ff019eac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800e9f0 tx=0x7f4fd800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.136+0000 7f4fed7fa640 1 -- 172.21.15.81:0/638116408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800cd80 con 0x7f4ff01036e0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.137+0000 7f4fed7fa640 1 -- 172.21.15.81:0/638116408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f4fd8010880 con 0x7f4ff01036e0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.137+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff01a1b60 con 0x7f4ff01036e0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.137+0000 7f4fed7fa640 1 -- 172.21.15.81:0/638116408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8018640 con 0x7f4ff01036e0 2024-09-21T02:51:48.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.137+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff01a20a0 con 0x7f4ff01036e0 2024-09-21T02:51:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.138+0000 7f4fed7fa640 1 -- 172.21.15.81:0/638116408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f4fd8018820 con 0x7f4ff01036e0 2024-09-21T02:51:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.138+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff0102ac0 con 0x7f4ff01036e0 2024-09-21T02:51:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.138+0000 7f4fed7fa640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fdc03fb20 0x7f4fdc042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.138+0000 7f4fed7fa640 1 -- 172.21.15.81:0/638116408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fd8054930 con 0x7f4ff01036e0 2024-09-21T02:51:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.138+0000 7f4fef7fe640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fdc03fb20 0x7f4fdc042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.138+0000 7f4fef7fe640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fdc03fb20 0x7f4fdc042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005ab0 tx=0x7f4fe0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:48.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.144+0000 7f4fed7fa640 1 -- 172.21.15.81:0/638116408 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4fd8020360 con 0x7f4ff01036e0 2024-09-21T02:51:48.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1982278026' entity='client.admin' 2024-09-21T02:51:48.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:51:48.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:48.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:48.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.339+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f4ff01a2390 con 0x7f4ff01036e0 2024-09-21T02:51:48.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.339+0000 7f4fed7fa640 1 -- 172.21.15.81:0/638116408 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v13)=0 v13) ==== 108+0+0 (secure 0 0 0) 0x7f4fd80071c0 con 0x7f4ff01036e0 2024-09-21T02:51:48.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fdc03fb20 msgr2=0x7f4fdc042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fdc03fb20 0x7f4fdc042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005ab0 tx=0x7f4fe0005a20 comp rx=0 tx=0).stop 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff01036e0 msgr2=0x7f4ff019eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff01036e0 0x7f4ff019eac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800e9f0 tx=0x7f4fd800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 shutdown_connections 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fdc03fb20 0x7f4fdc042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ff0104080 0x7f4ff01a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff01036e0 0x7f4ff019eac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 --2- 172.21.15.81:0/638116408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4ff0102650 0x7f4ff006c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 >> 172.21.15.81:0/638116408 conn(0x7f4ff00fdfa0 msgr2=0x7f4ff01049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 shutdown_connections 2024-09-21T02:51:48.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:48.342+0000 7f4ff5e1d640 1 -- 172.21.15.81:0/638116408 wait complete. 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3091048843' entity='client.admin' 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:51:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:49 smithi081 ceph-mon[30991]: Reconfiguring daemon mgr.x on smithi081 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3091048843' entity='client.admin' 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.343 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:51:49.344 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:49.344 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:49.344 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:49.344 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:49 smithi164 ceph-mon[34236]: Reconfiguring daemon mgr.x on smithi081 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3091048843' entity='client.admin' 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:51:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:51:49.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:51:49.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:51:49.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:49 smithi181 ceph-mon[34096]: Reconfiguring daemon mgr.x on smithi081 2024-09-21T02:51:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 -- 172.21.15.81:0/3296881931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 msgr2=0x7fc564103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3296881931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564103c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc560009ca0 tx=0x7fc56002a950 comp rx=0 tx=0).stop 2024-09-21T02:51:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 -- 172.21.15.81:0/3296881931 shutdown_connections 2024-09-21T02:51:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3296881931 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc564104870 0x7fc564104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3296881931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc564105210 0x7fc56410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3296881931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564103c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 -- 172.21.15.81:0/3296881931 >> 172.21.15.81:0/3296881931 conn(0x7fc5640ff150 msgr2=0x7fc564101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 -- 172.21.15.81:0/3296881931 shutdown_connections 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.110+0000 7fc56c21a640 1 -- 172.21.15.81:0/3296881931 wait complete. 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 Processor -- start 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 -- start start 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc564104870 0x7fc56419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc564105210 0x7fc56419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410efc0 con 0x7fc5641037e0 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410ee40 con 0x7fc564104870 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56c21a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410f140 con 0x7fc564105210 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc569fb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:50.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc569fb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47264/0 (socket says 172.21.15.81:47264) 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc569fb6640 1 -- 172.21.15.81:0/3055871495 learned_addr learned my addr 172.21.15.81:0/3055871495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc5697b5640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc564104870 0x7fc56419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc569fb6640 1 -- 172.21.15.81:0/3055871495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc564105210 msgr2=0x7fc56419af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc56a7b7640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc564105210 0x7fc56419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc569fb6640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc564105210 0x7fc56419af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.111+0000 7fc569fb6640 1 -- 172.21.15.81:0/3055871495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc564104870 msgr2=0x7fc56419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc569fb6640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc564104870 0x7fc56419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc569fb6640 1 -- 172.21.15.81:0/3055871495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56419b740 con 0x7fc5641037e0 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc569fb6640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564199d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc560005cc0 tx=0x7fc560030ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc55affd640 1 -- 172.21.15.81:0/3055871495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560034040 con 0x7fc5641037e0 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc55affd640 1 -- 172.21.15.81:0/3055871495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7fc560030850 con 0x7fc5641037e0 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56419b9d0 con 0x7fc5641037e0 2024-09-21T02:51:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc55affd640 1 -- 172.21.15.81:0/3055871495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560004670 con 0x7fc5641037e0 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.112+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5641a2130 con 0x7fc5641037e0 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.113+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56410f780 con 0x7fc5641037e0 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.114+0000 7fc55affd640 1 -- 172.21.15.81:0/3055871495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7fc560037020 con 0x7fc5641037e0 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.114+0000 7fc55affd640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc55007afd0 0x7fc55007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.114+0000 7fc5697b5640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc55007afd0 0x7fc55007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.114+0000 7fc55affd640 1 -- 172.21.15.81:0/3055871495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc5600bde60 con 0x7fc5641037e0 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.115+0000 7fc5697b5640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc55007afd0 0x7fc55007d4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc55400bbe0 tx=0x7fc55400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.119+0000 7fc55affd640 1 -- 172.21.15.81:0/3055871495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5600864e0 con 0x7fc5641037e0 2024-09-21T02:51:50.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:50 smithi081 ceph-mon[30991]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:50.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:50 smithi081 ceph-mon[30991]: Standby manager daemon z started 2024-09-21T02:51:50.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:50 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:51:50.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:50 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:51:50.216 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:50 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:51:50.217 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:50 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:51:50.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.303+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc56402e640 con 0x7fc5641037e0 2024-09-21T02:51:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.307+0000 7fc55affd640 1 -- 172.21.15.81:0/3055871495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7fc56008a8c0 con 0x7fc5641037e0 2024-09-21T02:51:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc55007afd0 msgr2=0x7fc55007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc55007afd0 0x7fc55007d4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc55400bbe0 tx=0x7fc55400b390 comp rx=0 tx=0).stop 2024-09-21T02:51:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 msgr2=0x7fc564199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564199d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc560005cc0 tx=0x7fc560030ed0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 shutdown_connections 2024-09-21T02:51:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc55007afd0 0x7fc55007d4e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc564105210 0x7fc56419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc564104870 0x7fc56419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 --2- 172.21.15.81:0/3055871495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5641037e0 0x7fc564199d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 >> 172.21.15.81:0/3055871495 conn(0x7fc5640ff150 msgr2=0x7fc564107c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 shutdown_connections 2024-09-21T02:51:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:50.310+0000 7fc56c21a640 1 -- 172.21.15.81:0/3055871495 wait complete. 2024-09-21T02:51:50.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:50 smithi164 ceph-mon[34236]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:50.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:50 smithi164 ceph-mon[34236]: Standby manager daemon z started 2024-09-21T02:51:50.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:50 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:51:50.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:50 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:51:50.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:50 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:51:50.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:50 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:51:50.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:50 smithi181 ceph-mon[34096]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:50.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:50 smithi181 ceph-mon[34096]: Standby manager daemon z started 2024-09-21T02:51:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:50 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:51:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:50 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:51:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:50 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:51:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:50 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.181:0/2020667947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:51:51.224 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:51 smithi081 ceph-mon[30991]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-21T02:51:51.224 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:51 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:51:51.224 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:51 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3055871495' entity='client.admin' 2024-09-21T02:51:51.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:51 smithi164 ceph-mon[34236]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-21T02:51:51.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:51 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:51:51.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:51 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3055871495' entity='client.admin' 2024-09-21T02:51:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:51 smithi181 ceph-mon[34096]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-21T02:51:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:51 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:51:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:51 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3055871495' entity='client.admin' 2024-09-21T02:51:51.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.560+0000 7f8619e85640 1 -- 172.21.15.81:0/1215224157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614104070 msgr2=0x7f861410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.560+0000 7f8619e85640 1 --2- 172.21.15.81:0/1215224157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614104070 0x7f861410aa10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f860c009ca0 tx=0x7f860c02a950 comp rx=0 tx=0).stop 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.560+0000 7f8619e85640 1 -- 172.21.15.81:0/1215224157 shutdown_connections 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.560+0000 7f8619e85640 1 --2- 172.21.15.81:0/1215224157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86141036d0 0x7f8614103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.560+0000 7f8619e85640 1 --2- 172.21.15.81:0/1215224157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614104070 0x7f861410aa10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.560+0000 7f8619e85640 1 --2- 172.21.15.81:0/1215224157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8614102640 0x7f8614102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.560+0000 7f8619e85640 1 -- 172.21.15.81:0/1215224157 >> 172.21.15.81:0/1215224157 conn(0x7f86140fdfb0 msgr2=0x7f8614100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.561+0000 7f8619e85640 1 -- 172.21.15.81:0/1215224157 shutdown_connections 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.561+0000 7f8619e85640 1 -- 172.21.15.81:0/1215224157 wait complete. 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.561+0000 7f8619e85640 1 Processor -- start 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.561+0000 7f8619e85640 1 -- start start 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8619e85640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614102640 0x7f861406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8619e85640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86141036d0 0x7f861419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8619e85640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8614104070 0x7f86141a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8619e85640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f861410dea0 con 0x7f8614102640 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8619e85640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f861410dd20 con 0x7f8614104070 2024-09-21T02:51:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8619e85640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f861410e020 con 0x7f86141036d0 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614102640 0x7f861406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614102640 0x7f861406b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55972/0 (socket says 172.21.15.81:55972) 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 -- 172.21.15.81:0/2385206090 learned_addr learned my addr 172.21.15.81:0/2385206090 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8613fff640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8614104070 0x7f86141a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8612ffd640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86141036d0 0x7f861419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 -- 172.21.15.81:0/2385206090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86141036d0 msgr2=0x7f861419ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86141036d0 0x7f861419ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 -- 172.21.15.81:0/2385206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8614104070 msgr2=0x7f86141a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8614104070 0x7f86141a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 -- 172.21.15.81:0/2385206090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86141a1760 con 0x7f8614102640 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f86137fe640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614102640 0x7f861406b6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f860400d950 tx=0x7f860400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8610ff9640 1 -- 172.21.15.81:0/2385206090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604017070 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8610ff9640 1 -- 172.21.15.81:0/2385206090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f8604009c30 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.562+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86141a1a50 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.563+0000 7f8610ff9640 1 -- 172.21.15.81:0/2385206090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860400f3c0 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.563+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86141a1fe0 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.564+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8614102ab0 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.564+0000 7f8610ff9640 1 -- 172.21.15.81:0/2385206090 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f8604010460 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.565+0000 7f8610ff9640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f85fc07afd0 0x7f85fc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.565+0000 7f8610ff9640 1 -- 172.21.15.81:0/2385206090 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f860409c8c0 con 0x7f8614102640 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.565+0000 7f8612ffd640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f85fc07afd0 0x7f85fc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.565+0000 7f8612ffd640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f85fc07afd0 0x7f85fc07d4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8608005d00 tx=0x7f860800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:51.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.570+0000 7f8610ff9640 1 -- 172.21.15.81:0/2385206090 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86040693a0 con 0x7f8614102640 2024-09-21T02:51:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.755+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/4163672868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc1036d0 msgr2=0x7f4fdc103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.755+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/4163672868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc1036d0 0x7f4fdc103ae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009900 tx=0x7f4fcc02a480 comp rx=0 tx=0).stop 2024-09-21T02:51:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/4163672868 shutdown_connections 2024-09-21T02:51:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/4163672868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fdc104070 0x7f4fdc10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/4163672868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc1036d0 0x7f4fdc103ae0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/4163672868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fdc102640 0x7f4fdc102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/4163672868 >> 172.21.15.81:0/4163672868 conn(0x7f4fdc0fdfb0 msgr2=0x7f4fdc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/4163672868 shutdown_connections 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/4163672868 wait complete. 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.756+0000 7f4fe3ad6640 1 Processor -- start 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe3ad6640 1 -- start start 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe3ad6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fdc102640 0x7f4fdc198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe3ad6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fdc1036d0 0x7f4fdc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe3ad6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc104070 0x7f4fdc199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe3ad6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10dec0 con 0x7f4fdc104070 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe3ad6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10dd40 con 0x7f4fdc102640 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe3ad6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10e040 con 0x7f4fdc1036d0 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc104070 0x7f4fdc199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc104070 0x7f4fdc199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55994/0 (socket says 172.21.15.81:55994) 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 -- 172.21.15.81:0/3448382481 learned_addr learned my addr 172.21.15.81:0/3448382481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe1071640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fdc1036d0 0x7f4fdc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe1872640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fdc102640 0x7f4fdc198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 -- 172.21.15.81:0/3448382481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fdc1036d0 msgr2=0x7f4fdc1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fdc1036d0 0x7f4fdc1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 -- 172.21.15.81:0/3448382481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fdc102640 msgr2=0x7f4fdc198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fdc102640 0x7f4fdc198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 -- 172.21.15.81:0/3448382481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc19a6a0 con 0x7f4fdc104070 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.757+0000 7f4fe2073640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc104070 0x7f4fdc199e80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400eb10 tx=0x7f4fd400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.758+0000 7f4fd2ffd640 1 -- 172.21.15.81:0/3448382481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4004b20 con 0x7f4fdc104070 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.758+0000 7f4fd2ffd640 1 -- 172.21.15.81:0/3448382481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f4fd4004cc0 con 0x7f4fdc104070 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.758+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc19a990 con 0x7f4fdc104070 2024-09-21T02:51:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.758+0000 7f4fd2ffd640 1 -- 172.21.15.81:0/3448382481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010430 con 0x7f4fdc104070 2024-09-21T02:51:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.758+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc06b030 con 0x7f4fdc104070 2024-09-21T02:51:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.759+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc10e680 con 0x7f4fdc104070 2024-09-21T02:51:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.760+0000 7f4fd2ffd640 1 -- 172.21.15.81:0/3448382481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f4fd4005020 con 0x7f4fdc104070 2024-09-21T02:51:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.760+0000 7f4fd2ffd640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fc807afd0 0x7f4fc807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.760+0000 7f4fd2ffd640 1 -- 172.21.15.81:0/3448382481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fd409d310 con 0x7f4fdc104070 2024-09-21T02:51:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.760+0000 7f4fe1872640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fc807afd0 0x7f4fc807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.761+0000 7f4fe1872640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fc807afd0 0x7f4fc807d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009b60 tx=0x7f4fd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.765+0000 7f4fd2ffd640 1 -- 172.21.15.81:0/3448382481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4fd4065990 con 0x7f4fdc104070 2024-09-21T02:51:51.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.768+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8614063fc0 con 0x7f8614102640 2024-09-21T02:51:51.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.772+0000 7f8610ff9640 1 -- 172.21.15.81:0/2385206090 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f860406e250 con 0x7f8614102640 2024-09-21T02:51:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f85fc07afd0 msgr2=0x7f85fc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f85fc07afd0 0x7f85fc07d4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8608005d00 tx=0x7f860800b410 comp rx=0 tx=0).stop 2024-09-21T02:51:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614102640 msgr2=0x7f861406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614102640 0x7f861406b6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f860400d950 tx=0x7f860400de10 comp rx=0 tx=0).stop 2024-09-21T02:51:51.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 shutdown_connections 2024-09-21T02:51:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f85fc07afd0 0x7f85fc07d4e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86141036d0 0x7f861419ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8614104070 0x7f86141a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.774+0000 7f8619e85640 1 --2- 172.21.15.81:0/2385206090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8614102640 0x7f861406b6a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.775+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 >> 172.21.15.81:0/2385206090 conn(0x7f86140fdfb0 msgr2=0x7f86141069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.775+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 shutdown_connections 2024-09-21T02:51:51.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.775+0000 7f8619e85640 1 -- 172.21.15.81:0/2385206090 wait complete. 2024-09-21T02:51:51.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.955+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f4fdc109300 con 0x7f4fdc104070 2024-09-21T02:51:51.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.958+0000 7f4fd2ffd640 1 -- 172.21.15.81:0/3448382481 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7f4fd4069d70 con 0x7f4fdc104070 2024-09-21T02:51:51.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fc807afd0 msgr2=0x7f4fc807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fc807afd0 0x7f4fc807d4e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009b60 tx=0x7f4fd8005f90 comp rx=0 tx=0).stop 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc104070 msgr2=0x7f4fdc199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc104070 0x7f4fdc199e80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400eb10 tx=0x7f4fd400c2d0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 shutdown_connections 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4fc807afd0 0x7f4fc807d4e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4fdc1036d0 0x7f4fdc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fdc104070 0x7f4fdc199e80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 --2- 172.21.15.81:0/3448382481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fdc102640 0x7f4fdc198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 >> 172.21.15.81:0/3448382481 conn(0x7f4fdc0fdfb0 msgr2=0x7f4fdc106a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 shutdown_connections 2024-09-21T02:51:51.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.961+0000 7f4fe3ad6640 1 -- 172.21.15.81:0/3448382481 wait complete. 2024-09-21T02:51:52.368 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:52 smithi081 ceph-mon[30991]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:52.368 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:52 smithi081 ceph-mon[30991]: from='client.? ' entity='client.admin' 2024-09-21T02:51:52.368 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:52 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2385206090' entity='client.admin' 2024-09-21T02:51:52.368 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:52 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3448382481' entity='client.admin' 2024-09-21T02:51:52.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:52 smithi164 ceph-mon[34236]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:52.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:52 smithi164 ceph-mon[34236]: from='client.? ' entity='client.admin' 2024-09-21T02:51:52.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:52 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2385206090' entity='client.admin' 2024-09-21T02:51:52.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:52 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3448382481' entity='client.admin' 2024-09-21T02:51:52.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:52 smithi181 ceph-mon[34096]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:52 smithi181 ceph-mon[34096]: from='client.? ' entity='client.admin' 2024-09-21T02:51:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:52 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2385206090' entity='client.admin' 2024-09-21T02:51:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:52 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3448382481' entity='client.admin' 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.500+0000 7f48e4563640 1 -- 172.21.15.81:0/2049611630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104810 msgr2=0x7f48dc104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.500+0000 7f48e4563640 1 --2- 172.21.15.81:0/2049611630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104810 0x7f48dc104c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009900 tx=0x7f48cc02a480 comp rx=0 tx=0).stop 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.500+0000 7f48e4563640 1 -- 172.21.15.81:0/2049611630 shutdown_connections 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.500+0000 7f48e4563640 1 --2- 172.21.15.81:0/2049611630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48dc1051b0 0x7f48dc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.500+0000 7f48e4563640 1 --2- 172.21.15.81:0/2049611630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc104810 0x7f48dc104c20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.500+0000 7f48e4563640 1 --2- 172.21.15.81:0/2049611630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc103780 0x7f48dc103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.501+0000 7f48e4563640 1 -- 172.21.15.81:0/2049611630 >> 172.21.15.81:0/2049611630 conn(0x7f48dc0ff0f0 msgr2=0x7f48dc1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.501+0000 7f48e4563640 1 -- 172.21.15.81:0/2049611630 shutdown_connections 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.501+0000 7f48e4563640 1 -- 172.21.15.81:0/2049611630 wait complete. 2024-09-21T02:51:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.501+0000 7f48e4563640 1 Processor -- start 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.501+0000 7f48e4563640 1 -- start start 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.501+0000 7f48e4563640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48dc103780 0x7f48dc199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.501+0000 7f48e4563640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc104810 0x7f48dc19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e4563640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc1051b0 0x7f48dc19af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e4563640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc10efe0 con 0x7f48dc1051b0 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e4563640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc10ee60 con 0x7f48dc103780 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e4563640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc10f160 con 0x7f48dc104810 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e2b00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc1051b0 0x7f48dc19af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e22ff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48dc103780 0x7f48dc199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e1afe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc104810 0x7f48dc19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e2b00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc1051b0 0x7f48dc19af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55956/0 (socket says 172.21.15.81:55956) 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e2b00640 1 -- 172.21.15.81:0/1084015411 learned_addr learned my addr 172.21.15.81:0/1084015411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e22ff640 1 -- 172.21.15.81:0/1084015411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc104810 msgr2=0x7f48dc19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e22ff640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc104810 0x7f48dc19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e22ff640 1 -- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc1051b0 msgr2=0x7f48dc19af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e22ff640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc1051b0 0x7f48dc19af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e22ff640 1 -- 172.21.15.81:0/1084015411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc19b780 con 0x7f48dc103780 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e2b00640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc1051b0 0x7f48dc19af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.502+0000 7f48e22ff640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48dc103780 0x7f48dc199d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48d800d6d0 tx=0x7f48d800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.503+0000 7f48d37fe640 1 -- 172.21.15.81:0/1084015411 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8017070 con 0x7f48dc103780 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.503+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc19ba70 con 0x7f48dc103780 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.503+0000 7f48d37fe640 1 -- 172.21.15.81:0/1084015411 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f48d8009820 con 0x7f48dc103780 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.503+0000 7f48d37fe640 1 -- 172.21.15.81:0/1084015411 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8004a00 con 0x7f48dc103780 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.503+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc0757c0 con 0x7f48dc103780 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.504+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48dc10f7a0 con 0x7f48dc103780 2024-09-21T02:51:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.504+0000 7f48d37fe640 1 -- 172.21.15.81:0/1084015411 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f48d8004ba0 con 0x7f48dc103780 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.505+0000 7f48d37fe640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f48c807afd0 0x7f48c807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.505+0000 7f48e1afe640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f48c807afd0 0x7f48c807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.505+0000 7f48d37fe640 1 -- 172.21.15.81:0/1084015411 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f48d809caa0 con 0x7f48dc103780 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.505+0000 7f48e1afe640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f48c807afd0 0x7f48c807d4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48cc000c00 tx=0x7f48cc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.510+0000 7f48d37fe640 1 -- 172.21.15.81:0/1084015411 <== mon.2 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48d8069460 con 0x7f48dc103780 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.699+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f48dc02e640 con 0x7f48dc103780 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.705+0000 7f48d37fe640 1 -- 172.21.15.81:0/1084015411 <== mon.2 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v15)=0 v15) ==== 119+0+0 (secure 0 0 0) 0x7f48d806e310 con 0x7f48dc103780 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.707+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f48c807afd0 msgr2=0x7f48c807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.707+0000 7f48e4563640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f48c807afd0 0x7f48c807d4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48cc000c00 tx=0x7f48cc009560 comp rx=0 tx=0).stop 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.707+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48dc103780 msgr2=0x7f48dc199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.707+0000 7f48e4563640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48dc103780 0x7f48dc199d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48d800d6d0 tx=0x7f48d800db90 comp rx=0 tx=0).stop 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 shutdown_connections 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f48c807afd0 0x7f48c807d4e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48dc104810 0x7f48dc19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48dc1051b0 0x7f48dc19af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 --2- 172.21.15.81:0/1084015411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48dc103780 0x7f48dc199d50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 >> 172.21.15.81:0/1084015411 conn(0x7f48dc0ff0f0 msgr2=0x7f48dc107ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 shutdown_connections 2024-09-21T02:51:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:51.708+0000 7f48e4563640 1 -- 172.21.15.81:0/1084015411 wait complete. 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 -- 172.21.15.81:0/271989376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 msgr2=0x7fbe64102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/271989376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe64102ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009900 tx=0x7fbe5402a480 comp rx=0 tx=0).stop 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 -- 172.21.15.81:0/271989376 shutdown_connections 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/271989376 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe64104080 0x7fbe6410aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/271989376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe641036e0 0x7fbe64103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/271989376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe64102ac0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 -- 172.21.15.81:0/271989376 >> 172.21.15.81:0/271989376 conn(0x7fbe640fdfe0 msgr2=0x7fbe64100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 -- 172.21.15.81:0/271989376 shutdown_connections 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.314+0000 7fbe6aa46640 1 -- 172.21.15.81:0/271989376 wait complete. 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 Processor -- start 2024-09-21T02:51:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 -- start start 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe6419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe641036e0 0x7fbe6419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe64104080 0x7fbe6419d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6410c600 con 0x7fbe64102650 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6410c480 con 0x7fbe641036e0 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe6aa46640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6410c780 con 0x7fbe64104080 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe6419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe6419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56020/0 (socket says 172.21.15.81:56020) 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.315+0000 7fbe63fff640 1 -- 172.21.15.81:0/709744895 learned_addr learned my addr 172.21.15.81:0/709744895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe68fe3640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe64104080 0x7fbe6419d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe637fe640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe641036e0 0x7fbe6419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe63fff640 1 -- 172.21.15.81:0/709744895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe64104080 msgr2=0x7fbe6419d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe63fff640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe64104080 0x7fbe6419d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe63fff640 1 -- 172.21.15.81:0/709744895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe641036e0 msgr2=0x7fbe6419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe63fff640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe641036e0 0x7fbe6419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe63fff640 1 -- 172.21.15.81:0/709744895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6419d9d0 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe637fe640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe641036e0 0x7fbe6419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe63fff640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe6419bfa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe54006010 tx=0x7fbe54004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe617fa640 1 -- 172.21.15.81:0/709744895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5403f070 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe617fa640 1 -- 172.21.15.81:0/709744895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7fbe54031d00 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6419dc60 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe617fa640 1 -- 172.21.15.81:0/709744895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54035030 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.316+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe641a43c0 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.317+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe64102ac0 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.319+0000 7fbe617fa640 1 -- 172.21.15.81:0/709744895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fbe54042070 con 0x7fbe64102650 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.319+0000 7fbe617fa640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbe4c0b6500 0x7fbe4c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.319+0000 7fbe637fe640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbe4c0b6500 0x7fbe4c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.320+0000 7fbe617fa640 1 -- 172.21.15.81:0/709744895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbe54106400 con 0x7fbe64102650 2024-09-21T02:51:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.320+0000 7fbe637fe640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbe4c0b6500 0x7fbe4c0b8a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe580058c0 tx=0x7fbe58005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.323+0000 7fbe617fa640 1 -- 172.21.15.81:0/709744895 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe540ce960 con 0x7fbe64102650 2024-09-21T02:51:53.430 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:53 smithi081 ceph-mon[30991]: Standby manager daemon y started 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:53 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:53 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:53 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:53 smithi081 ceph-mon[30991]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:53 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1461147927' entity='client.admin' 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:53 smithi164 ceph-mon[34236]: Standby manager daemon y started 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:53 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:53 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:51:53.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:53 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:51:53.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:53 smithi164 ceph-mon[34236]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:51:53.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:53 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1461147927' entity='client.admin' 2024-09-21T02:51:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:53 smithi181 ceph-mon[34096]: Standby manager daemon y started 2024-09-21T02:51:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:53 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:51:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:53 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:51:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:53 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:51:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:53 smithi181 ceph-mon[34096]: from='mgr.? 172.21.15.164:0/2837505916' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:51:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:53 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1461147927' entity='client.admin' 2024-09-21T02:51:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.508+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fbe64109120 con 0x7fbe64102650 2024-09-21T02:51:53.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.513+0000 7fbe617fa640 1 -- 172.21.15.81:0/709744895 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7fbe540d2d40 con 0x7fbe64102650 2024-09-21T02:51:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbe4c0b6500 msgr2=0x7fbe4c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbe4c0b6500 0x7fbe4c0b8a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe580058c0 tx=0x7fbe58005ec0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 msgr2=0x7fbe6419bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe6419bfa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe54006010 tx=0x7fbe54004360 comp rx=0 tx=0).stop 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 shutdown_connections 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbe4c0b6500 0x7fbe4c0b8a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe64104080 0x7fbe6419d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe641036e0 0x7fbe6419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 --2- 172.21.15.81:0/709744895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe64102650 0x7fbe6419bfa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 >> 172.21.15.81:0/709744895 conn(0x7fbe640fdfe0 msgr2=0x7fbe641003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 shutdown_connections 2024-09-21T02:51:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.515+0000 7fbe6aa46640 1 -- 172.21.15.81:0/709744895 wait complete. 2024-09-21T02:51:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:54 smithi081 ceph-mon[30991]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-21T02:51:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:51:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:54 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/709744895' entity='client.admin' 2024-09-21T02:51:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:54 smithi081 ceph-mon[30991]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:54.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:54 smithi164 ceph-mon[34236]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-21T02:51:54.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:51:54.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:54 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/709744895' entity='client.admin' 2024-09-21T02:51:54.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:54 smithi164 ceph-mon[34236]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:54.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:54 smithi181 ceph-mon[34096]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-21T02:51:54.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:51:54.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:54 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/709744895' entity='client.admin' 2024-09-21T02:51:54.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:54 smithi181 ceph-mon[34096]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:54.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.170+0000 7efd0abbd640 1 -- 172.21.15.81:0/4192368289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 msgr2=0x7efd04108d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:54.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.170+0000 7efd0abbd640 1 --2- 172.21.15.81:0/4192368289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd04108d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009900 tx=0x7efcf802a410 comp rx=0 tx=0).stop 2024-09-21T02:51:54.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.170+0000 7efd0abbd640 1 -- 172.21.15.81:0/4192368289 shutdown_connections 2024-09-21T02:51:54.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.170+0000 7efd0abbd640 1 --2- 172.21.15.81:0/4192368289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd04109490 0x7efd0410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.170+0000 7efd0abbd640 1 --2- 172.21.15.81:0/4192368289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd04108d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.170+0000 7efd0abbd640 1 --2- 172.21.15.81:0/4192368289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd0406c6a0 0x7efd041063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.170+0000 7efd0abbd640 1 -- 172.21.15.81:0/4192368289 >> 172.21.15.81:0/4192368289 conn(0x7efd040fdfd0 msgr2=0x7efd04100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 -- 172.21.15.81:0/4192368289 shutdown_connections 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 -- 172.21.15.81:0/4192368289 wait complete. 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 Processor -- start 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 -- start start 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd0406c6a0 0x7efd04199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd0419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd04109490 0x7efd0419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410efd0 con 0x7efd041068f0 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410ee50 con 0x7efd0406c6a0 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd0abbd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410f150 con 0x7efd04109490 2024-09-21T02:51:54.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd03fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd0419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.171+0000 7efd03fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd0419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56010/0 (socket says 172.21.15.81:56010) 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd03fff640 1 -- 172.21.15.81:0/1461147927 learned_addr learned my addr 172.21.15.81:0/1461147927 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd08959640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd0406c6a0 0x7efd04199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd0915a640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd04109490 0x7efd0419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd03fff640 1 -- 172.21.15.81:0/1461147927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd04109490 msgr2=0x7efd0419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd03fff640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd04109490 0x7efd0419afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd03fff640 1 -- 172.21.15.81:0/1461147927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd0406c6a0 msgr2=0x7efd04199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd03fff640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd0406c6a0 0x7efd04199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd03fff640 1 -- 172.21.15.81:0/1461147927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0419b7e0 con 0x7efd041068f0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd03fff640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd0419a420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efcf8005940 tx=0x7efcf8032b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd01ffb640 1 -- 172.21.15.81:0/1461147927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf803f030 con 0x7efd041068f0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd01ffb640 1 -- 172.21.15.81:0/1461147927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7efcf8003a40 con 0x7efd041068f0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0419ba70 con 0x7efd041068f0 2024-09-21T02:51:54.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd01ffb640 1 -- 172.21.15.81:0/1461147927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8035070 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.172+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd041a2000 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.174+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd04106d40 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.174+0000 7efd01ffb640 1 -- 172.21.15.81:0/1461147927 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7efcf8042030 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.175+0000 7efd01ffb640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efcec07afd0 0x7efcec07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.175+0000 7efd01ffb640 1 -- 172.21.15.81:0/1461147927 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efcf80bd260 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.175+0000 7efd08959640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efcec07afd0 0x7efcec07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.175+0000 7efd08959640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efcec07afd0 0x7efcec07d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcf4005fd0 tx=0x7efcf400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.179+0000 7efd01ffb640 1 -- 172.21.15.81:0/1461147927 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efcf8089cc0 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.365+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7efd0402e9d0 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.369+0000 7efd01ffb640 1 -- 172.21.15.81:0/1461147927 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7efcf808eb70 con 0x7efd041068f0 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efcec07afd0 msgr2=0x7efcec07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efcec07afd0 0x7efcec07d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcf4005fd0 tx=0x7efcf400b390 comp rx=0 tx=0).stop 2024-09-21T02:51:54.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 msgr2=0x7efd0419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd0419a420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efcf8005940 tx=0x7efcf8032b70 comp rx=0 tx=0).stop 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 shutdown_connections 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efcec07afd0 0x7efcec07d4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd04109490 0x7efd0419afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd041068f0 0x7efd0419a420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 --2- 172.21.15.81:0/1461147927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd0406c6a0 0x7efd04199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 >> 172.21.15.81:0/1461147927 conn(0x7efd040fdfd0 msgr2=0x7efd04104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 shutdown_connections 2024-09-21T02:51:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:52.371+0000 7efd0abbd640 1 -- 172.21.15.81:0/1461147927 wait complete. 2024-09-21T02:51:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 -- 172.21.15.81:0/1414758953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 msgr2=0x7f52ec103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 --2- 172.21.15.81:0/1414758953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec103ae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009900 tx=0x7f52d802a480 comp rx=0 tx=0).stop 2024-09-21T02:51:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 -- 172.21.15.81:0/1414758953 shutdown_connections 2024-09-21T02:51:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 --2- 172.21.15.81:0/1414758953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52ec104070 0x7f52ec10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 --2- 172.21.15.81:0/1414758953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec103ae0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 --2- 172.21.15.81:0/1414758953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 0x7f52ec102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 -- 172.21.15.81:0/1414758953 >> 172.21.15.81:0/1414758953 conn(0x7f52ec0fdfb0 msgr2=0x7f52ec100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 -- 172.21.15.81:0/1414758953 shutdown_connections 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.119+0000 7f52f3016640 1 -- 172.21.15.81:0/1414758953 wait complete. 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 Processor -- start 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 -- start start 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 0x7f52ec06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52ec104070 0x7f52ec1a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec10df10 con 0x7f52ec1036d0 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec10dd90 con 0x7f52ec104070 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f3016640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec10e090 con 0x7f52ec102640 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f0db2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 0x7f52ec06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f0db2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 0x7f52ec06b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:58688/0 (socket says 172.21.15.81:58688) 2024-09-21T02:51:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f0db2640 1 -- 172.21.15.81:0/2669444383 learned_addr learned my addr 172.21.15.81:0/2669444383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec19eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56076/0 (socket says 172.21.15.81:56076) 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52f15b3640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52ec104070 0x7f52ec1a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52ebfff640 1 -- 172.21.15.81:0/2669444383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 msgr2=0x7f52ec06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52ebfff640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 0x7f52ec06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52ebfff640 1 -- 172.21.15.81:0/2669444383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52ec104070 msgr2=0x7f52ec1a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.120+0000 7f52ebfff640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52ec104070 0x7f52ec1a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.121+0000 7f52ebfff640 1 -- 172.21.15.81:0/2669444383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec1a1800 con 0x7f52ec1036d0 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.121+0000 7f52f0db2640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 0x7f52ec06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.121+0000 7f52ebfff640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec19eab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52d802aa70 tx=0x7f52d80051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.124+0000 7f52e9ffb640 1 -- 172.21.15.81:0/2669444383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d803f070 con 0x7f52ec1036d0 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.124+0000 7f52e9ffb640 1 -- 172.21.15.81:0/2669444383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f52d8003c40 con 0x7f52ec1036d0 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.124+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec1a1a90 con 0x7f52ec1036d0 2024-09-21T02:51:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.124+0000 7f52e9ffb640 1 -- 172.21.15.81:0/2669444383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8035030 con 0x7f52ec1036d0 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.124+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec1a1f90 con 0x7f52ec1036d0 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.125+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec102ab0 con 0x7f52ec1036d0 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.127+0000 7f52e9ffb640 1 -- 172.21.15.81:0/2669444383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f52d8042070 con 0x7f52ec1036d0 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.127+0000 7f52e9ffb640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52dc0b6500 0x7f52dc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.127+0000 7f52f0db2640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52dc0b6500 0x7f52dc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.127+0000 7f52e9ffb640 1 -- 172.21.15.81:0/2669444383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f52d8105d90 con 0x7f52ec1036d0 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.128+0000 7f52f0db2640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52dc0b6500 0x7f52dc0b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52e00104e0 tx=0x7f52e000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.132+0000 7f52e9ffb640 1 -- 172.21.15.81:0/2669444383 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52d8109030 con 0x7f52ec1036d0 2024-09-21T02:51:55.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.321+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f52ec109820 con 0x7f52ec1036d0 2024-09-21T02:51:55.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.325+0000 7f52e9ffb640 1 -- 172.21.15.81:0/2669444383 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7f52d80d26d0 con 0x7f52ec1036d0 2024-09-21T02:51:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52dc0b6500 msgr2=0x7f52dc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52dc0b6500 0x7f52dc0b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52e00104e0 tx=0x7f52e000b410 comp rx=0 tx=0).stop 2024-09-21T02:51:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 msgr2=0x7f52ec19eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec19eab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52d802aa70 tx=0x7f52d80051d0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 shutdown_connections 2024-09-21T02:51:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52dc0b6500 0x7f52dc0b8a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52ec104070 0x7f52ec1a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52ec1036d0 0x7f52ec19eab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 --2- 172.21.15.81:0/2669444383 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52ec102640 0x7f52ec06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 >> 172.21.15.81:0/2669444383 conn(0x7f52ec0fdfb0 msgr2=0x7f52ec1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 shutdown_connections 2024-09-21T02:51:55.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.328+0000 7f52f3016640 1 -- 172.21.15.81:0/2669444383 wait complete. 2024-09-21T02:51:55.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:55 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3917676322' entity='client.admin' 2024-09-21T02:51:55.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:55 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3917676322' entity='client.admin' 2024-09-21T02:51:55.530 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:55 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3917676322' entity='client.admin' 2024-09-21T02:51:55.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 -- 172.21.15.81:0/2491163901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70104070 msgr2=0x7efe7010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 --2- 172.21.15.81:0/2491163901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70104070 0x7efe7010aa10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe68009ca0 tx=0x7efe6802a950 comp rx=0 tx=0).stop 2024-09-21T02:51:55.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 -- 172.21.15.81:0/2491163901 shutdown_connections 2024-09-21T02:51:55.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 --2- 172.21.15.81:0/2491163901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70104070 0x7efe7010aa10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 --2- 172.21.15.81:0/2491163901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe701036d0 0x7efe70103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 --2- 172.21.15.81:0/2491163901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe70102640 0x7efe70102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 -- 172.21.15.81:0/2491163901 >> 172.21.15.81:0/2491163901 conn(0x7efe700fdfb0 msgr2=0x7efe70100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 -- 172.21.15.81:0/2491163901 shutdown_connections 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 -- 172.21.15.81:0/2491163901 wait complete. 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.009+0000 7efe75cc0640 1 Processor -- start 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe75cc0640 1 -- start start 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe75cc0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70102640 0x7efe70199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe75cc0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe701036d0 0x7efe7019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe75cc0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe70104070 0x7efe7019af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe75cc0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efe7010f020 con 0x7efe70102640 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe75cc0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efe7010eea0 con 0x7efe70104070 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe75cc0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efe7010f1a0 con 0x7efe701036d0 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70102640 0x7efe70199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70102640 0x7efe70199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56044/0 (socket says 172.21.15.81:56044) 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 -- 172.21.15.81:0/3793537611 learned_addr learned my addr 172.21.15.81:0/3793537611 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6effd640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe701036d0 0x7efe7019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6ffff640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe70104070 0x7efe7019af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 -- 172.21.15.81:0/3793537611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe701036d0 msgr2=0x7efe7019a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe701036d0 0x7efe7019a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 -- 172.21.15.81:0/3793537611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe70104070 msgr2=0x7efe7019af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe70104070 0x7efe7019af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6f7fe640 1 -- 172.21.15.81:0/3793537611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7019b6a0 con 0x7efe70102640 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.010+0000 7efe6ffff640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe70104070 0x7efe7019af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.011+0000 7efe6f7fe640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70102640 0x7efe70199d00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c970 tx=0x7efe6000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.011+0000 7efe6cff9640 1 -- 172.21.15.81:0/3793537611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60007bb0 con 0x7efe70102640 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.011+0000 7efe6cff9640 1 -- 172.21.15.81:0/3793537611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7efe60007d50 con 0x7efe70102640 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.011+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7019b990 con 0x7efe70102640 2024-09-21T02:51:55.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.011+0000 7efe6cff9640 1 -- 172.21.15.81:0/3793537611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60004bf0 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.011+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe701a2120 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.012+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7010f780 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.013+0000 7efe6cff9640 1 -- 172.21.15.81:0/3793537611 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7efe60004dd0 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.014+0000 7efe6cff9640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efe5c0b6500 0x7efe5c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.014+0000 7efe6effd640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efe5c0b6500 0x7efe5c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.015+0000 7efe6cff9640 1 -- 172.21.15.81:0/3793537611 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efe600e56e0 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.015+0000 7efe6effd640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efe5c0b6500 0x7efe5c0b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe5800abe0 tx=0x7efe5800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.018+0000 7efe6cff9640 1 -- 172.21.15.81:0/3793537611 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe60014030 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.207+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7efe70102ab0 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.211+0000 7efe6cff9640 1 -- 172.21.15.81:0/3793537611 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v21)=0 v21) ==== 116+0+0 (secure 0 0 0) 0x7efe70102ab0 con 0x7efe70102640 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.213+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efe5c0b6500 msgr2=0x7efe5c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.213+0000 7efe75cc0640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efe5c0b6500 0x7efe5c0b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe5800abe0 tx=0x7efe5800a2d0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.213+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70102640 msgr2=0x7efe70199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:55.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.213+0000 7efe75cc0640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70102640 0x7efe70199d00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c970 tx=0x7efe6000cd70 comp rx=0 tx=0).stop 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 shutdown_connections 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efe5c0b6500 0x7efe5c0b8a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe701036d0 0x7efe7019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe70104070 0x7efe7019af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 --2- 172.21.15.81:0/3793537611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe70102640 0x7efe70199d00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 >> 172.21.15.81:0/3793537611 conn(0x7efe700fdfb0 msgr2=0x7efe701069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 shutdown_connections 2024-09-21T02:51:55.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:55.214+0000 7efe75cc0640 1 -- 172.21.15.81:0/3793537611 wait complete. 2024-09-21T02:51:56.455 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:56 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3793537611' entity='client.admin' 2024-09-21T02:51:56.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:56 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2669444383' entity='client.admin' 2024-09-21T02:51:56.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:56 smithi081 ceph-mon[30991]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:56.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:56 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3793537611' entity='client.admin' 2024-09-21T02:51:56.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:56 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2669444383' entity='client.admin' 2024-09-21T02:51:56.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:56 smithi181 ceph-mon[34096]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:56.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:56 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3793537611' entity='client.admin' 2024-09-21T02:51:56.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:56 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2669444383' entity='client.admin' 2024-09-21T02:51:56.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:56 smithi164 ceph-mon[34236]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:57.583 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-21T02:51:57.583 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T02:51:57.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 -- 172.21.15.81:0/1852040858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 msgr2=0x7f2cec103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 --2- 172.21.15.81:0/1852040858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec103bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009900 tx=0x7f2cdc02a480 comp rx=0 tx=0).stop 2024-09-21T02:51:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 -- 172.21.15.81:0/1852040858 shutdown_connections 2024-09-21T02:51:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 --2- 172.21.15.81:0/1852040858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cec1047e0 0x7f2cec104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 --2- 172.21.15.81:0/1852040858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105180 0x7f2cec10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 --2- 172.21.15.81:0/1852040858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec103bc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 -- 172.21.15.81:0/1852040858 >> 172.21.15.81:0/1852040858 conn(0x7f2cec0ff0c0 msgr2=0x7f2cec101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 -- 172.21.15.81:0/1852040858 shutdown_connections 2024-09-21T02:51:57.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 -- 172.21.15.81:0/1852040858 wait complete. 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 Processor -- start 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.732+0000 7f2cf21af640 1 -- start start 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2cf21af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2cf21af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cec1047e0 0x7f2cec19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2cf21af640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105180 0x7f2cec19af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2cf21af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10eff0 con 0x7f2cec103750 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2cf21af640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10ee70 con 0x7f2cec105180 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2cf21af640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10f170 con 0x7f2cec1047e0 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56116/0 (socket says 172.21.15.81:56116) 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 -- 172.21.15.81:0/4162292601 learned_addr learned my addr 172.21.15.81:0/4162292601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ce2ffd640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cec1047e0 0x7f2cec19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2cebfff640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105180 0x7f2cec19af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 -- 172.21.15.81:0/4162292601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cec1047e0 msgr2=0x7f2cec19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cec1047e0 0x7f2cec19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 -- 172.21.15.81:0/4162292601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105180 msgr2=0x7f2cec19af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105180 0x7f2cec19af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 -- 172.21.15.81:0/4162292601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec19b770 con 0x7f2cec103750 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.733+0000 7f2ceb7fe640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec199d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005ab0 tx=0x7f2cdc005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.734+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc03f070 con 0x7f2cec103750 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.734+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec19ba00 con 0x7f2cec103750 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.734+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f2cdc0044d0 con 0x7f2cec103750 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.734+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc035030 con 0x7f2cec103750 2024-09-21T02:51:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.734+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec0755f0 con 0x7f2cec103750 2024-09-21T02:51:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.735+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec103bc0 con 0x7f2cec103750 2024-09-21T02:51:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.736+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2cdc042070 con 0x7f2cec103750 2024-09-21T02:51:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.737+0000 7f2ce97fa640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2cd80b6480 0x7f2cd80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.737+0000 7f2ce2ffd640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2cd80b6480 0x7f2cd80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.737+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2cdc1063a0 con 0x7f2cec103750 2024-09-21T02:51:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.738+0000 7f2ce2ffd640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2cd80b6480 0x7f2cd80b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4005d00 tx=0x7f2cd400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:57.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.741+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cdc0ce900 con 0x7f2cec103750 2024-09-21T02:51:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 -- 172.21.15.81:0/1703002164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 msgr2=0x7f5594103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 --2- 172.21.15.81:0/1703002164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f5594103b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5584009900 tx=0x7f558402a480 comp rx=0 tx=0).stop 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 -- 172.21.15.81:0/1703002164 shutdown_connections 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 --2- 172.21.15.81:0/1703002164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55941040a0 0x7f559410aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 --2- 172.21.15.81:0/1703002164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f5594103b10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 --2- 172.21.15.81:0/1703002164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5594102670 0x7f5594102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 -- 172.21.15.81:0/1703002164 >> 172.21.15.81:0/1703002164 conn(0x7f55940fdfe0 msgr2=0x7f5594100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 -- 172.21.15.81:0/1703002164 shutdown_connections 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.865+0000 7f559c693640 1 -- 172.21.15.81:0/1703002164 wait complete. 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 Processor -- start 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 -- start start 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5594102670 0x7f5594199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f559419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55941040a0 0x7f559419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f559410f040 con 0x7f5594103700 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f559410eec0 con 0x7f5594102670 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559c693640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f559410f1c0 con 0x7f55941040a0 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f559419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f559419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56096/0 (socket says 172.21.15.81:56096) 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 -- 172.21.15.81:0/632276917 learned_addr learned my addr 172.21.15.81:0/632276917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f559a42f640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5594102670 0x7f5594199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 -- 172.21.15.81:0/632276917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55941040a0 msgr2=0x7f559419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55941040a0 0x7f559419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 -- 172.21.15.81:0/632276917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5594102670 msgr2=0x7f5594199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5594102670 0x7f5594199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.866+0000 7f5599c2e640 1 -- 172.21.15.81:0/632276917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559419b7e0 con 0x7f5594103700 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.867+0000 7f5599c2e640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f559419a420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5584006010 tx=0x7f5584004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.867+0000 7f558b7fe640 1 -- 172.21.15.81:0/632276917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558403f070 con 0x7f5594103700 2024-09-21T02:51:57.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.867+0000 7f558b7fe640 1 -- 172.21.15.81:0/632276917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f5584031d00 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.867+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559419ba70 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.867+0000 7f558b7fe640 1 -- 172.21.15.81:0/632276917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584035030 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.867+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55941a21d0 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.868+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5594102ae0 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.870+0000 7f558b7fe640 1 -- 172.21.15.81:0/632276917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5584042070 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.870+0000 7f558b7fe640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55800b6500 0x7f55800b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.870+0000 7f559a42f640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55800b6500 0x7f55800b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.870+0000 7f558b7fe640 1 -- 172.21.15.81:0/632276917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55841064b0 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.871+0000 7f559a42f640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55800b6500 0x7f55800b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55900058c0 tx=0x7f5590005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:56.873+0000 7f558b7fe640 1 -- 172.21.15.81:0/632276917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55840cea10 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.058+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f5594109850 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.064+0000 7f558b7fe640 1 -- 172.21.15.81:0/632276917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f55840d2df0 con 0x7f5594103700 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55800b6500 msgr2=0x7f55800b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55800b6500 0x7f55800b8a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55900058c0 tx=0x7f5590005c60 comp rx=0 tx=0).stop 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 msgr2=0x7f559419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f559419a420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5584006010 tx=0x7f5584004360 comp rx=0 tx=0).stop 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 shutdown_connections 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55800b6500 0x7f55800b8a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55941040a0 0x7f559419afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5594103700 0x7f559419a420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 --2- 172.21.15.81:0/632276917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5594102670 0x7f5594199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 >> 172.21.15.81:0/632276917 conn(0x7f55940fdfe0 msgr2=0x7f5594106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 shutdown_connections 2024-09-21T02:51:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.067+0000 7f559c693640 1 -- 172.21.15.81:0/632276917 wait complete. 2024-09-21T02:51:57.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.925+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f2cec10a9a0 con 0x7f2cec103750 2024-09-21T02:51:57.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.929+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f2cdc0d2ce0 con 0x7f2cec103750 2024-09-21T02:51:57.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.930+0000 7f2ce97fa640 1 -- 172.21.15.81:0/4162292601 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2cdc0cdd10 con 0x7f2cec103750 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2cd80b6480 msgr2=0x7f2cd80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2cd80b6480 0x7f2cd80b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4005d00 tx=0x7f2cd400b410 comp rx=0 tx=0).stop 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 msgr2=0x7f2cec199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec199d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005ab0 tx=0x7f2cdc005250 comp rx=0 tx=0).stop 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 shutdown_connections 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2cd80b6480 0x7f2cd80b8990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cec1047e0 0x7f2cec19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105180 0x7f2cec19af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 --2- 172.21.15.81:0/4162292601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cec103750 0x7f2cec199d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 >> 172.21.15.81:0/4162292601 conn(0x7f2cec0ff0c0 msgr2=0x7f2cec107b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.931+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 shutdown_connections 2024-09-21T02:51:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:57.932+0000 7f2cf21af640 1 -- 172.21.15.81:0/4162292601 wait complete. 2024-09-21T02:51:58.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:58 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/632276917' entity='client.admin' 2024-09-21T02:51:58.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:58 smithi164 ceph-mon[34236]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:58.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:51:58 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4162292601' entity='client.admin' 2024-09-21T02:51:58.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:58 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/632276917' entity='client.admin' 2024-09-21T02:51:58.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:58 smithi181 ceph-mon[34096]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:58.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:51:58 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4162292601' entity='client.admin' 2024-09-21T02:51:58.503 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:58 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/632276917' entity='client.admin' 2024-09-21T02:51:58.503 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:58 smithi081 ceph-mon[30991]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:51:58.503 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:51:58 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4162292601' entity='client.admin' 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.814+0000 7f1267186640 1 -- 172.21.15.81:0/4121290169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1260104070 msgr2=0x7f126010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 --2- 172.21.15.81:0/4121290169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1260104070 0x7f126010aa10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1258009ca0 tx=0x7f125802a950 comp rx=0 tx=0).stop 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 -- 172.21.15.81:0/4121290169 shutdown_connections 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 --2- 172.21.15.81:0/4121290169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12601036d0 0x7f1260103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 --2- 172.21.15.81:0/4121290169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1260104070 0x7f126010aa10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 --2- 172.21.15.81:0/4121290169 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1260102640 0x7f1260102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 -- 172.21.15.81:0/4121290169 >> 172.21.15.81:0/4121290169 conn(0x7f12600fdfb0 msgr2=0x7f1260100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 -- 172.21.15.81:0/4121290169 shutdown_connections 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 -- 172.21.15.81:0/4121290169 wait complete. 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 Processor -- start 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 -- start start 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1260102640 0x7f1260198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.815+0000 7f1267186640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12601036d0 0x7f1260199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f1267186640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1260104070 0x7f1260199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f1267186640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f126010e000 con 0x7f12601036d0 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f1267186640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f126010de80 con 0x7f1260102640 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f1267186640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f126010e180 con 0x7f1260104070 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12601036d0 0x7f1260199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12601036d0 0x7f1260199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56132/0 (socket says 172.21.15.81:56132) 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 -- 172.21.15.81:0/4164409047 learned_addr learned my addr 172.21.15.81:0/4164409047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f1264f22640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1260102640 0x7f1260198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f1265723640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1260104070 0x7f1260199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 -- 172.21.15.81:0/4164409047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1260104070 msgr2=0x7f1260199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1260104070 0x7f1260199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 -- 172.21.15.81:0/4164409047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1260102640 msgr2=0x7f1260198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1260102640 0x7f1260198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 -- 172.21.15.81:0/4164409047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126019a6c0 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125ffff640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12601036d0 0x7f1260199300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f124c00d770 tx=0x7f124c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125dffb640 1 -- 172.21.15.81:0/4164409047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c017070 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126019a9b0 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125dffb640 1 -- 172.21.15.81:0/4164409047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f124c005490 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.816+0000 7f125dffb640 1 -- 172.21.15.81:0/4164409047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c004b00 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.817+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12601a10b0 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.818+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1260109820 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.819+0000 7f125dffb640 1 -- 172.21.15.81:0/4164409047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f124c004ca0 con 0x7f12601036d0 2024-09-21T02:51:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.819+0000 7f125dffb640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f12500b6480 0x7f12500b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.820+0000 7f1264f22640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f12500b6480 0x7f12500b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.820+0000 7f125dffb640 1 -- 172.21.15.81:0/4164409047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f124c0e5060 con 0x7f12601036d0 2024-09-21T02:51:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.820+0000 7f1264f22640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f12500b6480 0x7f12500b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f125400bbe0 tx=0x7f125400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:58.824+0000 7f125dffb640 1 -- 172.21.15.81:0/4164409047 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f124c0b19a0 con 0x7f12601036d0 2024-09-21T02:51:59.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.006+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f126019abe0 con 0x7f12601036d0 2024-09-21T02:51:59.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.011+0000 7f125dffb640 1 -- 172.21.15.81:0/4164409047 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v25)=0 v25) ==== 111+0+0 (secure 0 0 0) 0x7f124c0b68e0 con 0x7f12601036d0 2024-09-21T02:51:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f12500b6480 msgr2=0x7f12500b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f12500b6480 0x7f12500b8990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f125400bbe0 tx=0x7f125400b390 comp rx=0 tx=0).stop 2024-09-21T02:51:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12601036d0 msgr2=0x7f1260199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12601036d0 0x7f1260199300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f124c00d770 tx=0x7f124c00dc30 comp rx=0 tx=0).stop 2024-09-21T02:51:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 shutdown_connections 2024-09-21T02:51:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f12500b6480 0x7f12500b8990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1260104070 0x7f1260199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12601036d0 0x7f1260199300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 --2- 172.21.15.81:0/4164409047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1260102640 0x7f1260198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 >> 172.21.15.81:0/4164409047 conn(0x7f12600fdfb0 msgr2=0x7f12601069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 shutdown_connections 2024-09-21T02:51:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.013+0000 7f1267186640 1 -- 172.21.15.81:0/4164409047 wait complete. 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 -- 172.21.15.81:0/854060469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 msgr2=0x7f77c0103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 --2- 172.21.15.81:0/854060469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c0103b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009900 tx=0x7f77b002a480 comp rx=0 tx=0).stop 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 -- 172.21.15.81:0/854060469 shutdown_connections 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 --2- 172.21.15.81:0/854060469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77c01040a0 0x7f77c010aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 --2- 172.21.15.81:0/854060469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c0103b10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 --2- 172.21.15.81:0/854060469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77c0102670 0x7f77c0102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 -- 172.21.15.81:0/854060469 >> 172.21.15.81:0/854060469 conn(0x7f77c00fdfe0 msgr2=0x7f77c0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 -- 172.21.15.81:0/854060469 shutdown_connections 2024-09-21T02:51:59.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.511+0000 7f77c72c7640 1 -- 172.21.15.81:0/854060469 wait complete. 2024-09-21T02:51:59.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 Processor -- start 2024-09-21T02:51:59.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 -- start start 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77c0102670 0x7f77c006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77c01040a0 0x7f77c01a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010e030 con 0x7f77c0103700 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010deb0 con 0x7f77c0102670 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c72c7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010e1b0 con 0x7f77c01040a0 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c4862640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c4862640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c019eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56160/0 (socket says 172.21.15.81:56160) 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c4862640 1 -- 172.21.15.81:0/160544977 learned_addr learned my addr 172.21.15.81:0/160544977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c5063640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77c0102670 0x7f77c006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.512+0000 7f77c5864640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77c01040a0 0x7f77c01a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c4862640 1 -- 172.21.15.81:0/160544977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77c01040a0 msgr2=0x7f77c01a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c4862640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77c01040a0 0x7f77c01a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c4862640 1 -- 172.21.15.81:0/160544977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77c0102670 msgr2=0x7f77c006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c4862640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77c0102670 0x7f77c006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c4862640 1 -- 172.21.15.81:0/160544977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c01a1910 con 0x7f77c0103700 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c5864640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77c01040a0 0x7f77c01a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c5063640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77c0102670 0x7f77c006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c4862640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c019eba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77b0006010 tx=0x7f77b0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77b67fc640 1 -- 172.21.15.81:0/160544977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b003f070 con 0x7f77c0103700 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77b67fc640 1 -- 172.21.15.81:0/160544977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f77b0031cf0 con 0x7f77c0103700 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c01a1ba0 con 0x7f77c0103700 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77b67fc640 1 -- 172.21.15.81:0/160544977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0035030 con 0x7f77c0103700 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.513+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01a2080 con 0x7f77c0103700 2024-09-21T02:51:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.514+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c0109850 con 0x7f77c0103700 2024-09-21T02:51:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.515+0000 7f77b67fc640 1 -- 172.21.15.81:0/160544977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f77b0042070 con 0x7f77c0103700 2024-09-21T02:51:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.516+0000 7f77b67fc640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77ac0b6480 0x7f77ac0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.516+0000 7f77c5063640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77ac0b6480 0x7f77ac0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.516+0000 7f77b67fc640 1 -- 172.21.15.81:0/160544977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f77b0106170 con 0x7f77c0103700 2024-09-21T02:51:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.517+0000 7f77c5063640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77ac0b6480 0x7f77ac0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0058c0 tx=0x7f77bc005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.520+0000 7f77b67fc640 1 -- 172.21.15.81:0/160544977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77b00ce6d0 con 0x7f77c0103700 2024-09-21T02:51:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.710+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f77c0064030 con 0x7f77c0103700 2024-09-21T02:51:59.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.716+0000 7f77b67fc640 1 -- 172.21.15.81:0/160544977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v26)=0 v26) ==== 127+0+0 (secure 0 0 0) 0x7f77b00d2ab0 con 0x7f77c0103700 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77ac0b6480 msgr2=0x7f77ac0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77ac0b6480 0x7f77ac0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0058c0 tx=0x7f77bc005d30 comp rx=0 tx=0).stop 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 msgr2=0x7f77c019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c019eba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77b0006010 tx=0x7f77b0003d50 comp rx=0 tx=0).stop 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 shutdown_connections 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77ac0b6480 0x7f77ac0b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77c01040a0 0x7f77c01a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77c0103700 0x7f77c019eba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 --2- 172.21.15.81:0/160544977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77c0102670 0x7f77c006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 >> 172.21.15.81:0/160544977 conn(0x7f77c00fdfe0 msgr2=0x7f77c0106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:59.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 shutdown_connections 2024-09-21T02:51:59.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.718+0000 7f77c72c7640 1 -- 172.21.15.81:0/160544977 wait complete. 2024-09-21T02:51:59.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.948+0000 7f772ab71640 1 -- 172.21.15.81:0/489859803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 msgr2=0x7f7724104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.948+0000 7f772ab71640 1 --2- 172.21.15.81:0/489859803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 0x7f7724104c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7714009900 tx=0x7f771402a480 comp rx=0 tx=0).stop 2024-09-21T02:51:59.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.948+0000 7f772ab71640 1 -- 172.21.15.81:0/489859803 shutdown_connections 2024-09-21T02:51:59.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.948+0000 7f772ab71640 1 --2- 172.21.15.81:0/489859803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77241051b0 0x7f772410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.948+0000 7f772ab71640 1 --2- 172.21.15.81:0/489859803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 0x7f7724104c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.948+0000 7f772ab71640 1 --2- 172.21.15.81:0/489859803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7724103780 0x7f7724103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.948+0000 7f772ab71640 1 -- 172.21.15.81:0/489859803 >> 172.21.15.81:0/489859803 conn(0x7f77240ff0f0 msgr2=0x7f77241015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:51:59.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.949+0000 7f772ab71640 1 -- 172.21.15.81:0/489859803 shutdown_connections 2024-09-21T02:51:59.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.949+0000 7f772ab71640 1 -- 172.21.15.81:0/489859803 wait complete. 2024-09-21T02:51:59.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.949+0000 7f772ab71640 1 Processor -- start 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.949+0000 7f772ab71640 1 -- start start 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.949+0000 7f772ab71640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724103780 0x7f77241a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772ab71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 0x7f77241a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772ab71640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77241051b0 0x7f77241a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772ab71640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f772410f190 con 0x7f7724104810 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772ab71640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f772410f010 con 0x7f7724103780 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772ab71640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f772410f310 con 0x7f77241051b0 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724103780 0x7f77241a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724103780 0x7f77241a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:37716/0 (socket says 172.21.15.81:37716) 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 -- 172.21.15.81:0/3790308348 learned_addr learned my addr 172.21.15.81:0/3790308348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772910e640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77241051b0 0x7f77241a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 -- 172.21.15.81:0/3790308348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77241051b0 msgr2=0x7f77241a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f771bfff640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 0x7f77241a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77241051b0 0x7f77241a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 -- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 msgr2=0x7f77241a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 0x7f77241a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 -- 172.21.15.81:0/3790308348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77241a1e70 con 0x7f7724103780 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.950+0000 7f772890d640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724103780 0x7f77241a0440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f772000ea80 tx=0x7f772000ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.951+0000 7f7719ffb640 1 -- 172.21.15.81:0/3790308348 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772000ce40 con 0x7f7724103780 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.951+0000 7f7719ffb640 1 -- 172.21.15.81:0/3790308348 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7720005020 con 0x7f7724103780 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.951+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77241a2160 con 0x7f7724103780 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.951+0000 7f7719ffb640 1 -- 172.21.15.81:0/3790308348 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200116d0 con 0x7f7724103780 2024-09-21T02:51:59.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.951+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77241a8860 con 0x7f7724103780 2024-09-21T02:51:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.952+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7724108950 con 0x7f7724103780 2024-09-21T02:51:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.953+0000 7f7719ffb640 1 -- 172.21.15.81:0/3790308348 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f7720004a40 con 0x7f7724103780 2024-09-21T02:51:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.954+0000 7f7719ffb640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f770c0b6500 0x7f770c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:51:59.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.954+0000 7f771bfff640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f770c0b6500 0x7f770c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:51:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.954+0000 7f7719ffb640 1 -- 172.21.15.81:0/3790308348 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f77200e5950 con 0x7f7724103780 2024-09-21T02:51:59.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.954+0000 7f771bfff640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f770c0b6500 0x7f770c0b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7714005f70 tx=0x7f7714005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:51:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.959+0000 7f7719ffb640 1 -- 172.21.15.81:0/3790308348 <== mon.2 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7720016030 con 0x7f7724103780 2024-09-21T02:52:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.153+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7724063fc0 con 0x7f7724103780 2024-09-21T02:52:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.161+0000 7f7719ffb640 1 -- 172.21.15.81:0/3790308348 <== mon.2 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) ==== 120+0+0 (secure 0 0 0) 0x7f77200051d0 con 0x7f7724103780 2024-09-21T02:52:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f770c0b6500 msgr2=0x7f770c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f770c0b6500 0x7f770c0b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7714005f70 tx=0x7f7714005fd0 comp rx=0 tx=0).stop 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724103780 msgr2=0x7f77241a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724103780 0x7f77241a0440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f772000ea80 tx=0x7f772000ef40 comp rx=0 tx=0).stop 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 shutdown_connections 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f770c0b6500 0x7f770c0b8a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f77241051b0 0x7f77241a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7724104810 0x7f77241a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 --2- 172.21.15.81:0/3790308348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724103780 0x7f77241a0440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 >> 172.21.15.81:0/3790308348 conn(0x7f77240ff0f0 msgr2=0x7f7724105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 shutdown_connections 2024-09-21T02:52:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.163+0000 7f772ab71640 1 -- 172.21.15.81:0/3790308348 wait complete. 2024-09-21T02:52:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:00 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4164409047' entity='client.admin' 2024-09-21T02:52:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:00 smithi164 ceph-mon[34236]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:00 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/160544977' entity='client.admin' 2024-09-21T02:52:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:00 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3498917384' entity='client.admin' 2024-09-21T02:52:00.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:00 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4164409047' entity='client.admin' 2024-09-21T02:52:00.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:00 smithi181 ceph-mon[34096]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:00.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:00 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/160544977' entity='client.admin' 2024-09-21T02:52:00.301 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:00 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3498917384' entity='client.admin' 2024-09-21T02:52:00.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:00 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4164409047' entity='client.admin' 2024-09-21T02:52:00.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:00 smithi081 ceph-mon[30991]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:00.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:00 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/160544977' entity='client.admin' 2024-09-21T02:52:00.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:00 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3498917384' entity='client.admin' 2024-09-21T02:52:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 -- 172.21.15.81:0/4081413860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4806c340 msgr2=0x7fac481063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 --2- 172.21.15.81:0/4081413860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4806c340 0x7fac481063a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fac44009900 tx=0x7fac4402a410 comp rx=0 tx=0).stop 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 -- 172.21.15.81:0/4081413860 shutdown_connections 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 --2- 172.21.15.81:0/4081413860 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac481068e0 0x7fac48108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 --2- 172.21.15.81:0/4081413860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac48109480 0x7fac4810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 --2- 172.21.15.81:0/4081413860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac4806c340 0x7fac481063a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 -- 172.21.15.81:0/4081413860 >> 172.21.15.81:0/4081413860 conn(0x7fac480fdfa0 msgr2=0x7fac48100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 -- 172.21.15.81:0/4081413860 shutdown_connections 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.702+0000 7fac5073f640 1 -- 172.21.15.81:0/4081413860 wait complete. 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 Processor -- start 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 -- start start 2024-09-21T02:52:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac4806c340 0x7fac481039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac481068e0 0x7fac481022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac48109480 0x7fac481027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810f100 con 0x7fac48109480 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810ef80 con 0x7fac4806c340 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac5073f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fac4810f280 con 0x7fac481068e0 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac4ecdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac48109480 0x7fac481027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac4ecdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac48109480 0x7fac481027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56164/0 (socket says 172.21.15.81:56164) 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac4ecdc640 1 -- 172.21.15.81:0/3498917384 learned_addr learned my addr 172.21.15.81:0/3498917384 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.703+0000 7fac4e4db640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac4806c340 0x7fac481039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac4dcda640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac481068e0 0x7fac481022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac4ecdc640 1 -- 172.21.15.81:0/3498917384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac481068e0 msgr2=0x7fac481022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac4ecdc640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac481068e0 0x7fac481022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac4ecdc640 1 -- 172.21.15.81:0/3498917384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac4806c340 msgr2=0x7fac481039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac4ecdc640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac4806c340 0x7fac481039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac4ecdc640 1 -- 172.21.15.81:0/3498917384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48102ee0 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac4ecdc640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac48109480 0x7fac481027e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac4000cad0 tx=0x7fac4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac3f7fe640 1 -- 172.21.15.81:0/3498917384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4000ae20 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac3f7fe640 1 -- 172.21.15.81:0/3498917384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fac40005020 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac3f7fe640 1 -- 172.21.15.81:0/3498917384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4000f6b0 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac481a3eb0 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.704+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481a4250 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.705+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac480ffac0 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.707+0000 7fac3f7fe640 1 -- 172.21.15.81:0/3498917384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fac40004a40 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.708+0000 7fac3f7fe640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac340b6500 0x7fac340b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.708+0000 7fac4e4db640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac340b6500 0x7fac340b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.708+0000 7fac3f7fe640 1 -- 172.21.15.81:0/3498917384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fac400e5910 con 0x7fac48109480 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.708+0000 7fac4e4db640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac340b6500 0x7fac340b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fac44009230 tx=0x7fac440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.711+0000 7fac3f7fe640 1 -- 172.21.15.81:0/3498917384 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac40014030 con 0x7fac48109480 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.904+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fac48106cf0 con 0x7fac48109480 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.910+0000 7fac3f7fe640 1 -- 172.21.15.81:0/3498917384 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fac400b22d0 con 0x7fac48109480 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac340b6500 msgr2=0x7fac340b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac340b6500 0x7fac340b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fac44009230 tx=0x7fac440058d0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac48109480 msgr2=0x7fac481027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac48109480 0x7fac481027e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac4000cad0 tx=0x7fac4000cf90 comp rx=0 tx=0).stop 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 shutdown_connections 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac340b6500 0x7fac340b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac481068e0 0x7fac481022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac48109480 0x7fac481027e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 --2- 172.21.15.81:0/3498917384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac4806c340 0x7fac481039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 >> 172.21.15.81:0/3498917384 conn(0x7fac480fdfa0 msgr2=0x7fac48104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 shutdown_connections 2024-09-21T02:52:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.913+0000 7fac5073f640 1 -- 172.21.15.81:0/3498917384 wait complete. 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 -- 172.21.15.81:0/2666401820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71541069a0 msgr2=0x7f7154108dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 --2- 172.21.15.81:0/2666401820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71541069a0 0x7f7154108dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7148009900 tx=0x7f714802a410 comp rx=0 tx=0).stop 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 -- 172.21.15.81:0/2666401820 shutdown_connections 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 --2- 172.21.15.81:0/2666401820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71541094e0 0x7f715410b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 --2- 172.21.15.81:0/2666401820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71541069a0 0x7f7154108dc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 --2- 172.21.15.81:0/2666401820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f715406c5e0 0x7f7154106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 -- 172.21.15.81:0/2666401820 >> 172.21.15.81:0/2666401820 conn(0x7f71540fe000 msgr2=0x7f71541004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 -- 172.21.15.81:0/2666401820 shutdown_connections 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 -- 172.21.15.81:0/2666401820 wait complete. 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 Processor -- start 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.806+0000 7f715a625640 1 -- start start 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f715a625640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715406c5e0 0x7f7154199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f715a625640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71541069a0 0x7f715419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f715a625640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71541094e0 0x7f715419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f715a625640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f715410f120 con 0x7f715406c5e0 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f715a625640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f715410efa0 con 0x7f71541069a0 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f715a625640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f715410f2a0 con 0x7f71541094e0 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715406c5e0 0x7f7154199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715406c5e0 0x7f7154199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56178/0 (socket says 172.21.15.81:56178) 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 -- 172.21.15.81:0/1651180989 learned_addr learned my addr 172.21.15.81:0/1651180989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f71537fe640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71541069a0 0x7f715419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7158bc2640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71541094e0 0x7f715419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 -- 172.21.15.81:0/1651180989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71541094e0 msgr2=0x7f715419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71541094e0 0x7f715419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 -- 172.21.15.81:0/1651180989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71541069a0 msgr2=0x7f715419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71541069a0 0x7f715419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.807+0000 7f7153fff640 1 -- 172.21.15.81:0/1651180989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715419b8a0 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.808+0000 7f7153fff640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715406c5e0 0x7f7154199e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f714400d950 tx=0x7f714400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.808+0000 7f71517fa640 1 -- 172.21.15.81:0/1651180989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144017070 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.808+0000 7f71517fa640 1 -- 172.21.15.81:0/1651180989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7144009c30 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.808+0000 7f71517fa640 1 -- 172.21.15.81:0/1651180989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714400f620 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.808+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715419bb90 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.808+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541a2290 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.809+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71540ffb20 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.811+0000 7f71517fa640 1 -- 172.21.15.81:0/1651180989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f7144010460 con 0x7f715406c5e0 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.812+0000 7f71517fa640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f713c0b6500 0x7f713c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.812+0000 7f71537fe640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f713c0b6500 0x7f713c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.812+0000 7f71517fa640 1 -- 172.21.15.81:0/1651180989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f71440e51a0 con 0x7f715406c5e0 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.813+0000 7f71537fe640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f713c0b6500 0x7f713c0b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7148009230 tx=0x7f71480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:59.815+0000 7f71517fa640 1 -- 172.21.15.81:0/1651180989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71440ad780 con 0x7f715406c5e0 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.006+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f715402e640 con 0x7f715406c5e0 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.007+0000 7f71517fa640 1 -- 172.21.15.81:0/1651180989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v27)=0 v27) ==== 106+0+0 (secure 0 0 0) 0x7f7144009de0 con 0x7f715406c5e0 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f713c0b6500 msgr2=0x7f713c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f713c0b6500 0x7f713c0b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7148009230 tx=0x7f71480058d0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715406c5e0 msgr2=0x7f7154199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715406c5e0 0x7f7154199e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f714400d950 tx=0x7f714400de10 comp rx=0 tx=0).stop 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 shutdown_connections 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f713c0b6500 0x7f713c0b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f71541094e0 0x7f715419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71541069a0 0x7f715419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 --2- 172.21.15.81:0/1651180989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715406c5e0 0x7f7154199e70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 >> 172.21.15.81:0/1651180989 conn(0x7f71540fe000 msgr2=0x7f7154104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 shutdown_connections 2024-09-21T02:52:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:00.009+0000 7f715a625640 1 -- 172.21.15.81:0/1651180989 wait complete. 2024-09-21T02:52:01.304 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:01 smithi081 ceph-mon[30991]: from='client.? ' entity='client.admin' 2024-09-21T02:52:01.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:01 smithi164 ceph-mon[34236]: from='client.? ' entity='client.admin' 2024-09-21T02:52:01.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:01 smithi181 ceph-mon[34096]: from='client.? ' entity='client.admin' 2024-09-21T02:52:02.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 -- 172.21.15.81:0/2755458572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 msgr2=0x7fa60c1106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:02.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 --2- 172.21.15.81:0/2755458572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1106d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009900 tx=0x7fa5f802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 -- 172.21.15.81:0/2755458572 shutdown_connections 2024-09-21T02:52:02.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 --2- 172.21.15.81:0/2755458572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c110c10 0x7fa60c1130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 --2- 172.21.15.81:0/2755458572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1106d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 --2- 172.21.15.81:0/2755458572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa60c10a3c0 0x7fa60c10dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 -- 172.21.15.81:0/2755458572 >> 172.21.15.81:0/2755458572 conn(0x7fa60c070950 msgr2=0x7fa60c072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 -- 172.21.15.81:0/2755458572 shutdown_connections 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.927+0000 7fa6130f1640 1 -- 172.21.15.81:0/2755458572 wait complete. 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 Processor -- start 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 -- start start 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c10a3c0 0x7fa60c10b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1a7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa60c110c10 0x7fa60c1a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c116750 con 0x7fa60c10e2b0 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1165d0 con 0x7fa60c110c10 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa6130f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1168d0 con 0x7fa60c10a3c0 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1a7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56038/0 (socket says 172.21.15.81:56038) 2024-09-21T02:52:02.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 -- 172.21.15.81:0/3917676322 learned_addr learned my addr 172.21.15.81:0/3917676322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa610e8d640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c10a3c0 0x7fa60c10b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa61168e640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa60c110c10 0x7fa60c1a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 -- 172.21.15.81:0/3917676322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c10a3c0 msgr2=0x7fa60c10b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c10a3c0 0x7fa60c10b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 -- 172.21.15.81:0/3917676322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa60c110c10 msgr2=0x7fa60c1a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa60c110c10 0x7fa60c1a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.928+0000 7fa60bfff640 1 -- 172.21.15.81:0/3917676322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c1a9fd0 con 0x7fa60c10e2b0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.929+0000 7fa60bfff640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1a7310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8005ab0 tx=0x7fa5f8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.929+0000 7fa609ffb640 1 -- 172.21.15.81:0/3917676322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f803f070 con 0x7fa60c10e2b0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.929+0000 7fa609ffb640 1 -- 172.21.15.81:0/3917676322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7fa5f8003a40 con 0x7fa60c10e2b0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.929+0000 7fa609ffb640 1 -- 172.21.15.81:0/3917676322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8035030 con 0x7fa60c10e2b0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.929+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c1aa260 con 0x7fa60c10e2b0 2024-09-21T02:52:02.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.929+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c1aa790 con 0x7fa60c10e2b0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.930+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c10e6c0 con 0x7fa60c10e2b0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.931+0000 7fa609ffb640 1 -- 172.21.15.81:0/3917676322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa5f8042070 con 0x7fa60c10e2b0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.932+0000 7fa609ffb640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa5fc0b6500 0x7fa5fc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.932+0000 7fa610e8d640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa5fc0b6500 0x7fa5fc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.932+0000 7fa609ffb640 1 -- 172.21.15.81:0/3917676322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa5f8106290 con 0x7fa60c10e2b0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.933+0000 7fa610e8d640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa5fc0b6500 0x7fa5fc0b8a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0755c0 tx=0x7fa60000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:53.935+0000 7fa609ffb640 1 -- 172.21.15.81:0/3917676322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5f80ce7f0 con 0x7fa60c10e2b0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.118+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fa60c02e640 con 0x7fa60c10e2b0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.122+0000 7fa609ffb640 1 -- 172.21.15.81:0/3917676322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v20)=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7fa5f80d2bd0 con 0x7fa60c10e2b0 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa5fc0b6500 msgr2=0x7fa5fc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa5fc0b6500 0x7fa5fc0b8a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa60c0755c0 tx=0x7fa60000a2d0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 msgr2=0x7fa60c1a7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1a7310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8005ab0 tx=0x7fa5f8005020 comp rx=0 tx=0).stop 2024-09-21T02:52:02.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 shutdown_connections 2024-09-21T02:52:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa5fc0b6500 0x7fa5fc0b8a10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa60c110c10 0x7fa60c1a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa60c10e2b0 0x7fa60c1a7310 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 --2- 172.21.15.81:0/3917676322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa60c10a3c0 0x7fa60c10b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 >> 172.21.15.81:0/3917676322 conn(0x7fa60c070950 msgr2=0x7fa60c10c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 shutdown_connections 2024-09-21T02:52:02.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:51:54.127+0000 7fa6130f1640 1 -- 172.21.15.81:0/3917676322 wait complete. 2024-09-21T02:52:02.327 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:02 smithi081 ceph-mon[30991]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:02.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:02 smithi164 ceph-mon[34236]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:02.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:02 smithi181 ceph-mon[34096]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:03.984 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:03 smithi081 ceph-mon[30991]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:03.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:03 smithi181 ceph-mon[34096]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:04.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:03 smithi164 ceph-mon[34236]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 -- 172.21.15.81:0/1067014306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 msgr2=0x7f466c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 --2- 172.21.15.81:0/1067014306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c10bb20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ca0 tx=0x7f466402a950 comp rx=0 tx=0).stop 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 -- 172.21.15.81:0/1067014306 shutdown_connections 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 --2- 172.21.15.81:0/1067014306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466c1047e0 0x7f466c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 --2- 172.21.15.81:0/1067014306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c10bb20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 --2- 172.21.15.81:0/1067014306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f466c103750 0x7f466c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 -- 172.21.15.81:0/1067014306 >> 172.21.15.81:0/1067014306 conn(0x7f466c0ff0c0 msgr2=0x7f466c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 -- 172.21.15.81:0/1067014306 shutdown_connections 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.094+0000 7f4672792640 1 -- 172.21.15.81:0/1067014306 wait complete. 2024-09-21T02:52:05.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 Processor -- start 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 -- start start 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466c103750 0x7f466c199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f466c1047e0 0x7f466c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f466c10f110 con 0x7f466c105180 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f466c10ef90 con 0x7f466c1047e0 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4672792640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f466c10f290 con 0x7f466c103750 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4670d2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4670d2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c19afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43424/0 (socket says 172.21.15.81:43424) 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4670d2f640 1 -- 172.21.15.81:0/1911860790 learned_addr learned my addr 172.21.15.81:0/1911860790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f466bfff640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466c103750 0x7f466c199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.095+0000 7f4663fff640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f466c1047e0 0x7f466c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4670d2f640 1 -- 172.21.15.81:0/1911860790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466c103750 msgr2=0x7f466c199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4670d2f640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466c103750 0x7f466c199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4670d2f640 1 -- 172.21.15.81:0/1911860790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f466c1047e0 msgr2=0x7f466c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4670d2f640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f466c1047e0 0x7f466c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4670d2f640 1 -- 172.21.15.81:0/1911860790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c19b7f0 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4670d2f640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c19afd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4664004af0 tx=0x7f466402fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4669ffb640 1 -- 172.21.15.81:0/1911860790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664034040 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4669ffb640 1 -- 172.21.15.81:0/1911860790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f46640308d0 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c19ba80 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4669ffb640 1 -- 172.21.15.81:0/1911860790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664004840 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.096+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c1a21e0 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.097+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c103bc0 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.099+0000 7f4669ffb640 1 -- 172.21.15.81:0/1911860790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f4664037020 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.100+0000 7f4669ffb640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f46580b6500 0x7f46580b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.100+0000 7f466bfff640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f46580b6500 0x7f46580b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.100+0000 7f4669ffb640 1 -- 172.21.15.81:0/1911860790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4664106710 con 0x7f466c105180 2024-09-21T02:52:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.101+0000 7f466bfff640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f46580b6500 0x7f46580b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f465c00bbe0 tx=0x7f465c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:05.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.104+0000 7f4669ffb640 1 -- 172.21.15.81:0/1911860790 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4664083710 con 0x7f466c105180 2024-09-21T02:52:05.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.290+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f466c10a930 con 0x7f466c105180 2024-09-21T02:52:05.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.294+0000 7f4669ffb640 1 -- 172.21.15.81:0/1911860790 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v29)=0 v29) ==== 106+0+0 (secure 0 0 0) 0x7f466c10a930 con 0x7f466c105180 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f46580b6500 msgr2=0x7f46580b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f46580b6500 0x7f46580b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f465c00bbe0 tx=0x7f465c00b390 comp rx=0 tx=0).stop 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 msgr2=0x7f466c19afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c19afd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4664004af0 tx=0x7f466402fad0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 shutdown_connections 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f46580b6500 0x7f46580b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c105180 0x7f466c19afd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f466c1047e0 0x7f466c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 --2- 172.21.15.81:0/1911860790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f466c103750 0x7f466c199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.296+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 >> 172.21.15.81:0/1911860790 conn(0x7f466c0ff0c0 msgr2=0x7f466c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.297+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 shutdown_connections 2024-09-21T02:52:05.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.297+0000 7f4672792640 1 -- 172.21.15.81:0/1911860790 wait complete. 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 -- 172.21.15.81:0/521656685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8102640 msgr2=0x7f0fb8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/521656685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8102640 0x7f0fb8102ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009900 tx=0x7f0fa802a480 comp rx=0 tx=0).stop 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 -- 172.21.15.81:0/521656685 shutdown_connections 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/521656685 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb81036d0 0x7f0fb8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/521656685 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fb8104070 0x7f0fb810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/521656685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8102640 0x7f0fb8102ab0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 -- 172.21.15.81:0/521656685 >> 172.21.15.81:0/521656685 conn(0x7f0fb80fdfb0 msgr2=0x7f0fb8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 -- 172.21.15.81:0/521656685 shutdown_connections 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 -- 172.21.15.81:0/521656685 wait complete. 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 Processor -- start 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.402+0000 7f0fbdb18640 1 -- start start 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fbdb18640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fb8102640 0x7f0fb8198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fbdb18640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb81036d0 0x7f0fb8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fbdb18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8104070 0x7f0fb8199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fbdb18640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb810dfd0 con 0x7f0fb8104070 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fbdb18640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb810de50 con 0x7f0fb8102640 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fbdb18640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb810e150 con 0x7f0fb81036d0 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8104070 0x7f0fb8199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8104070 0x7f0fb8199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43444/0 (socket says 172.21.15.81:43444) 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 -- 172.21.15.81:0/1646242382 learned_addr learned my addr 172.21.15.81:0/1646242382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb77fe640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fb8102640 0x7f0fb8198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 -- 172.21.15.81:0/1646242382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb81036d0 msgr2=0x7f0fb8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0faeffd640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb81036d0 0x7f0fb8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb81036d0 0x7f0fb8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 -- 172.21.15.81:0/1646242382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fb8102640 msgr2=0x7f0fb8198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fb8102640 0x7f0fb8198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 -- 172.21.15.81:0/1646242382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb819a6f0 con 0x7f0fb8104070 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb77fe640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fb8102640 0x7f0fb8198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0faeffd640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb81036d0 0x7f0fb8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.403+0000 7f0fb7fff640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8104070 0x7f0fb8199ed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000eaa0 tx=0x7f0fb000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.404+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000cdb0 con 0x7f0fb8104070 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.404+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0fb0005020 con 0x7f0fb8104070 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.404+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb819a9e0 con 0x7f0fb8104070 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.404+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00116d0 con 0x7f0fb8104070 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.404+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb81a10e0 con 0x7f0fb8104070 2024-09-21T02:52:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.405+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb8102ab0 con 0x7f0fb8104070 2024-09-21T02:52:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.406+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f0fb0004a40 con 0x7f0fb8104070 2024-09-21T02:52:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.407+0000 7f0fb57fa640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0fa40b6500 0x7f0fa40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.407+0000 7f0fb77fe640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0fa40b6500 0x7f0fa40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.407+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0fb00e5c20 con 0x7f0fb8104070 2024-09-21T02:52:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.407+0000 7f0fb77fe640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0fa40b6500 0x7f0fa40b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8000c00 tx=0x7f0fa80042c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:05.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.410+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0fb0016030 con 0x7f0fb8104070 2024-09-21T02:52:05.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.593+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f0fb8109820 con 0x7f0fb8104070 2024-09-21T02:52:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.599+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7f0fb8109820 con 0x7f0fb8104070 2024-09-21T02:52:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.600+0000 7f0fb57fa640 1 -- 172.21.15.81:0/1646242382 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0fb00a9260 con 0x7f0fb8104070 2024-09-21T02:52:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0fa40b6500 msgr2=0x7f0fa40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0fa40b6500 0x7f0fa40b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8000c00 tx=0x7f0fa80042c0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8104070 msgr2=0x7f0fb8199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8104070 0x7f0fb8199ed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000eaa0 tx=0x7f0fb000ef60 comp rx=0 tx=0).stop 2024-09-21T02:52:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 shutdown_connections 2024-09-21T02:52:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0fa40b6500 0x7f0fa40b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0fb81036d0 0x7f0fb8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb8104070 0x7f0fb8199ed0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 --2- 172.21.15.81:0/1646242382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fb8102640 0x7f0fb8198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 >> 172.21.15.81:0/1646242382 conn(0x7f0fb80fdfb0 msgr2=0x7f0fb81069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 shutdown_connections 2024-09-21T02:52:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:05.601+0000 7f0fbdb18640 1 -- 172.21.15.81:0/1646242382 wait complete. 2024-09-21T02:52:06.526 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:06 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1911860790' entity='client.admin' 2024-09-21T02:52:06.526 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:06 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1646242382' entity='client.admin' 2024-09-21T02:52:06.526 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:06 smithi081 ceph-mon[30991]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:06.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:06 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1911860790' entity='client.admin' 2024-09-21T02:52:06.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:06 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1646242382' entity='client.admin' 2024-09-21T02:52:06.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:06 smithi164 ceph-mon[34236]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:06.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:06 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1911860790' entity='client.admin' 2024-09-21T02:52:06.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:06 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1646242382' entity='client.admin' 2024-09-21T02:52:06.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:06 smithi181 ceph-mon[34096]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:07.832 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:07 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1418685766' entity='client.admin' 2024-09-21T02:52:07.832 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:07 smithi081 ceph-mon[30991]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:07 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1418685766' entity='client.admin' 2024-09-21T02:52:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:07 smithi181 ceph-mon[34096]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:08.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:07 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1418685766' entity='client.admin' 2024-09-21T02:52:08.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:07 smithi164 ceph-mon[34236]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 -- 172.21.15.81:0/1543034002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0102650 msgr2=0x7efca0102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1543034002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0102650 0x7efca0102ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009900 tx=0x7efc9c02a480 comp rx=0 tx=0).stop 2024-09-21T02:52:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 -- 172.21.15.81:0/1543034002 shutdown_connections 2024-09-21T02:52:08.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1543034002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca01036e0 0x7efca0103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1543034002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca0104080 0x7efca010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1543034002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0102650 0x7efca0102ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 -- 172.21.15.81:0/1543034002 >> 172.21.15.81:0/1543034002 conn(0x7efca00fdfe0 msgr2=0x7efca0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 -- 172.21.15.81:0/1543034002 shutdown_connections 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.524+0000 7efca7fe0640 1 -- 172.21.15.81:0/1543034002 wait complete. 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 Processor -- start 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 -- start start 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca0102650 0x7efca0199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca01036e0 0x7efca019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0104080 0x7efca019b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efca010e120 con 0x7efca0104080 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efca010dfa0 con 0x7efca01036e0 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca7fe0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efca010e2a0 con 0x7efca0102650 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0104080 0x7efca019b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:08.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca657d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0104080 0x7efca019b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43466/0 (socket says 172.21.15.81:43466) 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca657d640 1 -- 172.21.15.81:0/1418685766 learned_addr learned my addr 172.21.15.81:0/1418685766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.525+0000 7efca5d7c640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca0102650 0x7efca0199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca557b640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca01036e0 0x7efca019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca657d640 1 -- 172.21.15.81:0/1418685766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca0102650 msgr2=0x7efca0199ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca657d640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca0102650 0x7efca0199ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca657d640 1 -- 172.21.15.81:0/1418685766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca01036e0 msgr2=0x7efca019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca657d640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca01036e0 0x7efca019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca657d640 1 -- 172.21.15.81:0/1418685766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca019b920 con 0x7efca0104080 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca657d640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0104080 0x7efca019b100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efc9800cad0 tx=0x7efc9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efc92ffd640 1 -- 172.21.15.81:0/1418685766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9800ae20 con 0x7efca0104080 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efc92ffd640 1 -- 172.21.15.81:0/1418685766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc98005020 con 0x7efca0104080 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca019bc10 con 0x7efca0104080 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efc92ffd640 1 -- 172.21.15.81:0/1418685766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9800f6b0 con 0x7efca0104080 2024-09-21T02:52:08.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.526+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca01a2310 con 0x7efca0104080 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.527+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca01a24e0 con 0x7efca0104080 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.529+0000 7efc92ffd640 1 -- 172.21.15.81:0/1418685766 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7efc980051d0 con 0x7efca0104080 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.530+0000 7efc92ffd640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efc8c0b6480 0x7efc8c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.530+0000 7efca5d7c640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efc8c0b6480 0x7efc8c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.530+0000 7efc92ffd640 1 -- 172.21.15.81:0/1418685766 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efc980e59e0 con 0x7efca0104080 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.531+0000 7efca5d7c640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efc8c0b6480 0x7efc8c0b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0057c0 tx=0x7efc9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.533+0000 7efc92ffd640 1 -- 172.21.15.81:0/1418685766 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc98014030 con 0x7efca0104080 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.718+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7efca01a26b0 con 0x7efca0104080 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.722+0000 7efc92ffd640 1 -- 172.21.15.81:0/1418685766 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v31)=0 v31) ==== 108+0+0 (secure 0 0 0) 0x7efc980adf40 con 0x7efca0104080 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efc8c0b6480 msgr2=0x7efc8c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efc8c0b6480 0x7efc8c0b8990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0057c0 tx=0x7efc9c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0104080 msgr2=0x7efca019b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0104080 0x7efca019b100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efc9800cad0 tx=0x7efc9800cf90 comp rx=0 tx=0).stop 2024-09-21T02:52:08.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 shutdown_connections 2024-09-21T02:52:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efc8c0b6480 0x7efc8c0b8990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca0104080 0x7efca019b100 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca01036e0 0x7efca019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 --2- 172.21.15.81:0/1418685766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efca0102650 0x7efca0199ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 >> 172.21.15.81:0/1418685766 conn(0x7efca00fdfe0 msgr2=0x7efca00ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 shutdown_connections 2024-09-21T02:52:08.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:06.725+0000 7efca7fe0640 1 -- 172.21.15.81:0/1418685766 wait complete. 2024-09-21T02:52:09.705 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T02:52:09.706 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi081') 2024-09-21T02:52:10.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:10 smithi181 ceph-mon[34096]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:10 smithi081 ceph-mon[30991]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:10.611 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi081') 2024-09-21T02:52:10.612 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi081') 2024-09-21T02:52:10.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:10.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:10.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:10.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:10 smithi164 ceph-mon[34236]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/2941968135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 msgr2=0x7f1bc8102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/2941968135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc8102ac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009900 tx=0x7f1bc402a480 comp rx=0 tx=0).stop 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/2941968135 shutdown_connections 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/2941968135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc8104080 0x7f1bc810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/2941968135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bc81036e0 0x7f1bc8103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/2941968135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc8102ac0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/2941968135 >> 172.21.15.81:0/2941968135 conn(0x7f1bc80fdfe0 msgr2=0x7f1bc8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:10.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/2941968135 shutdown_connections 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.880+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/2941968135 wait complete. 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 Processor -- start 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 -- start start 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc810cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc81036e0 0x7f1bc810b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bc8104080 0x7f1bc810bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810f270 con 0x7f1bc8102650 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810f0f0 con 0x7f1bc8104080 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcf3bd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810f3f0 con 0x7f1bc81036e0 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc810cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc810cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43480/0 (socket says 172.21.15.81:43480) 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 -- 172.21.15.81:0/1211359 learned_addr learned my addr 172.21.15.81:0/1211359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd95a640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bc8104080 0x7f1bc810bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:10.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcc958640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc81036e0 0x7f1bc810b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 -- 172.21.15.81:0/1211359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc81036e0 msgr2=0x7f1bc810b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc81036e0 0x7f1bc810b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 -- 172.21.15.81:0/1211359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bc8104080 msgr2=0x7f1bc810bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bc8104080 0x7f1bc810bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 -- 172.21.15.81:0/1211359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc810c2a0 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd95a640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bc8104080 0x7f1bc810bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.881+0000 7f1bcd159640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc810cd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009230 tx=0x7f1bc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.882+0000 7f1bbe7fc640 1 -- 172.21.15.81:0/1211359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc403f030 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.882+0000 7f1bbe7fc640 1 -- 172.21.15.81:0/1211359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bc4003c90 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.882+0000 7f1bbe7fc640 1 -- 172.21.15.81:0/1211359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4035070 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.882+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc81a3f40 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.882+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc81a42e0 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.883+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc8102ac0 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.884+0000 7f1bbe7fc640 1 -- 172.21.15.81:0/1211359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1bc4042030 con 0x7f1bc8102650 2024-09-21T02:52:10.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.885+0000 7f1bbe7fc640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bb40b6500 0x7f1bb40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:10.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.885+0000 7f1bcc958640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bb40b6500 0x7f1bb40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:10.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.885+0000 7f1bbe7fc640 1 -- 172.21.15.81:0/1211359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1bc4106090 con 0x7f1bc8102650 2024-09-21T02:52:10.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.885+0000 7f1bcc958640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bb40b6500 0x7f1bb40b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8005fd0 tx=0x7f1bb8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:10.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:10.888+0000 7f1bbe7fc640 1 -- 172.21.15.81:0/1211359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bc40ce5f0 con 0x7f1bc8102650 2024-09-21T02:52:11.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.074+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f1bc8109830 con 0x7f1bc8102650 2024-09-21T02:52:11.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.079+0000 7f1bbe7fc640 1 -- 172.21.15.81:0/1211359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f1bc8109830 con 0x7f1bc8102650 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bb40b6500 msgr2=0x7f1bb40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bb40b6500 0x7f1bb40b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8005fd0 tx=0x7f1bb8005850 comp rx=0 tx=0).stop 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 msgr2=0x7f1bc810cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc810cd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009230 tx=0x7f1bc40042f0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 shutdown_connections 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bb40b6500 0x7f1bb40b8a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc81036e0 0x7f1bc810b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1bc8104080 0x7f1bc810bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 --2- 172.21.15.81:0/1211359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bc8102650 0x7f1bc810cd90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 >> 172.21.15.81:0/1211359 conn(0x7f1bc80fdfe0 msgr2=0x7f1bc8106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:11.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 shutdown_connections 2024-09-21T02:52:11.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.081+0000 7f1bcf3bd640 1 -- 172.21.15.81:0/1211359 wait complete. 2024-09-21T02:52:11.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:11.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:11.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:11.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:11 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1211359' entity='client.admin' 2024-09-21T02:52:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:11 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1211359' entity='client.admin' 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 -- 172.21.15.81:0/2352219594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea01040a0 msgr2=0x7fdea010aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/2352219594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea01040a0 0x7fdea010aa40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde98009ca0 tx=0x7fde9802a950 comp rx=0 tx=0).stop 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 -- 172.21.15.81:0/2352219594 shutdown_connections 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/2352219594 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdea0103700 0x7fdea0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/2352219594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea01040a0 0x7fdea010aa40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/2352219594 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdea0102670 0x7fdea0102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 -- 172.21.15.81:0/2352219594 >> 172.21.15.81:0/2352219594 conn(0x7fdea00fe000 msgr2=0x7fdea0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 -- 172.21.15.81:0/2352219594 shutdown_connections 2024-09-21T02:52:11.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.563+0000 7fdea5ee3640 1 -- 172.21.15.81:0/2352219594 wait complete. 2024-09-21T02:52:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 Processor -- start 2024-09-21T02:52:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 -- start start 2024-09-21T02:52:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea0102670 0x7fdea006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdea0103700 0x7fdea019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdea01040a0 0x7fdea01a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdea010e170 con 0x7fdea0102670 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea0102670 0x7fdea006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdea010dff0 con 0x7fdea0103700 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fdea5ee3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdea010e2f0 con 0x7fdea01040a0 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea0102670 0x7fdea006c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39544/0 (socket says 172.21.15.81:39544) 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 -- 172.21.15.81:0/1426376493 learned_addr learned my addr 172.21.15.81:0/1426376493 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9ffff640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdea01040a0 0x7fdea01a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9effd640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdea0103700 0x7fdea019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 -- 172.21.15.81:0/1426376493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdea01040a0 msgr2=0x7fdea01a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdea01040a0 0x7fdea01a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 -- 172.21.15.81:0/1426376493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdea0103700 msgr2=0x7fdea019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdea0103700 0x7fdea019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9f7fe640 1 -- 172.21.15.81:0/1426376493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea01a1940 con 0x7fdea0102670 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9ffff640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdea01040a0 0x7fdea01a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.564+0000 7fde9effd640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdea0103700 0x7fdea019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.565+0000 7fde9f7fe640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea0102670 0x7fdea006c3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde9000d950 tx=0x7fde9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.565+0000 7fde9cff9640 1 -- 172.21.15.81:0/1426376493 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90017030 con 0x7fdea0102670 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.565+0000 7fde9cff9640 1 -- 172.21.15.81:0/1426376493 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde90004020 con 0x7fdea0102670 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.565+0000 7fde9cff9640 1 -- 172.21.15.81:0/1426376493 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde900055d0 con 0x7fdea0102670 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.565+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea01a1c30 con 0x7fdea0102670 2024-09-21T02:52:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.565+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea01a21c0 con 0x7fdea0102670 2024-09-21T02:52:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.566+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea0109830 con 0x7fdea0102670 2024-09-21T02:52:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.567+0000 7fde9cff9640 1 -- 172.21.15.81:0/1426376493 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fde90009a30 con 0x7fdea0102670 2024-09-21T02:52:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.568+0000 7fde9cff9640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fde8c0b6500 0x7fde8c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.568+0000 7fde9effd640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fde8c0b6500 0x7fde8c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.568+0000 7fde9cff9640 1 -- 172.21.15.81:0/1426376493 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fde900e50d0 con 0x7fdea0102670 2024-09-21T02:52:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.569+0000 7fde9effd640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fde8c0b6500 0x7fde8c0b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde88005fd0 tx=0x7fde880094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:11.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.572+0000 7fde9cff9640 1 -- 172.21.15.81:0/1426376493 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde900ad630 con 0x7fdea0102670 2024-09-21T02:52:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:11.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:11.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:11 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1211359' entity='client.admin' 2024-09-21T02:52:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.755+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fdea002e640 con 0x7fdea0102670 2024-09-21T02:52:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.759+0000 7fde9cff9640 1 -- 172.21.15.81:0/1426376493 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7fde900b1a10 con 0x7fdea0102670 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fde8c0b6500 msgr2=0x7fde8c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fde8c0b6500 0x7fde8c0b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde88005fd0 tx=0x7fde880094d0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea0102670 msgr2=0x7fdea006c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea0102670 0x7fdea006c3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde9000d950 tx=0x7fde9000de10 comp rx=0 tx=0).stop 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 shutdown_connections 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fde8c0b6500 0x7fde8c0b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdea01040a0 0x7fdea01a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdea0103700 0x7fdea019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 --2- 172.21.15.81:0/1426376493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdea0102670 0x7fdea006c3e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 >> 172.21.15.81:0/1426376493 conn(0x7fdea00fe000 msgr2=0x7fdea0106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.761+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 shutdown_connections 2024-09-21T02:52:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:11.762+0000 7fdea5ee3640 1 -- 172.21.15.81:0/1426376493 wait complete. 2024-09-21T02:52:11.967 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi081') 2024-09-21T02:52:11.968 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi081') 2024-09-21T02:52:11.968 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi081') 2024-09-21T02:52:11.968 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi081') 2024-09-21T02:52:11.968 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi081') 2024-09-21T02:52:11.968 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi081') 2024-09-21T02:52:11.968 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-21T02:52:12.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:12 smithi081 ceph-mon[30991]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:12.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:12 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1426376493' entity='client.admin' 2024-09-21T02:52:12.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:12 smithi181 ceph-mon[34096]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:12.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:12 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1426376493' entity='client.admin' 2024-09-21T02:52:12.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:12 smithi164 ceph-mon[34236]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:12.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:12 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1426376493' entity='client.admin' 2024-09-21T02:52:13.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.076 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0bfe3ac0-77c4-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-21T02:52:13.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T02:52:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:52:13.709 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:13 smithi081 ceph-mon[30991]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:13.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 -- 172.21.15.81:0/1463582897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c41051b0 msgr2=0x7f70c410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 --2- 172.21.15.81:0/1463582897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c41051b0 0x7f70c410bb50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009ca0 tx=0x7f70bc02a950 comp rx=0 tx=0).stop 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 -- 172.21.15.81:0/1463582897 shutdown_connections 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 --2- 172.21.15.81:0/1463582897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c41051b0 0x7f70c410bb50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 --2- 172.21.15.81:0/1463582897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c4104810 0x7f70c4104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 --2- 172.21.15.81:0/1463582897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70c4103780 0x7f70c4103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 -- 172.21.15.81:0/1463582897 >> 172.21.15.81:0/1463582897 conn(0x7f70c40ff0f0 msgr2=0x7f70c41015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 -- 172.21.15.81:0/1463582897 shutdown_connections 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 -- 172.21.15.81:0/1463582897 wait complete. 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.796+0000 7f70c9bba640 1 Processor -- start 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c9bba640 1 -- start start 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c9bba640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c4103780 0x7f70c4076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c9bba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c4104810 0x7f70c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:13.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c9bba640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70c41051b0 0x7f70c4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c9bba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70c410f280 con 0x7f70c4104810 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c9bba640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f70c410f100 con 0x7f70c4103780 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c9bba640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f70c410f400 con 0x7f70c41051b0 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c4104810 0x7f70c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c4104810 0x7f70c4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39566/0 (socket says 172.21.15.81:39566) 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 -- 172.21.15.81:0/4012252412 learned_addr learned my addr 172.21.15.81:0/4012252412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c37fe640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c4103780 0x7f70c4076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 -- 172.21.15.81:0/4012252412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70c41051b0 msgr2=0x7f70c4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c3fff640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70c41051b0 0x7f70c4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70c41051b0 0x7f70c4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 -- 172.21.15.81:0/4012252412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c4103780 msgr2=0x7f70c4076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c4103780 0x7f70c4076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70baffd640 1 -- 172.21.15.81:0/4012252412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c4076350 con 0x7f70c4104810 2024-09-21T02:52:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.797+0000 7f70c37fe640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c4103780 0x7f70c4076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.798+0000 7f70baffd640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c4104810 0x7f70c4075710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00d950 tx=0x7f70ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.798+0000 7f70c17fa640 1 -- 172.21.15.81:0/4012252412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac017070 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.798+0000 7f70c17fa640 1 -- 172.21.15.81:0/4012252412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70ac009c30 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.798+0000 7f70c17fa640 1 -- 172.21.15.81:0/4012252412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac00f620 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.798+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c41a3f50 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.798+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c41a4340 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.799+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c4103bf0 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.801+0000 7f70c17fa640 1 -- 172.21.15.81:0/4012252412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f70ac010460 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.802+0000 7f70c17fa640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70b00b6500 0x7f70b00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.802+0000 7f70c37fe640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70b00b6500 0x7f70b00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.802+0000 7f70c17fa640 1 -- 172.21.15.81:0/4012252412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f70ac0e5250 con 0x7f70c4104810 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.802+0000 7f70c37fe640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70b00b6500 0x7f70b00b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70b40058c0 tx=0x7f70b4005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.805+0000 7f70c17fa640 1 -- 172.21.15.81:0/4012252412 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70ac0ad830 con 0x7f70c4104810 2024-09-21T02:52:13.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.985+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f70c410a960 con 0x7f70c4104810 2024-09-21T02:52:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.986+0000 7f70c17fa640 1 -- 172.21.15.81:0/4012252412 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21112 (secure 0 0 0) 0x7f70ac009de0 con 0x7f70c4104810 2024-09-21T02:52:13.988 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global dev auth_debug true 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global basic log_to_file true 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global basic log_to_journald false 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global basic log_to_stderr false 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_allow_pool_delete true 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T02:52:13.989 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global dev ms_die_on_bug true 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global dev ms_die_on_old_message true 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T02:52:13.990 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced debug_mon 20/20 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced debug_ms 1/1 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced debug_paxos 20/20 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T02:52:13.991 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced client_mount_timeout 30 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_client 20/20 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_mgr 20/20 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_ms 1/1 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T02:52:13.992 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev bdev_debug_aio true 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced debug_bluefs 20/20 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced debug_bluestore 20/20 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced debug_ms 1/1 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced debug_osd 20/20 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T02:52:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev osd_debug_op_order true 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev osd_debug_shutdown true 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T02:52:13.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T02:52:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_bal_split_size 100 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-21T02:52:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-21T02:52:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-21T02:52:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T02:52:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T02:52:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T02:52:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T02:52:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T02:52:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70b00b6500 msgr2=0x7f70b00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70b00b6500 0x7f70b00b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70b40058c0 tx=0x7f70b4005d30 comp rx=0 tx=0).stop 2024-09-21T02:52:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c4104810 msgr2=0x7f70c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c4104810 0x7f70c4075710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00d950 tx=0x7f70ac00de10 comp rx=0 tx=0).stop 2024-09-21T02:52:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 shutdown_connections 2024-09-21T02:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70b00b6500 0x7f70b00b8a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70c41051b0 0x7f70c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c4104810 0x7f70c4075710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 --2- 172.21.15.81:0/4012252412 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c4103780 0x7f70c4076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 >> 172.21.15.81:0/4012252412 conn(0x7f70c40ff0f0 msgr2=0x7f70c4107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 shutdown_connections 2024-09-21T02:52:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:13.989+0000 7f70c9bba640 1 -- 172.21.15.81:0/4012252412 wait complete. 2024-09-21T02:52:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:13 smithi181 ceph-mon[34096]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:14.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:13 smithi164 ceph-mon[34236]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:14.713 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:14 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4012252412' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:52:14.741 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T02:52:14.741 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:52:14.741 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:52:14.757 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:52:14.758 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-21T02:52:14.812 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 02:51:02.029882830 +0000 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 02:46:51.909838930 +0000 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 02:46:51.909838930 +0000 2024-09-21T02:52:14.813 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 02:46:51.909838930 +0000 2024-09-21T02:52:14.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:52:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T02:52:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T02:52:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000196338 s, 2.6 MB/s 2024-09-21T02:52:14.878 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:52:14.935 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-21T02:52:14.990 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:52:14.990 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:14.990 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T02:52:14.990 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:14.990 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:14.991 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 02:51:02.059882293 +0000 2024-09-21T02:52:14.991 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 02:46:52.232833240 +0000 2024-09-21T02:52:14.991 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 02:46:52.232833240 +0000 2024-09-21T02:52:14.991 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 02:46:52.232833240 +0000 2024-09-21T02:52:14.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:52:14.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:14 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4012252412' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:52:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T02:52:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T02:52:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000163906 s, 3.1 MB/s 2024-09-21T02:52:15.054 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:52:15.110 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-21T02:52:15.165 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:52:15.165 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:15.165 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T02:52:15.165 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:15.165 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:15.165 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 02:51:02.091881720 +0000 2024-09-21T02:52:15.166 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 02:46:52.551827621 +0000 2024-09-21T02:52:15.166 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 02:46:52.551827621 +0000 2024-09-21T02:52:15.166 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 02:46:52.551827621 +0000 2024-09-21T02:52:15.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:52:15.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:14 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4012252412' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:52:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T02:52:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T02:52:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000203121 s, 2.5 MB/s 2024-09-21T02:52:15.229 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:52:15.285 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-21T02:52:15.340 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 02:51:02.120881201 +0000 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 02:46:52.873821949 +0000 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 02:46:52.873821949 +0000 2024-09-21T02:52:15.341 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 02:46:52.873821949 +0000 2024-09-21T02:52:15.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:52:15.404 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T02:52:15.405 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T02:52:15.405 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00019434 s, 2.6 MB/s 2024-09-21T02:52:15.406 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:52:15.462 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-21T02:52:15.462 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:52:15.482 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:52:15.482 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-21 02:51:46.602615408 +0000 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-21 02:46:51.876994240 +0000 2024-09-21T02:52:15.541 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-21 02:46:51.876994240 +0000 2024-09-21T02:52:15.542 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-21 02:46:51.876994240 +0000 2024-09-21T02:52:15.542 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:52:15.611 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-21T02:52:15.611 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-21T02:52:15.611 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000314017 s, 1.6 MB/s 2024-09-21T02:52:15.613 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:52:15.672 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-21 02:51:46.602615408 +0000 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-21 02:46:52.213989220 +0000 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-21 02:46:52.213989220 +0000 2024-09-21T02:52:15.730 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-21 02:46:52.213989220 +0000 2024-09-21T02:52:15.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:52:15.795 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-21T02:52:15.795 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-21T02:52:15.796 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000267764 s, 1.9 MB/s 2024-09-21T02:52:15.797 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:52:15.854 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-09-21T02:52:15.910 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:52:15.910 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:15.910 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T02:52:15.910 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:15.911 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:15.911 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-21 02:51:46.603615393 +0000 2024-09-21T02:52:15.911 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-21 02:46:52.533984453 +0000 2024-09-21T02:52:15.911 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-21 02:46:52.533984453 +0000 2024-09-21T02:52:15.911 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-21 02:46:52.533984453 +0000 2024-09-21T02:52:15.911 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:52:15.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:15 smithi164 ceph-mon[34236]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:15.954 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-21T02:52:15.954 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-21T02:52:15.954 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000197933 s, 2.6 MB/s 2024-09-21T02:52:15.956 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:52:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:15 smithi181 ceph-mon[34096]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:16.013 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-09-21T02:52:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:15 smithi081 ceph-mon[30991]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-21 02:51:46.603615393 +0000 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-21 02:46:52.878979314 +0000 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-21 02:46:52.878979314 +0000 2024-09-21T02:52:16.069 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-21 02:46:52.878979314 +0000 2024-09-21T02:52:16.070 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:52:16.132 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-21T02:52:16.133 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-21T02:52:16.133 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000192938 s, 2.7 MB/s 2024-09-21T02:52:16.134 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:52:16.190 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-21T02:52:16.190 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:52:16.210 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:52:16.210 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 02:51:44.284913559 +0000 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 02:46:51.874855010 +0000 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 02:46:51.874855010 +0000 2024-09-21T02:52:16.269 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 02:46:51.874855010 +0000 2024-09-21T02:52:16.269 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:52:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T02:52:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T02:52:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000228609 s, 2.2 MB/s 2024-09-21T02:52:16.340 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:52:16.398 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-21T02:52:16.455 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:52:16.455 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:16.455 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T02:52:16.456 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:16.456 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:16.456 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 02:51:44.285913539 +0000 2024-09-21T02:52:16.456 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 02:46:52.199848333 +0000 2024-09-21T02:52:16.456 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 02:46:52.199848333 +0000 2024-09-21T02:52:16.456 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 02:46:52.199848333 +0000 2024-09-21T02:52:16.456 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:52:16.522 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T02:52:16.522 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T02:52:16.522 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000234313 s, 2.2 MB/s 2024-09-21T02:52:16.523 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:52:16.581 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 02:51:44.285913539 +0000 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 02:46:52.511841925 +0000 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 02:46:52.511841925 +0000 2024-09-21T02:52:16.638 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 02:46:52.511841925 +0000 2024-09-21T02:52:16.638 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:52:16.703 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T02:52:16.703 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T02:52:16.703 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000172989 s, 3.0 MB/s 2024-09-21T02:52:16.704 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:52:16.761 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-21T02:52:16.818 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:52:16.818 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:52:16.818 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T02:52:16.818 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:52:16.818 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:52:16.819 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-21 02:51:44.286913519 +0000 2024-09-21T02:52:16.819 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-21 02:46:52.836835249 +0000 2024-09-21T02:52:16.819 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-21 02:46:52.836835249 +0000 2024-09-21T02:52:16.819 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-21 02:46:52.836835249 +0000 2024-09-21T02:52:16.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:52:16.882 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-21T02:52:16.883 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-21T02:52:16.883 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000216234 s, 2.4 MB/s 2024-09-21T02:52:16.884 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:52:16.940 INFO:tasks.cephadm:Deploying osd.0 on smithi081 with /dev/vg_nvme/lv_4... 2024-09-21T02:52:16.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:52:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:52:17.977 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:17 smithi081 ceph-mon[30991]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:17.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:17 smithi181 ceph-mon[34096]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:18.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:17 smithi164 ceph-mon[34236]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:19.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:52:19.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-09-21T02:52:19.884 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:52:19.983 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:19 smithi164 ceph-mon[34236]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:19 smithi181 ceph-mon[34096]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:20.005 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:19 smithi081 ceph-mon[30991]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 -- 172.21.15.81:0/322305208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 msgr2=0x7fc638102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 --2- 172.21.15.81:0/322305208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc638102ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc628009900 tx=0x7fc62802a480 comp rx=0 tx=0).stop 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 -- 172.21.15.81:0/322305208 shutdown_connections 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 --2- 172.21.15.81:0/322305208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc638104070 0x7fc63810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 --2- 172.21.15.81:0/322305208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6381036d0 0x7fc638103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 --2- 172.21.15.81:0/322305208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc638102ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 -- 172.21.15.81:0/322305208 >> 172.21.15.81:0/322305208 conn(0x7fc6380fdfb0 msgr2=0x7fc638100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 -- 172.21.15.81:0/322305208 shutdown_connections 2024-09-21T02:52:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.372+0000 7fc63d554640 1 -- 172.21.15.81:0/322305208 wait complete. 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 Processor -- start 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 -- start start 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc63806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6381036d0 0x7fc63819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc638104070 0x7fc6381a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc63810e130 con 0x7fc638102640 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc63810dfb0 con 0x7fc638104070 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.373+0000 7fc63d554640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc63810e2b0 con 0x7fc6381036d0 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc63806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc63806b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39576/0 (socket says 172.21.15.81:39576) 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 -- 172.21.15.81:0/2104370734 learned_addr learned my addr 172.21.15.81:0/2104370734 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:52:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc6377fe640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc638104070 0x7fc6381a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc62ffff640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6381036d0 0x7fc63819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 -- 172.21.15.81:0/2104370734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6381036d0 msgr2=0x7fc63819ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6381036d0 0x7fc63819ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 -- 172.21.15.81:0/2104370734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc638104070 msgr2=0x7fc6381a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc638104070 0x7fc6381a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 -- 172.21.15.81:0/2104370734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6381a19c0 con 0x7fc638102640 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc636ffd640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc63806b6a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc628009230 tx=0x7fc6280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc634ff9640 1 -- 172.21.15.81:0/2104370734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62803f030 con 0x7fc638102640 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc634ff9640 1 -- 172.21.15.81:0/2104370734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc628003c90 con 0x7fc638102640 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc634ff9640 1 -- 172.21.15.81:0/2104370734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628035070 con 0x7fc638102640 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6381a1c50 con 0x7fc638102640 2024-09-21T02:52:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.374+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6381a20e0 con 0x7fc638102640 2024-09-21T02:52:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.376+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc638109820 con 0x7fc638102640 2024-09-21T02:52:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.377+0000 7fc634ff9640 1 -- 172.21.15.81:0/2104370734 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fc628042030 con 0x7fc638102640 2024-09-21T02:52:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.378+0000 7fc634ff9640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc6240b6500 0x7fc6240b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.378+0000 7fc62ffff640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc6240b6500 0x7fc6240b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.378+0000 7fc634ff9640 1 -- 172.21.15.81:0/2104370734 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc628105bb0 con 0x7fc638102640 2024-09-21T02:52:20.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.378+0000 7fc62ffff640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc6240b6500 0x7fc6240b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc620005fd0 tx=0x7fc620005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:20.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.382+0000 7fc634ff9640 1 -- 172.21.15.81:0/2104370734 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6280ce110 con 0x7fc638102640 2024-09-21T02:52:20.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:20.571+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc638063800 con 0x7fc6240b6500 2024-09-21T02:52:20.939 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:20 smithi081 ceph-mon[30991]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:20.939 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:52:20.940 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:52:20.940 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:20 smithi181 ceph-mon[34096]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:52:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:52:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:21.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:20 smithi164 ceph-mon[34236]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:21.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:52:21.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:52:21.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:21.963 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:21 smithi081 ceph-mon[30991]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:21.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:21 smithi181 ceph-mon[34096]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:22.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:21 smithi164 ceph-mon[34236]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:23.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:22 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3545025940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0"} : dispatch 2024-09-21T02:52:23.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:22 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3545025940' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0"}]': finished 2024-09-21T02:52:23.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:22 smithi164 ceph-mon[34236]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:52:23.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:22 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:23.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3545025940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0"} : dispatch 2024-09-21T02:52:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3545025940' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0"}]': finished 2024-09-21T02:52:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:22 smithi181 ceph-mon[34096]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:52:23.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:22 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:23.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:22 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3545025940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0"} : dispatch 2024-09-21T02:52:23.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:22 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3545025940' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0"}]': finished 2024-09-21T02:52:23.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:22 smithi081 ceph-mon[30991]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:52:23.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:22 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:24.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:23 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/968629601' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:52:24.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:23 smithi164 ceph-mon[34236]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:24.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:23 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/968629601' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:52:24.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:23 smithi181 ceph-mon[34096]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:24.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:23 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/968629601' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:52:24.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:23 smithi081 ceph-mon[30991]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:25.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:25 smithi181 ceph-mon[34096]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:25 smithi081 ceph-mon[30991]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:26.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:25 smithi164 ceph-mon[34236]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:27.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:27 smithi181 ceph-mon[34096]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:28.053 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:27 smithi081 ceph-mon[30991]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:28.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:27 smithi164 ceph-mon[34236]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:29.975 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:29 smithi081 ceph-mon[30991]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:29.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:29 smithi181 ceph-mon[34096]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:30.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:29 smithi164 ceph-mon[34236]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:31.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:31 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:52:31.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:31 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:31.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:31 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:52:31.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:31 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:31.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:31 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:52:31.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:31 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:32.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:32 smithi164 ceph-mon[34236]: Deploying daemon osd.0 on smithi081 2024-09-21T02:52:32.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:32 smithi164 ceph-mon[34236]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:32 smithi181 ceph-mon[34096]: Deploying daemon osd.0 on smithi081 2024-09-21T02:52:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:32 smithi181 ceph-mon[34096]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:32.529 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:32 smithi081 ceph-mon[30991]: Deploying daemon osd.0 on smithi081 2024-09-21T02:52:32.529 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:32 smithi081 ceph-mon[30991]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:33.785 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:33 smithi081 ceph-mon[30991]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:33.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:33 smithi181 ceph-mon[34096]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:34.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:33 smithi164 ceph-mon[34236]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:35 smithi181 ceph-mon[34096]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:36.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:35 smithi081 ceph-mon[30991]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:36.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:35 smithi164 ceph-mon[34236]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:37.979 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:37.979 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:37.979 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:37.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:37.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:37.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:38.895 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:38 smithi081 ceph-mon[30991]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:38.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:38 smithi164 ceph-mon[34236]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:38.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:38 smithi181 ceph-mon[34096]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:40.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:40.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:40.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:40 smithi164 ceph-mon[34236]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:40.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:40.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:40.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:40 smithi081 ceph-mon[30991]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:40.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:40 smithi181 ceph-mon[34096]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:41.758 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:41 smithi081 ceph-mon[30991]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:41.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.796+0000 7fc634ff9640 1 -- 172.21.15.81:0/2104370734 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc638063800 con 0x7fc6240b6500 2024-09-21T02:52:41.798 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 0 on host 'smithi081' 2024-09-21T02:52:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc6240b6500 msgr2=0x7fc6240b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc6240b6500 0x7fc6240b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc620005fd0 tx=0x7fc620005850 comp rx=0 tx=0).stop 2024-09-21T02:52:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 msgr2=0x7fc63806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc63806b6a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc628009230 tx=0x7fc6280042f0 comp rx=0 tx=0).stop 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 shutdown_connections 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc6240b6500 0x7fc6240b8a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc6381036d0 0x7fc63819ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc638104070 0x7fc6381a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.798+0000 7fc63d554640 1 --2- 172.21.15.81:0/2104370734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc638102640 0x7fc63806b6a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.799+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 >> 172.21.15.81:0/2104370734 conn(0x7fc6380fdfb0 msgr2=0x7fc6381069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.799+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 shutdown_connections 2024-09-21T02:52:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:52:41.799+0000 7fc63d554640 1 -- 172.21.15.81:0/2104370734 wait complete. 2024-09-21T02:52:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:41 smithi181 ceph-mon[34096]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:42.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:41 smithi164 ceph-mon[34236]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:42.454 DEBUG:teuthology.orchestra.run.smithi081:osd.0> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T02:52:42.456 INFO:tasks.cephadm:Deploying osd.1 on smithi164 with /dev/vg_nvme/lv_4... 2024-09-21T02:52:42.456 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:52:42.713 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:52:42.833 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:42.833 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:42.833 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:42.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:42.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:42.965 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:42.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:52:42.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:42.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:43.882 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:43 smithi081 ceph-mon[30991]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:52:43.882 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:43 smithi081 ceph-mon[30991]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:43.882 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:52:43 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0[46420]: 2024-09-21T02:52:43.625+0000 7fd33f525640 -1 osd.0 0 log_to_monitors true 2024-09-21T02:52:43.973 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:43 smithi164 ceph-mon[34236]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:52:43.973 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:43 smithi164 ceph-mon[34236]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:43.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:43 smithi181 ceph-mon[34096]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:52:43.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:43 smithi181 ceph-mon[34096]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:44.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:44 smithi081 ceph-mon[30991]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:52:44.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:44 smithi081 ceph-mon[30991]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:52:44.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:44 smithi081 ceph-mon[30991]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:52:44.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:44.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:44 smithi164 ceph-mon[34236]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:52:44.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:44 smithi164 ceph-mon[34236]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:52:44.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:44 smithi164 ceph-mon[34236]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:52:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:44 smithi181 ceph-mon[34096]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:52:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:44 smithi181 ceph-mon[34096]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:52:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:44 smithi181 ceph-mon[34096]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:52:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:45.191 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:52:45.216 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi164:vg_nvme/lv_4 2024-09-21T02:52:45.305 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0[46420]: 2024-09-21T02:52:45.145+0000 7fd33b4a7640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T02:52:45.305 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0[46420]: 2024-09-21T02:52:45.148+0000 7fd33329d640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:52:45.471 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi081 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:45.825 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:45.826 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:45.826 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:45.826 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:45 smithi164 ceph-mon[34236]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:45.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 -- 172.21.15.164:0/3677750162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 msgr2=0x7f085c103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:45.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3677750162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c103ae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0848009900 tx=0x7f084802a480 comp rx=0 tx=0).stop 2024-09-21T02:52:45.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 -- 172.21.15.164:0/3677750162 shutdown_connections 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3677750162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f085c104070 0x7f085c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3677750162 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c103ae0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3677750162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f085c102640 0x7f085c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 -- 172.21.15.164:0/3677750162 >> 172.21.15.164:0/3677750162 conn(0x7f085c0fdfb0 msgr2=0x7f085c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 -- 172.21.15.164:0/3677750162 shutdown_connections 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.918+0000 7f0862cf1640 1 -- 172.21.15.164:0/3677750162 wait complete. 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 Processor -- start 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 -- start start 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f085c102640 0x7f085c06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:45.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c19ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f085c104070 0x7f085c1a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f085c10e140 con 0x7f085c102640 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f085c10dfc0 con 0x7f085c1036d0 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f0862cf1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f085c10e2c0 con 0x7f085c104070 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f085bfff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c19ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f085bfff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c19ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59448/0 (socket says 172.21.15.164:59448) 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f085bfff640 1 -- 172.21.15.164:0/3863724884 learned_addr learned my addr 172.21.15.164:0/3863724884 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.919+0000 7f086128e640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f085c104070 0x7f085c1a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f0860a8d640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f085c102640 0x7f085c06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:45.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f085bfff640 1 -- 172.21.15.164:0/3863724884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f085c104070 msgr2=0x7f085c1a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f085bfff640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f085c104070 0x7f085c1a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f085bfff640 1 -- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f085c102640 msgr2=0x7f085c06b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f085bfff640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f085c102640 0x7f085c06b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f085bfff640 1 -- 172.21.15.164:0/3863724884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c198a40 con 0x7f085c1036d0 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f085bfff640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c19ec70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0848009230 tx=0x7f0848032f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f0859ffb640 1 -- 172.21.15.164:0/3863724884 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848035070 con 0x7f085c1036d0 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f0859ffb640 1 -- 172.21.15.164:0/3863724884 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08480035f0 con 0x7f085c1036d0 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085c198cd0 con 0x7f085c1036d0 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f0859ffb640 1 -- 172.21.15.164:0/3863724884 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848049610 con 0x7f085c1036d0 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.920+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085c199200 con 0x7f085c1036d0 2024-09-21T02:52:45.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.922+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085c02e640 con 0x7f085c1036d0 2024-09-21T02:52:45.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.923+0000 7f0859ffb640 1 -- 172.21.15.164:0/3863724884 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f0848041b60 con 0x7f085c1036d0 2024-09-21T02:52:45.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.924+0000 7f0859ffb640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f084c0b6500 0x7f084c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:52:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.924+0000 7f0859ffb640 1 -- 172.21.15.164:0/3863724884 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f084810e830 con 0x7f085c1036d0 2024-09-21T02:52:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.924+0000 7f0860a8d640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f084c0b6500 0x7f084c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:52:45.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.925+0000 7f0860a8d640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f084c0b6500 0x7f084c0b8a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0850005fd0 tx=0x7f0850005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:52:45.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:45.928+0000 7f0859ffb640 1 -- 172.21.15.164:0/3863724884 <== mon.2 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08480d6c50 con 0x7f085c1036d0 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi081 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:52:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-21T02:52:46.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:46.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:46.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:46.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:46.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:45 smithi181 ceph-mon[34096]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752]' entity='osd.0' 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi081 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:46.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:52:46.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:52:46.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:45 smithi081 ceph-mon[30991]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:52:46.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:52:46.122+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f085c109380 con 0x7f084c0b6500 2024-09-21T02:52:46.810 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] boot 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:52:46.811 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] boot 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:52:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: osd.0 [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] boot 2024-09-21T02:52:47.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:52:47.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:52:48.644 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:48 smithi164 ceph-mon[34236]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:52:48.644 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:48 smithi164 ceph-mon[34236]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:48.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:48 smithi181 ceph-mon[34096]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:52:48.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:48 smithi181 ceph-mon[34096]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:48.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:48 smithi081 ceph-mon[30991]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:52:48.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:48 smithi081 ceph-mon[30991]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/33653094' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"} : dispatch 2024-09-21T02:52:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:49 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"} : dispatch 2024-09-21T02:52:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:49 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"}]': finished 2024-09-21T02:52:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:49 smithi164 ceph-mon[34236]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:52:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:52:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/1767129779' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:52:49.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/33653094' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"} : dispatch 2024-09-21T02:52:49.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:49 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"} : dispatch 2024-09-21T02:52:49.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:49 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"}]': finished 2024-09-21T02:52:49.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:49 smithi181 ceph-mon[34096]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:52:49.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:52:49.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/1767129779' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:52:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/33653094' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"} : dispatch 2024-09-21T02:52:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:49 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"} : dispatch 2024-09-21T02:52:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:49 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eb4ea10-4d33-4614-b945-babb11aac5d4"}]': finished 2024-09-21T02:52:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:49 smithi081 ceph-mon[30991]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:52:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:52:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/1767129779' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:52:50.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:50 smithi164 ceph-mon[34236]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:50.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:50 smithi181 ceph-mon[34096]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:50.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:50 smithi081 ceph-mon[30991]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:51.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:51 smithi181 ceph-mon[34096]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:52.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:51 smithi081 ceph-mon[30991]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:52.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:51 smithi164 ceph-mon[34236]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:53.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:53 smithi164 ceph-mon[34236]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:53.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:53 smithi181 ceph-mon[34096]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:54.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:53 smithi081 ceph-mon[30991]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:55.776 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:55 smithi164 ceph-mon[34236]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:55.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:55 smithi181 ceph-mon[34096]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:56.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:55 smithi081 ceph-mon[30991]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:56.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:56 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:52:56.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:56 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:56.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:56 smithi181 ceph-mon[34096]: Deploying daemon osd.1 on smithi164 2024-09-21T02:52:57.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:56 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:52:57.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:56 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:57.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:56 smithi081 ceph-mon[30991]: Deploying daemon osd.1 on smithi164 2024-09-21T02:52:57.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:56 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:52:57.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:56 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:52:57.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:56 smithi164 ceph-mon[34236]: Deploying daemon osd.1 on smithi164 2024-09-21T02:52:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:57 smithi164 ceph-mon[34236]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:57 smithi181 ceph-mon[34096]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:57 smithi081 ceph-mon[30991]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:52:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:52:59 smithi181 ceph-mon[34096]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:52:59 smithi081 ceph-mon[30991]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:52:59 smithi164 ceph-mon[34236]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:01.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:01 smithi181 ceph-mon[34096]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:02.020 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:01 smithi164 ceph-mon[34236]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:01 smithi081 ceph-mon[30991]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:02.903 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:02.903 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:02.903 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:03.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:03.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:03.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:03 smithi181 ceph-mon[34096]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:04.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:03 smithi081 ceph-mon[30991]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:04.179 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:03 smithi164 ceph-mon[34236]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:05.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:05.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:05.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:05.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:05.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:06.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.126+0000 7f0859ffb640 1 -- 172.21.15.164:0/3863724884 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f085c109380 con 0x7f084c0b6500 2024-09-21T02:53:06.128 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 1 on host 'smithi164' 2024-09-21T02:53:06.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f084c0b6500 msgr2=0x7f084c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:06.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f084c0b6500 0x7f084c0b8a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0850005fd0 tx=0x7f0850005850 comp rx=0 tx=0).stop 2024-09-21T02:53:06.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 msgr2=0x7f085c19ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c19ec70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0848009230 tx=0x7f0848032f30 comp rx=0 tx=0).stop 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 shutdown_connections 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f084c0b6500 0x7f084c0b8a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f085c104070 0x7f085c1a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f085c1036d0 0x7f085c19ec70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 --2- 172.21.15.164:0/3863724884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f085c102640 0x7f085c06b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 >> 172.21.15.164:0/3863724884 conn(0x7f085c0fdfb0 msgr2=0x7f085c1069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 shutdown_connections 2024-09-21T02:53:06.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:53:06.129+0000 7f0862cf1640 1 -- 172.21.15.164:0/3863724884 wait complete. 2024-09-21T02:53:06.427 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:06 smithi164 ceph-mon[34236]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:06.427 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:06 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:06.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:06 smithi081 ceph-mon[30991]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:06.457 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:06 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:06.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:06 smithi181 ceph-mon[34096]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:06.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:06 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:06.748 DEBUG:teuthology.orchestra.run.smithi164:osd.1> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T02:53:06.751 INFO:tasks.cephadm:Deploying osd.2 on smithi181 with /dev/vg_nvme/lv_4... 2024-09-21T02:53:06.751 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:53:07.003 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:53:07.395 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:07.396 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:07.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:07.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:07.476 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:07.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:08.276 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:08 smithi181 ceph-mon[34096]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:08.316 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:08 smithi164 ceph-mon[34236]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:08.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:08 smithi081 ceph-mon[30991]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:08.682 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1[38131]: 2024-09-21T02:53:08.313+0000 7f62768a1640 -1 osd.1 0 log_to_monitors true 2024-09-21T02:53:09.335 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:53:09.360 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-09-21T02:53:09.367 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:09 smithi164 ceph-mon[34236]: from='osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:53:09.367 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:09 smithi164 ceph-mon[34236]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:53:09.383 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:09 smithi181 ceph-mon[34096]: from='osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:53:09.383 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:09 smithi181 ceph-mon[34096]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:53:09.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:09 smithi081 ceph-mon[30991]: from='osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:53:09.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:09 smithi081 ceph-mon[30991]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:53:09.610 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 -- 172.21.15.181:0/2441950183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef81083b0 msgr2=0x7f2ef810a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 --2- 172.21.15.181:0/2441950183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef81083b0 0x7f2ef810a8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009ca0 tx=0x7f2ef002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 -- 172.21.15.181:0/2441950183 shutdown_connections 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 --2- 172.21.15.181:0/2441950183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef81083b0 0x7f2ef810a8c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 --2- 172.21.15.181:0/2441950183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef8105790 0x7f2ef8107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 --2- 172.21.15.181:0/2441950183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef8102d10 0x7f2ef8105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 -- 172.21.15.181:0/2441950183 >> 172.21.15.181:0/2441950183 conn(0x7f2ef80fd770 msgr2=0x7f2ef80ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 -- 172.21.15.181:0/2441950183 shutdown_connections 2024-09-21T02:53:10.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 -- 172.21.15.181:0/2441950183 wait complete. 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.045+0000 7f2efd41a640 1 Processor -- start 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2efd41a640 1 -- start start 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2efd41a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef8102d10 0x7f2ef8199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2efd41a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef8105790 0x7f2ef819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2efd41a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef81083b0 0x7f2ef819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2efd41a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef810e1a0 con 0x7f2ef81083b0 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2efd41a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef810e020 con 0x7f2ef8102d10 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2efd41a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef810e320 con 0x7f2ef8105790 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef8105790 0x7f2ef819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef8105790 0x7f2ef819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:41962/0 (socket says 172.21.15.181:41962) 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 -- 172.21.15.181:0/3313823649 learned_addr learned my addr 172.21.15.181:0/3313823649 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef6ffd640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef8102d10 0x7f2ef8199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef77fe640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef81083b0 0x7f2ef819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 -- 172.21.15.181:0/3313823649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef8102d10 msgr2=0x7f2ef8199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:10.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef8102d10 0x7f2ef8199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:10.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 -- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef81083b0 msgr2=0x7f2ef819b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:10.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef81083b0 0x7f2ef819b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:10.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 -- 172.21.15.181:0/3313823649 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef819b890 con 0x7f2ef8105790 2024-09-21T02:53:10.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef77fe640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef81083b0 0x7f2ef819b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:53:10.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.046+0000 7f2ef67fc640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef8105790 0x7f2ef819a4d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e9f0 tx=0x7f2eec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:53:10.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.047+0000 7f2edffff640 1 -- 172.21.15.181:0/3313823649 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00cd80 con 0x7f2ef8105790 2024-09-21T02:53:10.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.047+0000 7f2edffff640 1 -- 172.21.15.181:0/3313823649 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2eec0108c0 con 0x7f2ef8105790 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.047+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef819bb80 con 0x7f2ef8105790 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.047+0000 7f2edffff640 1 -- 172.21.15.181:0/3313823649 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0187c0 con 0x7f2ef8105790 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.047+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef81a2280 con 0x7f2ef8105790 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.048+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef8105210 con 0x7f2ef8105790 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.049+0000 7f2edffff640 1 -- 172.21.15.181:0/3313823649 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2eec010430 con 0x7f2ef8105790 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.050+0000 7f2edffff640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2ee00b6500 0x7f2ee00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.050+0000 7f2edffff640 1 -- 172.21.15.181:0/3313823649 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f2eec0e5d30 con 0x7f2ef8105790 2024-09-21T02:53:10.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.050+0000 7f2ef6ffd640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2ee00b6500 0x7f2ee00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:10.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.051+0000 7f2ef6ffd640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2ee00b6500 0x7f2ee00b8a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009b60 tx=0x7f2ee8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:53:10.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.054+0000 7f2edffff640 1 -- 172.21.15.181:0/3313823649 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2eec0ea070 con 0x7f2ef8105790 2024-09-21T02:53:10.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:10.248+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2ef8063800 con 0x7f2ee00b6500 2024-09-21T02:53:10.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi164 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi164 to 17088M 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi164 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi164 to 17088M 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:10.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi164 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi164 to 17088M 2024-09-21T02:53:10.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:10.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:10.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:10.931 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1[38131]: 2024-09-21T02:53:10.576+0000 7f6272823640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T02:53:10.931 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:10 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1[38131]: 2024-09-21T02:53:10.580+0000 7f626a619640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:11.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:11 smithi181 ceph-mon[34096]: from='osd.1 ' entity='osd.1' 2024-09-21T02:53:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:11 smithi164 ceph-mon[34236]: from='osd.1 ' entity='osd.1' 2024-09-21T02:53:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:53:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:53:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:11.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:11.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:53:11.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:53:11.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:11.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:11 smithi081 ceph-mon[30991]: from='osd.1 ' entity='osd.1' 2024-09-21T02:53:12.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:12 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:53:12.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:12 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:53:12.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:12 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:12.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:12 smithi164 ceph-mon[34236]: osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] boot 2024-09-21T02:53:12.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:12 smithi164 ceph-mon[34236]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:53:12.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:12 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:12.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:12 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:53:12.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:12 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:53:12.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:12 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:12.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:12 smithi181 ceph-mon[34096]: osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] boot 2024-09-21T02:53:12.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:12 smithi181 ceph-mon[34096]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:53:12.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:12 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:12 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:53:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:12 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:53:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:12 smithi081 ceph-mon[30991]: osd.1 [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] boot 2024-09-21T02:53:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:12 smithi081 ceph-mon[30991]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:53:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:53:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:13 smithi164 ceph-mon[34236]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:13 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/1080728983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"} : dispatch 2024-09-21T02:53:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:13 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"} : dispatch 2024-09-21T02:53:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:13 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"}]': finished 2024-09-21T02:53:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:13 smithi164 ceph-mon[34236]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T02:53:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:13 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/1984919411' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:53:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:13 smithi181 ceph-mon[34096]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:13 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/1080728983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"} : dispatch 2024-09-21T02:53:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:13 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"} : dispatch 2024-09-21T02:53:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:13 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"}]': finished 2024-09-21T02:53:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:13 smithi181 ceph-mon[34096]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T02:53:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:13 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/1984919411' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:53:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:13 smithi081 ceph-mon[30991]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:53:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:13 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/1080728983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"} : dispatch 2024-09-21T02:53:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:13 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"} : dispatch 2024-09-21T02:53:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:13 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de365a9b-3533-47fe-8660-2febee4ea04d"}]': finished 2024-09-21T02:53:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:13 smithi081 ceph-mon[30991]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T02:53:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:13 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/1984919411' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:53:15.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:15 smithi164 ceph-mon[34236]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:15 smithi181 ceph-mon[34096]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:15 smithi081 ceph-mon[30991]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:17.882 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:17 smithi181 ceph-mon[34096]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:17.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:17 smithi164 ceph-mon[34236]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:17 smithi081 ceph-mon[30991]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:19.812 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:19 smithi181 ceph-mon[34096]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:19 smithi164 ceph-mon[34236]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:20.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:19 smithi081 ceph-mon[30991]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:20.921 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:53:20.922 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:20.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:53:20.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:53:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:21.910 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:21 smithi181 ceph-mon[34096]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:21.910 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:21 smithi181 ceph-mon[34096]: Deploying daemon osd.2 on smithi181 2024-09-21T02:53:21.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:21 smithi164 ceph-mon[34236]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:21.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:21 smithi164 ceph-mon[34236]: Deploying daemon osd.2 on smithi181 2024-09-21T02:53:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:21 smithi081 ceph-mon[30991]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:21 smithi081 ceph-mon[30991]: Deploying daemon osd.2 on smithi181 2024-09-21T02:53:23.882 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:23 smithi181 ceph-mon[34096]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:23.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:23 smithi164 ceph-mon[34236]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:24.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:23 smithi081 ceph-mon[30991]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:25.910 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:25 smithi181 ceph-mon[34096]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:25.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:25 smithi164 ceph-mon[34236]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:25 smithi081 ceph-mon[30991]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:27.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:27 smithi181 ceph-mon[34096]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:27.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:27.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:27.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:27 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:27 smithi164 ceph-mon[34236]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:27 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:27 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:27 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:27 smithi081 ceph-mon[30991]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:27 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:29.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:29 smithi164 ceph-mon[34236]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:29.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:29.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:29.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:29.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:29.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:29.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:29 smithi181 ceph-mon[34096]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:29.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:29.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:30.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:30.001 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:29 smithi081 ceph-mon[30991]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.411+0000 7f2edffff640 1 -- 172.21.15.181:0/3313823649 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2ef8063800 con 0x7f2ee00b6500 2024-09-21T02:53:30.413 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 2 on host 'smithi181' 2024-09-21T02:53:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2ee00b6500 msgr2=0x7f2ee00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2ee00b6500 0x7f2ee00b8a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009b60 tx=0x7f2ee8005f90 comp rx=0 tx=0).stop 2024-09-21T02:53:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef8105790 msgr2=0x7f2ef819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef8105790 0x7f2ef819a4d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00e9f0 tx=0x7f2eec00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 shutdown_connections 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2ee00b6500 0x7f2ee00b8a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2ef8105790 0x7f2ef819a4d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef81083b0 0x7f2ef819b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 --2- 172.21.15.181:0/3313823649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef8102d10 0x7f2ef8199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 >> 172.21.15.181:0/3313823649 conn(0x7f2ef80fd770 msgr2=0x7f2ef80ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 shutdown_connections 2024-09-21T02:53:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:53:30.414+0000 7f2efd41a640 1 -- 172.21.15.181:0/3313823649 wait complete. 2024-09-21T02:53:30.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:30 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:30.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:30 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:30 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:30 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:30.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:30 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:30.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:30 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:31.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:30 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:31.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:30 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:31.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:30 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:31.060 DEBUG:teuthology.orchestra.run.smithi181:osd.2> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T02:53:31.103 INFO:tasks.cephadm:Deploying osd.3 on smithi081 with /dev/vg_nvme/lv_3... 2024-09-21T02:53:31.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:53:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:53:31.735 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:31 smithi081 ceph-mon[30991]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:31.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:31 smithi164 ceph-mon[34236]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:31.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:31 smithi181 ceph-mon[34096]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:32.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:32 smithi081 ceph-mon[30991]: from='osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:53:32.787 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:32 smithi081 ceph-mon[30991]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:53:32.913 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:32 smithi181 ceph-mon[34096]: from='osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:53:32.914 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:32 smithi181 ceph-mon[34096]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:53:32.914 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:32 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2[38450]: 2024-09-21T02:53:32.503+0000 7f167348e640 -1 osd.2 0 log_to_monitors true 2024-09-21T02:53:32.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:32 smithi164 ceph-mon[34236]: from='osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:53:32.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:32 smithi164 ceph-mon[34236]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:53:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-mon[34096]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-mon[34096]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:53:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-mon[34096]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:53:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-mon[34096]: from='osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:53:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-mon[34096]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:53:33.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2[38450]: 2024-09-21T02:53:33.635+0000 7f166f410640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T02:53:33.750 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:33 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2[38450]: 2024-09-21T02:53:33.639+0000 7f166b20e640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:53:33.914 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:33 smithi081 ceph-mon[30991]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:33.915 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:33 smithi081 ceph-mon[30991]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:53:33.915 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:33 smithi081 ceph-mon[30991]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:53:33.915 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:33.915 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:33 smithi081 ceph-mon[30991]: from='osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:53:33.915 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:33 smithi081 ceph-mon[30991]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:53:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:53:33.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:33 smithi164 ceph-mon[34236]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:33.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:33 smithi164 ceph-mon[34236]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:53:33.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:33 smithi164 ceph-mon[34236]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:53:33.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:33.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:33 smithi164 ceph-mon[34236]: from='osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:53:33.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:33 smithi164 ceph-mon[34236]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:53:33.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-09-21T02:53:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 -- 172.21.15.81:0/1410785889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650104070 msgr2=0x7f265010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1410785889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650104070 0x7f265010aa10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2648009900 tx=0x7f264802a480 comp rx=0 tx=0).stop 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 -- 172.21.15.81:0/1410785889 shutdown_connections 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1410785889 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26501036d0 0x7f2650103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1410785889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650104070 0x7f265010aa10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1410785889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2650102640 0x7f2650102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 -- 172.21.15.81:0/1410785889 >> 172.21.15.81:0/1410785889 conn(0x7f26500fdfb0 msgr2=0x7f2650100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 -- 172.21.15.81:0/1410785889 shutdown_connections 2024-09-21T02:53:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.654+0000 7f2657ce4640 1 -- 172.21.15.81:0/1410785889 wait complete. 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 Processor -- start 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 -- start start 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102640 0x7f2650198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26501036d0 0x7f2650199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2650104070 0x7f2650199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f265010e140 con 0x7f2650102640 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f265010dfc0 con 0x7f2650104070 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2657ce4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f265010e2c0 con 0x7f26501036d0 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2655a80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102640 0x7f2650198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2655a80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102640 0x7f2650198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58802/0 (socket says 172.21.15.81:58802) 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f2655a80640 1 -- 172.21.15.81:0/1492159125 learned_addr learned my addr 172.21.15.81:0/1492159125 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.655+0000 7f265527f640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26501036d0 0x7f2650199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2656281640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2650104070 0x7f2650199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2655a80640 1 -- 172.21.15.81:0/1492159125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26501036d0 msgr2=0x7f2650199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2655a80640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26501036d0 0x7f2650199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2655a80640 1 -- 172.21.15.81:0/1492159125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2650104070 msgr2=0x7f2650199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2655a80640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2650104070 0x7f2650199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2655a80640 1 -- 172.21.15.81:0/1492159125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265019a7c0 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2655a80640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102640 0x7f2650198d90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f264000cce0 tx=0x7f264000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640004b20 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2640004cc0 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265019aab0 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264000f6b0 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.656+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501a11b0 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.657+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2650102ab0 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.659+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f264000f850 con 0x7f2650102640 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.659+0000 7f264effd640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26380b6500 0x7f26380b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.659+0000 7f265527f640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26380b6500 0x7f26380b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:53:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.660+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2851+0+0 (secure 0 0 0) 0x7f26400e6080 con 0x7f2650102640 2024-09-21T02:53:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.660+0000 7f265527f640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26380b6500 0x7f26380b8a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2644005fd0 tx=0x7f264400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:53:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.663+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2640014030 con 0x7f2650102640 2024-09-21T02:53:34.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:34.850+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2650063800 con 0x7f26380b6500 2024-09-21T02:53:34.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:53:34.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:34.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:53:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:53:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:34.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi181 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi181 to 17087M 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] boot 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:53:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:53:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:53:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi181 2024-09-21T02:53:35.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi181 to 17087M 2024-09-21T02:53:35.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] boot 2024-09-21T02:53:35.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T02:53:35.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:35.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:53:35.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:53:35.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi181 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi181 to 17087M 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: osd.2 [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] boot 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:53:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:36 smithi081 ceph-mon[30991]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:36 smithi081 ceph-mon[30991]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:53:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:53:36.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:36 smithi164 ceph-mon[34236]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:36.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:36 smithi164 ceph-mon[34236]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:53:36.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:53:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:36 smithi181 ceph-mon[34096]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:53:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:36 smithi181 ceph-mon[34096]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:53:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:53:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50569]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:53:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50569]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50569]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50572]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:53:37.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50572]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50572]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50555]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50555]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50555]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50560]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50560]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.556 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 02:53:37 smithi081 sudo[50560]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.614 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41844]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:53:37.614 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41844]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.614 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.614 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41844]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.614 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41847]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:53:37.614 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41847]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.615 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.615 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41847]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41838]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41838]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41838]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41841]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41841]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.615 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 02:53:37 smithi164 sudo[41841]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42369]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42369]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42369]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42372]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42372]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42375]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42378]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42378]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 sudo[42378]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:53:37.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/375501088' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1a2e3786-f58f-4cad-b61e-404b2d7da8f1"} : dispatch 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/375501088' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a2e3786-f58f-4cad-b61e-404b2d7da8f1"}]': finished 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.751 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:37 smithi181 ceph-mon[34096]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:37.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:53:37.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:53:37.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:53:37.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/375501088' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1a2e3786-f58f-4cad-b61e-404b2d7da8f1"} : dispatch 2024-09-21T02:53:37.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/375501088' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a2e3786-f58f-4cad-b61e-404b2d7da8f1"}]': finished 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.840 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.841 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:37 smithi081 ceph-mon[30991]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: pgmap v91: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/375501088' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1a2e3786-f58f-4cad-b61e-404b2d7da8f1"} : dispatch 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/375501088' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a2e3786-f58f-4cad-b61e-404b2d7da8f1"}]': finished 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:53:37.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:37 smithi164 ceph-mon[34236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:53:38.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:38.661+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f26400a9b30 con 0x7f2650102640 2024-09-21T02:53:38.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:38 smithi164 ceph-mon[34236]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:38.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:38 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1118226766' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:53:38.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:38 smithi164 ceph-mon[34236]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T02:53:38.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:38.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:38 smithi181 ceph-mon[34096]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:38.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:38 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1118226766' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:53:38.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:38 smithi181 ceph-mon[34096]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T02:53:38.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:38 smithi081 ceph-mon[30991]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:38 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1118226766' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:53:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:38 smithi081 ceph-mon[30991]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T02:53:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:39.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:39 smithi164 ceph-mon[34236]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T02:53:39.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:39 smithi181 ceph-mon[34096]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T02:53:40.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:39 smithi081 ceph-mon[30991]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T02:53:40.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:40 smithi164 ceph-mon[34236]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:40 smithi181 ceph-mon[34096]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:41.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:40 smithi081 ceph-mon[30991]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:42.883 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:42 smithi081 ceph-mon[30991]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:42.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:42 smithi164 ceph-mon[34236]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:42.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:42 smithi181 ceph-mon[34096]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:44.899 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:44 smithi081 ceph-mon[30991]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:44.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:44 smithi164 ceph-mon[34236]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:44.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:44 smithi181 ceph-mon[34096]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:45.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:53:45.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:45.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:45 smithi081 ceph-mon[30991]: Deploying daemon osd.3 on smithi081 2024-09-21T02:53:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:53:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:45 smithi181 ceph-mon[34096]: Deploying daemon osd.3 on smithi081 2024-09-21T02:53:46.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:53:46.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:46.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:45 smithi164 ceph-mon[34236]: Deploying daemon osd.3 on smithi081 2024-09-21T02:53:46.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:46 smithi081 ceph-mon[30991]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:46.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:46 smithi181 ceph-mon[34096]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:47.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:46 smithi164 ceph-mon[34236]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:48.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:48 smithi081 ceph-mon[30991]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:48.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:48 smithi181 ceph-mon[34096]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:49.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:48 smithi164 ceph-mon[34236]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:50.983 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:50 smithi164 ceph-mon[34236]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:50.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:50 smithi181 ceph-mon[34096]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:51.045 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:50 smithi081 ceph-mon[30991]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:52.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:52 smithi181 ceph-mon[34096]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:52.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:52.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:52.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:53.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:52 smithi081 ceph-mon[30991]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:53.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:53.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:53.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:53.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:52 smithi164 ceph-mon[34236]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:53.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:53.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:53.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:55 smithi081 ceph-mon[30991]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.925+0000 7f264effd640 1 -- 172.21.15.81:0/1492159125 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2650063800 con 0x7f26380b6500 2024-09-21T02:53:55.927 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 3 on host 'smithi081' 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26380b6500 msgr2=0x7f26380b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26380b6500 0x7f26380b8a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2644005fd0 tx=0x7f264400b390 comp rx=0 tx=0).stop 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102640 msgr2=0x7f2650198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102640 0x7f2650198d90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f264000cce0 tx=0x7f264000a620 comp rx=0 tx=0).stop 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 shutdown_connections 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26380b6500 0x7f26380b8a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26501036d0 0x7f2650199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2650104070 0x7f2650199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 --2- 172.21.15.81:0/1492159125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650102640 0x7f2650198d90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:53:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 >> 172.21.15.81:0/1492159125 conn(0x7f26500fdfb0 msgr2=0x7f26501069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:53:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 shutdown_connections 2024-09-21T02:53:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:53:55.927+0000 7f2657ce4640 1 -- 172.21.15.81:0/1492159125 wait complete. 2024-09-21T02:53:55.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:55 smithi164 ceph-mon[34236]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:55.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:55.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:55.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:55 smithi181 ceph-mon[34096]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:55.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:55.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:55.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:55.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:56.662 DEBUG:teuthology.orchestra.run.smithi081:osd.3> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T02:53:56.664 INFO:tasks.cephadm:Deploying osd.4 on smithi164 with /dev/vg_nvme/lv_3... 2024-09-21T02:53:56.664 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:53:56.886 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:56 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:56.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:56 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:56.887 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:56 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:56.922 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:53:56.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:56 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:56.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:56 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:56.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:56 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:56.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:56 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:53:56.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:56 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:56.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:56 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:57.879 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:57 smithi081 ceph-mon[30991]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:57.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:57 smithi164 ceph-mon[34236]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:57 smithi181 ceph-mon[34096]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:58.165 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 02:53:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3[52543]: 2024-09-21T02:53:57.992+0000 7f0255194640 -1 osd.3 0 log_to_monitors true 2024-09-21T02:53:58.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:58 smithi164 ceph-mon[34236]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:53:58.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:58 smithi181 ceph-mon[34096]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:53:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:58 smithi081 ceph-mon[30991]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:53:59.314 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:53:59.341 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi164:vg_nvme/lv_3 2024-09-21T02:53:59.592 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:53:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:53:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:53:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:53:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:59.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:59.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:59.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:59.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:53:59.851 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:53:59.852 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:53:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:53:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:00.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:00.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:00.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:00.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:00.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:53:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:00.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.041+0000 7fb2e0569640 1 -- 172.21.15.164:0/4013192027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 msgr2=0x7fb2d8102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:00.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.041+0000 7fb2e0569640 1 --2- 172.21.15.164:0/4013192027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8102ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009900 tx=0x7fb2d402a480 comp rx=0 tx=0).stop 2024-09-21T02:54:00.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 -- 172.21.15.164:0/4013192027 shutdown_connections 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 --2- 172.21.15.164:0/4013192027 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d81036f0 0x7fb2d8103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 --2- 172.21.15.164:0/4013192027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d8104090 0x7fb2d810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 --2- 172.21.15.164:0/4013192027 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8102ad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 -- 172.21.15.164:0/4013192027 >> 172.21.15.164:0/4013192027 conn(0x7fb2d80fdfd0 msgr2=0x7fb2d8100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 -- 172.21.15.164:0/4013192027 shutdown_connections 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 -- 172.21.15.164:0/4013192027 wait complete. 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 Processor -- start 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.042+0000 7fb2e0569640 1 -- start start 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2e0569640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2e0569640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81036f0 0x7fb2d819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2e0569640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d8104090 0x7fb2d819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2e0569640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d810e150 con 0x7fb2d81036f0 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2e0569640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d810dfd0 con 0x7fb2d8102660 2024-09-21T02:54:00.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2e0569640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d810e2d0 con 0x7fb2d8104090 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54694/0 (socket says 172.21.15.164:54694) 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 -- 172.21.15.164:0/2797390016 learned_addr learned my addr 172.21.15.164:0/2797390016 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2ddb04640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81036f0 0x7fb2d819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2deb06640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d8104090 0x7fb2d819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 -- 172.21.15.164:0/2797390016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d8104090 msgr2=0x7fb2d819b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d8104090 0x7fb2d819b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 -- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81036f0 msgr2=0x7fb2d819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81036f0 0x7fb2d819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 -- 172.21.15.164:0/2797390016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d819b9a0 con 0x7fb2d8102660 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2deb06640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d8104090 0x7fb2d819b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2de305640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8199f70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009a20 tx=0x7fb2d40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.043+0000 7fb2cf7fe640 1 -- 172.21.15.164:0/2797390016 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d403f030 con 0x7fb2d8102660 2024-09-21T02:54:00.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.044+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d819bc30 con 0x7fb2d8102660 2024-09-21T02:54:00.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.044+0000 7fb2cf7fe640 1 -- 172.21.15.164:0/2797390016 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2d4003a80 con 0x7fb2d8102660 2024-09-21T02:54:00.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.044+0000 7fb2cf7fe640 1 -- 172.21.15.164:0/2797390016 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4035070 con 0x7fb2d8102660 2024-09-21T02:54:00.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.044+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d81a21c0 con 0x7fb2d8102660 2024-09-21T02:54:00.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.045+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d81a2420 con 0x7fb2d8102660 2024-09-21T02:54:00.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.046+0000 7fb2cf7fe640 1 -- 172.21.15.164:0/2797390016 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb2d4042030 con 0x7fb2d8102660 2024-09-21T02:54:00.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.047+0000 7fb2cf7fe640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2c40b6510 0x7fb2c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:00.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.047+0000 7fb2cf7fe640 1 -- 172.21.15.164:0/2797390016 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7fb2d4106530 con 0x7fb2d8102660 2024-09-21T02:54:00.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.047+0000 7fb2ddb04640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2c40b6510 0x7fb2c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:00.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.047+0000 7fb2ddb04640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2c40b6510 0x7fb2c40b8a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80058c0 tx=0x7fb2c800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:54:00.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.051+0000 7fb2cf7fe640 1 -- 172.21.15.164:0/2797390016 <== mon.2 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2d40ce100 con 0x7fb2d8102660 2024-09-21T02:54:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:00.242+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb2d81000a0 con 0x7fb2c40b6510 2024-09-21T02:54:00.305 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3[52543]: 2024-09-21T02:53:59.977+0000 7f025192b640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T02:54:00.305 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 02:53:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3[52543]: 2024-09-21T02:53:59.983+0000 7f0248f0c640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:54:00.901 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi081 2024-09-21T02:54:00.901 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-21T02:54:00.901 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] boot 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:00.902 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi081 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] boot 2024-09-21T02:54:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T02:54:01.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:01.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:01.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:01.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi081 2024-09-21T02:54:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-21T02:54:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523]' entity='osd.3' 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: osd.3 [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] boot 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:01.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:01.828 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:01 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:54:01.828 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:01 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:54:01.828 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:01 smithi164 ceph-mon[34236]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:54:01.829 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:01 smithi164 ceph-mon[34236]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:01.829 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:01 smithi164 ceph-mon[34236]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:54:01.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:01 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:54:01.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:01 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:54:01.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:01 smithi181 ceph-mon[34096]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:54:01.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:01 smithi181 ceph-mon[34096]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:01.900 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:01 smithi181 ceph-mon[34096]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:54:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:01 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:54:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:01 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:54:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:01 smithi081 ceph-mon[30991]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:54:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:01 smithi081 ceph-mon[30991]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:01 smithi081 ceph-mon[30991]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:54:03.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:03 smithi164 ceph-mon[34236]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:03.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:03 smithi164 ceph-mon[34236]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:54:03.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:03 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/3025765341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"} : dispatch 2024-09-21T02:54:03.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:03 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"} : dispatch 2024-09-21T02:54:03.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:03 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"}]': finished 2024-09-21T02:54:03.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:03 smithi164 ceph-mon[34236]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T02:54:03.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:03.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:03 smithi181 ceph-mon[34096]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:03.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:03 smithi181 ceph-mon[34096]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:54:03.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:03 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/3025765341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"} : dispatch 2024-09-21T02:54:03.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:03 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"} : dispatch 2024-09-21T02:54:03.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:03 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"}]': finished 2024-09-21T02:54:03.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:03 smithi181 ceph-mon[34096]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T02:54:03.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:03 smithi081 ceph-mon[30991]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:03 smithi081 ceph-mon[30991]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:54:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:03 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/3025765341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"} : dispatch 2024-09-21T02:54:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:03 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"} : dispatch 2024-09-21T02:54:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:03 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e7883d2-d336-454f-b035-5cdaf8cf6d81"}]': finished 2024-09-21T02:54:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:03 smithi081 ceph-mon[30991]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T02:54:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:04.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:04 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/2073859299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:04.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:04 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/2073859299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:04.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:04 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/2073859299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:05.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:05 smithi164 ceph-mon[34236]: pgmap v115: 1 pgs: 1 activating+degraded; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:54:05.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:05 smithi164 ceph-mon[34236]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-21T02:54:05.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:05 smithi181 ceph-mon[34096]: pgmap v115: 1 pgs: 1 activating+degraded; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:54:05.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:05 smithi181 ceph-mon[34096]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-21T02:54:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:05 smithi081 ceph-mon[30991]: pgmap v115: 1 pgs: 1 activating+degraded; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:54:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:05 smithi081 ceph-mon[30991]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-21T02:54:07.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:07 smithi081 ceph-mon[30991]: pgmap v116: 1 pgs: 1 activating+degraded; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:54:07.429 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:07 smithi164 ceph-mon[34236]: pgmap v116: 1 pgs: 1 activating+degraded; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:54:07.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:07 smithi181 ceph-mon[34096]: pgmap v116: 1 pgs: 1 activating+degraded; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:54:08.423 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:08 smithi164 ceph-mon[34236]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-21T02:54:08.423 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:08 smithi164 ceph-mon[34236]: Cluster is now healthy 2024-09-21T02:54:08.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:08 smithi181 ceph-mon[34096]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-21T02:54:08.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:08 smithi181 ceph-mon[34096]: Cluster is now healthy 2024-09-21T02:54:08.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:08 smithi081 ceph-mon[30991]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-21T02:54:08.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:08 smithi081 ceph-mon[30991]: Cluster is now healthy 2024-09-21T02:54:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:09 smithi164 ceph-mon[34236]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T02:54:09.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:09 smithi181 ceph-mon[34096]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T02:54:09.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:09 smithi081 ceph-mon[30991]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T02:54:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:11 smithi164 ceph-mon[34236]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:54:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:54:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:11.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:11 smithi181 ceph-mon[34096]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:54:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:54:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:11 smithi081 ceph-mon[30991]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:54:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:54:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:12.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:12 smithi164 ceph-mon[34236]: Deploying daemon osd.4 on smithi164 2024-09-21T02:54:12.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:12 smithi181 ceph-mon[34096]: Deploying daemon osd.4 on smithi164 2024-09-21T02:54:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:12 smithi081 ceph-mon[30991]: Deploying daemon osd.4 on smithi164 2024-09-21T02:54:13.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:13 smithi164 ceph-mon[34236]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T02:54:13.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:13 smithi181 ceph-mon[34096]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T02:54:13.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:13 smithi081 ceph-mon[30991]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T02:54:15.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:15 smithi164 ceph-mon[34236]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T02:54:15.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:15 smithi181 ceph-mon[34096]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T02:54:15.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:15 smithi081 ceph-mon[30991]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T02:54:17.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:17 smithi164 ceph-mon[34236]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:54:17.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:17 smithi181 ceph-mon[34096]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:54:17.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:17 smithi081 ceph-mon[30991]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:54:18.428 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:18.429 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:18.430 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:18.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:18.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:18.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:18.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:18.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:18.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:19 smithi081 ceph-mon[30991]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:54:19.557 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:19 smithi164 ceph-mon[34236]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:54:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:19 smithi181 ceph-mon[34096]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:54:20.833 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:20.834 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:20.834 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:20.834 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:20.834 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:21.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.246+0000 7fb2cf7fe640 1 -- 172.21.15.164:0/2797390016 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb2d81000a0 con 0x7fb2c40b6510 2024-09-21T02:54:21.248 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 4 on host 'smithi164' 2024-09-21T02:54:21.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2c40b6510 msgr2=0x7fb2c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:21.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2c40b6510 0x7fb2c40b8a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80058c0 tx=0x7fb2c800a250 comp rx=0 tx=0).stop 2024-09-21T02:54:21.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 msgr2=0x7fb2d8199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:21.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8199f70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009a20 tx=0x7fb2d40040c0 comp rx=0 tx=0).stop 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 shutdown_connections 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2c40b6510 0x7fb2c40b8a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2d8104090 0x7fb2d819b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d81036f0 0x7fb2d819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 --2- 172.21.15.164:0/2797390016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2d8102660 0x7fb2d8199f70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 >> 172.21.15.164:0/2797390016 conn(0x7fb2d80fdfd0 msgr2=0x7fb2d80ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 shutdown_connections 2024-09-21T02:54:21.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:54:21.249+0000 7fb2e0569640 1 -- 172.21.15.164:0/2797390016 wait complete. 2024-09-21T02:54:21.849 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:21 smithi164 ceph-mon[34236]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:21.849 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:21 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:21.849 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:21 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:21.849 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:21 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:21.882 DEBUG:teuthology.orchestra.run.smithi164:osd.4> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T02:54:21.884 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_3... 2024-09-21T02:54:21.884 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:54:21.912 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:21 smithi181 ceph-mon[34096]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:21.913 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:21 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:21.913 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:21 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:21.913 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:21 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:21 smithi081 ceph-mon[30991]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:21 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:21 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:21 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:22.140 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:54:23.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:23 smithi181 ceph-mon[34096]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:23.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:23 smithi181 ceph-mon[34096]: from='osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:54:23.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:23 smithi181 ceph-mon[34096]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:54:23.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:23 smithi164 ceph-mon[34236]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:23.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:23 smithi164 ceph-mon[34236]: from='osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:54:23.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:23 smithi164 ceph-mon[34236]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:54:23.932 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 02:54:23 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T02:54:23.568+0000 7f5a370cd640 -1 osd.4 0 log_to_monitors true 2024-09-21T02:54:24.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:23 smithi081 ceph-mon[30991]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:24.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:23 smithi081 ceph-mon[30991]: from='osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:54:24.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:23 smithi081 ceph-mon[30991]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:54:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:54:24.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-09-21T02:54:24.886 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:24.887 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.888 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:24 smithi181 ceph-mon[34096]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:54:24.910 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:54:24.931 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T02:54:24.646+0000 7f5a3304f640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T02:54:24.931 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T02:54:24.651+0000 7f5a2ee4d640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:24.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:24.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:24.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:24.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:24.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:24 smithi164 ceph-mon[34236]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:25.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:25.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:25.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:24 smithi081 ceph-mon[30991]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:54:25.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 -- 172.21.15.181:0/1972993501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 msgr2=0x7f0338103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:25.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 --2- 172.21.15.181:0/1972993501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f0338103280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f032c009900 tx=0x7f032c02a480 comp rx=0 tx=0).stop 2024-09-21T02:54:25.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 -- 172.21.15.181:0/1972993501 shutdown_connections 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 --2- 172.21.15.181:0/1972993501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f0338103280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 --2- 172.21.15.181:0/1972993501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0338103810 0x7f033810a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 --2- 172.21.15.181:0/1972993501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0338101de0 0x7f0338102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 -- 172.21.15.181:0/1972993501 >> 172.21.15.181:0/1972993501 conn(0x7f03380fd770 msgr2=0x7f03380ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 -- 172.21.15.181:0/1972993501 shutdown_connections 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.372+0000 7f033fd69640 1 -- 172.21.15.181:0/1972993501 wait complete. 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 Processor -- start 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 -- start start 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0338101de0 0x7f03381059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f03381042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:25.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0338103810 0x7f03381047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f033810d8d0 con 0x7f0338103810 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f033810d750 con 0x7f0338101de0 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033fd69640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f033810da50 con 0x7f0338102e70 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033d304640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f03381042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033d304640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f03381042a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:36402/0 (socket says 172.21.15.181:36402) 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033d304640 1 -- 172.21.15.181:0/978733700 learned_addr learned my addr 172.21.15.181:0/978733700 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.373+0000 7f033db05640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0338101de0 0x7f03381059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033e306640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0338103810 0x7f03381047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033d304640 1 -- 172.21.15.181:0/978733700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0338101de0 msgr2=0x7f03381059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033d304640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0338101de0 0x7f03381059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033d304640 1 -- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0338103810 msgr2=0x7f03381047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033d304640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0338103810 0x7f03381047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033d304640 1 -- 172.21.15.181:0/978733700 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0338104ee0 con 0x7f0338102e70 2024-09-21T02:54:25.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033e306640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0338103810 0x7f03381047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:54:25.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033d304640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f03381042a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f032c009230 tx=0x7f032c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:54:25.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f032affd640 1 -- 172.21.15.181:0/978733700 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c03f030 con 0x7f0338102e70 2024-09-21T02:54:25.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f032affd640 1 -- 172.21.15.181:0/978733700 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f032c0044c0 con 0x7f0338102e70 2024-09-21T02:54:25.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03381a3f80 con 0x7f0338102e70 2024-09-21T02:54:25.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f032affd640 1 -- 172.21.15.181:0/978733700 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c035070 con 0x7f0338102e70 2024-09-21T02:54:25.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.374+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03381a4320 con 0x7f0338102e70 2024-09-21T02:54:25.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.375+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03381a44f0 con 0x7f0338102e70 2024-09-21T02:54:25.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.377+0000 7f032affd640 1 -- 172.21.15.181:0/978733700 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f032c042030 con 0x7f0338102e70 2024-09-21T02:54:25.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.378+0000 7f032affd640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f03240b6590 0x7f03240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:25.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.378+0000 7f033db05640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f03240b6590 0x7f03240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:25.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.378+0000 7f032affd640 1 -- 172.21.15.181:0/978733700 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f032c106630 con 0x7f0338102e70 2024-09-21T02:54:25.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.378+0000 7f033db05640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f03240b6590 0x7f03240b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0330005fd0 tx=0x7f0330009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:54:25.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.382+0000 7f032affd640 1 -- 172.21.15.181:0/978733700 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f032c0ce050 con 0x7f0338102e70 2024-09-21T02:54:25.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:25.576+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f03381093b0 con 0x7f03240b6590 2024-09-21T02:54:25.885 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:25.885 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi164 2024-09-21T02:54:25.885 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi164 to 8544M 2024-09-21T02:54:25.885 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:54:25.885 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:25.886 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:25.886 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:25.886 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:25.886 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:25.886 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:25.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi164 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi164 to 8544M 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:25.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi164 2024-09-21T02:54:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi164 to 8544M 2024-09-21T02:54:26.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:54:26.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:26.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:26.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:26.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:26.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:26.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:26.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:26 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:54:26.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:26 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:54:26.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:26 smithi164 ceph-mon[34236]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:26.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:26 smithi164 ceph-mon[34236]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:26.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:26 smithi164 ceph-mon[34236]: osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] boot 2024-09-21T02:54:26.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:26 smithi164 ceph-mon[34236]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T02:54:26.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:26 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:26.989 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:26 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:54:26.989 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:26 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:54:26.989 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:26 smithi181 ceph-mon[34096]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:26.989 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:26 smithi181 ceph-mon[34096]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:26.990 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:26 smithi181 ceph-mon[34096]: osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] boot 2024-09-21T02:54:26.990 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:26 smithi181 ceph-mon[34096]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T02:54:26.990 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:26 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:26 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:54:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:26 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:54:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:26 smithi081 ceph-mon[30991]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:26 smithi081 ceph-mon[30991]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:54:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:26 smithi081 ceph-mon[30991]: osd.4 [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] boot 2024-09-21T02:54:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:26 smithi081 ceph-mon[30991]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T02:54:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:26 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:54:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:27 smithi164 ceph-mon[34236]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:54:27.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:27 smithi181 ceph-mon[34096]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:54:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:27 smithi081 ceph-mon[30991]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:54:28.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:28 smithi164 ceph-mon[34236]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:28.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:28 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/3570193673' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"} : dispatch 2024-09-21T02:54:28.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:28 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"} : dispatch 2024-09-21T02:54:28.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:28 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"}]': finished 2024-09-21T02:54:28.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:28 smithi164 ceph-mon[34236]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T02:54:28.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:28.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:28 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/1757293259' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:28 smithi181 ceph-mon[34096]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:28 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/3570193673' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"} : dispatch 2024-09-21T02:54:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:28 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"} : dispatch 2024-09-21T02:54:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:28 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"}]': finished 2024-09-21T02:54:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:28 smithi181 ceph-mon[34096]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T02:54:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:28 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/1757293259' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:28 smithi081 ceph-mon[30991]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:28 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/3570193673' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"} : dispatch 2024-09-21T02:54:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:28 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"} : dispatch 2024-09-21T02:54:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:28 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "510f6ee6-d0cb-4d53-959f-f3fdb5875218"}]': finished 2024-09-21T02:54:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:28 smithi081 ceph-mon[30991]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T02:54:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:28 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/1757293259' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:30.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:30 smithi164 ceph-mon[34236]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:30.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:30 smithi181 ceph-mon[34096]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:31.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:30 smithi081 ceph-mon[30991]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:32.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:32 smithi164 ceph-mon[34236]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:32.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:32 smithi181 ceph-mon[34096]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:33.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:32 smithi081 ceph-mon[30991]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:34.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:34 smithi181 ceph-mon[34096]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:34 smithi164 ceph-mon[34236]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:34 smithi081 ceph-mon[30991]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:36 smithi181 ceph-mon[34096]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:54:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:36.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:36 smithi181 ceph-mon[34096]: Deploying daemon osd.5 on smithi181 2024-09-21T02:54:37.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:36 smithi081 ceph-mon[30991]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:37.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:54:37.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:37.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:36 smithi081 ceph-mon[30991]: Deploying daemon osd.5 on smithi181 2024-09-21T02:54:37.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:36 smithi164 ceph-mon[34236]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:37.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:54:37.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:37.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:36 smithi164 ceph-mon[34236]: Deploying daemon osd.5 on smithi181 2024-09-21T02:54:38.928 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:38 smithi181 ceph-mon[34096]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:38 smithi081 ceph-mon[30991]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:39.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:38 smithi164 ceph-mon[34236]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:40 smithi181 ceph-mon[34096]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:41.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:40 smithi081 ceph-mon[30991]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:41.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:40 smithi164 ceph-mon[34236]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:42.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:42 smithi181 ceph-mon[34096]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:42.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:42.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:42.845 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:42 smithi081 ceph-mon[30991]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:42 smithi164 ceph-mon[34236]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:44.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:44 smithi181 ceph-mon[34096]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:44 smithi081 ceph-mon[30991]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:44 smithi164 ceph-mon[34236]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:46.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:46.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:46.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:46 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:46.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:46.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:46 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:46.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:46.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:46 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:46.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.734+0000 7f032affd640 1 -- 172.21.15.181:0/978733700 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f03381093b0 con 0x7f03240b6590 2024-09-21T02:54:46.736 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-09-21T02:54:46.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f03240b6590 msgr2=0x7f03240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:46.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f03240b6590 0x7f03240b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0330005fd0 tx=0x7f0330009500 comp rx=0 tx=0).stop 2024-09-21T02:54:46.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 msgr2=0x7f03381042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:46.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f03381042a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f032c009230 tx=0x7f032c0040c0 comp rx=0 tx=0).stop 2024-09-21T02:54:46.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 shutdown_connections 2024-09-21T02:54:46.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f03240b6590 0x7f03240b8aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:46.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0338102e70 0x7f03381042a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:46.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0338103810 0x7f03381047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:46.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 --2- 172.21.15.181:0/978733700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0338101de0 0x7f03381059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:46.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.736+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 >> 172.21.15.181:0/978733700 conn(0x7f03380fd770 msgr2=0x7f033806b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:54:46.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.737+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 shutdown_connections 2024-09-21T02:54:46.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:54:46.737+0000 7f033fd69640 1 -- 172.21.15.181:0/978733700 wait complete. 2024-09-21T02:54:47.354 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:47 smithi181 ceph-mon[34096]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:47.355 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:47.355 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:47.355 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:47.380 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T02:54:47.385 INFO:tasks.cephadm:Deploying osd.6 on smithi081 with /dev/vg_nvme/lv_2... 2024-09-21T02:54:47.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:54:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:47 smithi081 ceph-mon[30991]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:54:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:47 smithi164 ceph-mon[34236]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:54:47.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:47.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:48.749 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 02:54:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T02:54:48.527+0000 7f589dfb0640 -1 osd.5 0 log_to_monitors true 2024-09-21T02:54:49.312 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:49 smithi081 ceph-mon[30991]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:49.312 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:49 smithi081 ceph-mon[30991]: from='osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:54:49.312 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:49 smithi081 ceph-mon[30991]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:54:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:49 smithi164 ceph-mon[34236]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:49 smithi164 ceph-mon[34236]: from='osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:54:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:49 smithi164 ceph-mon[34236]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:54:49.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:49 smithi181 ceph-mon[34096]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:49.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:49 smithi181 ceph-mon[34096]: from='osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:54:49.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:49 smithi181 ceph-mon[34096]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:54:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:54:50.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-09-21T02:54:50.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:50.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:50.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:50.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:54:50.584 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:54:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:54:50.999 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T02:54:50.718+0000 7f5899f32640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T02:54:50.999 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 02:54:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T02:54:50.726+0000 7f5891d28640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 -- 172.21.15.81:0/3176316230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7301040c0 msgr2=0x7ff73010aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 --2- 172.21.15.81:0/3176316230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7301040c0 0x7ff73010aa60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff728009ca0 tx=0x7ff72802a950 comp rx=0 tx=0).stop 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 -- 172.21.15.81:0/3176316230 shutdown_connections 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 --2- 172.21.15.81:0/3176316230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7301040c0 0x7ff73010aa60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 --2- 172.21.15.81:0/3176316230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff730103720 0x7ff730103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 --2- 172.21.15.81:0/3176316230 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff730102690 0x7ff730102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 -- 172.21.15.81:0/3176316230 >> 172.21.15.81:0/3176316230 conn(0x7ff7300fe000 msgr2=0x7ff7301004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 -- 172.21.15.81:0/3176316230 shutdown_connections 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 -- 172.21.15.81:0/3176316230 wait complete. 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 Processor -- start 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.147+0000 7ff7379e3640 1 -- start start 2024-09-21T02:54:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff7379e3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff730102690 0x7ff73019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff7379e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730103720 0x7ff73019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff7379e3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7301040c0 0x7ff73019d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff7379e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff73010e1f0 con 0x7ff730103720 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff7379e3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff73010e070 con 0x7ff7301040c0 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff7379e3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff73010e370 con 0x7ff730102690 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730103720 0x7ff73019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730103720 0x7ff73019c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39044/0 (socket says 172.21.15.81:39044) 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 -- 172.21.15.81:0/2733270187 learned_addr learned my addr 172.21.15.81:0/2733270187 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff735f80640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7301040c0 0x7ff73019d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff73577f640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff730102690 0x7ff73019c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 -- 172.21.15.81:0/2733270187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff730102690 msgr2=0x7ff73019c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff730102690 0x7ff73019c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 -- 172.21.15.81:0/2733270187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7301040c0 msgr2=0x7ff73019d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:54:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7301040c0 0x7ff73019d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:54:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 -- 172.21.15.81:0/2733270187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73019dbc0 con 0x7ff730103720 2024-09-21T02:54:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.148+0000 7ff734f7e640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730103720 0x7ff73019c800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff72000b4a0 tx=0x7ff72000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:54:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.149+0000 7ff7267fc640 1 -- 172.21.15.81:0/2733270187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720014070 con 0x7ff730103720 2024-09-21T02:54:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.149+0000 7ff7267fc640 1 -- 172.21.15.81:0/2733270187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff720010aa0 con 0x7ff730103720 2024-09-21T02:54:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.149+0000 7ff7267fc640 1 -- 172.21.15.81:0/2733270187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720017b70 con 0x7ff730103720 2024-09-21T02:54:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.149+0000 7ff7379e3640 1 -- 172.21.15.81:0/2733270187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73019deb0 con 0x7ff730103720 2024-09-21T02:54:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.149+0000 7ff7379e3640 1 -- 172.21.15.81:0/2733270187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7301a45b0 con 0x7ff730103720 2024-09-21T02:54:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.150+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff730063fc0 con 0x7ff730103720 2024-09-21T02:54:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.151+0000 7ff7267fc640 1 -- 172.21.15.81:0/2733270187 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff720017070 con 0x7ff730103720 2024-09-21T02:54:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.152+0000 7ff7267fc640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff71c0b6590 0x7ff71c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:54:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.152+0000 7ff73577f640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff71c0b6590 0x7ff71c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:54:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.152+0000 7ff7267fc640 1 -- 172.21.15.81:0/2733270187 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7ff7200e5990 con 0x7ff730103720 2024-09-21T02:54:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.153+0000 7ff73577f640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff71c0b6590 0x7ff71c0b8aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0058c0 tx=0x7ff72c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:54:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.160+0000 7ff7267fc640 1 -- 172.21.15.81:0/2733270187 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7200ad200 con 0x7ff730103720 2024-09-21T02:54:51.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:54:51.357+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff730063800 con 0x7ff71c0b6590 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi181 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi181 to 8543M 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:51.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:51 smithi081 ceph-mon[30991]: from='osd.5 ' entity='osd.5' 2024-09-21T02:54:51.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:51.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi181 2024-09-21T02:54:51.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi181 to 8543M 2024-09-21T02:54:51.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:54:51.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:54:51.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:51.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:51.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:51 smithi164 ceph-mon[34236]: from='osd.5 ' entity='osd.5' 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi181 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi181 to 8543M 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:51 smithi181 ceph-mon[34096]: from='osd.5 ' entity='osd.5' 2024-09-21T02:54:52.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:54:52.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:54:52.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] boot 2024-09-21T02:54:52.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T02:54:52.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:52.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:52.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:52.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:52.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:52.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:52 smithi081 ceph-mon[30991]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:54:52.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] boot 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:52.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:52 smithi164 ceph-mon[34236]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: osd.5 [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] boot 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:54:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:52 smithi181 ceph-mon[34096]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:54:53.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:53 smithi081 ceph-mon[30991]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:53.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:53 smithi081 ceph-mon[30991]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:54:53.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:53 smithi164 ceph-mon[34236]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:53.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:53 smithi164 ceph-mon[34236]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:54:53.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:53 smithi181 ceph-mon[34096]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:53.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:53 smithi181 ceph-mon[34096]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:54:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:54 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/847634179' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6070ee30-62b8-4773-9031-357aef41a66b"} : dispatch 2024-09-21T02:54:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:54 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/847634179' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6070ee30-62b8-4773-9031-357aef41a66b"}]': finished 2024-09-21T02:54:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:54 smithi081 ceph-mon[30991]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T02:54:54.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:54:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:54 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/847634179' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6070ee30-62b8-4773-9031-357aef41a66b"} : dispatch 2024-09-21T02:54:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:54 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/847634179' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6070ee30-62b8-4773-9031-357aef41a66b"}]': finished 2024-09-21T02:54:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:54 smithi164 ceph-mon[34236]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T02:54:54.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:54:54.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:54 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/847634179' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6070ee30-62b8-4773-9031-357aef41a66b"} : dispatch 2024-09-21T02:54:54.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:54 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/847634179' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6070ee30-62b8-4773-9031-357aef41a66b"}]': finished 2024-09-21T02:54:54.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:54 smithi181 ceph-mon[34096]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T02:54:54.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:54:55.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:55 smithi081 ceph-mon[30991]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:55.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:55 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1832474102' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:55.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:55 smithi164 ceph-mon[34236]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:55.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:55 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1832474102' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:55.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:55 smithi181 ceph-mon[34096]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:55.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:55 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1832474102' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:54:57.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:57 smithi164 ceph-mon[34236]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:57.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:57 smithi181 ceph-mon[34096]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:57.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:57 smithi081 ceph-mon[30991]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 208 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:54:59.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:54:59 smithi164 ceph-mon[34236]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:54:59.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:54:59 smithi181 ceph-mon[34096]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:54:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:54:59 smithi081 ceph-mon[30991]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:55:01.541 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:01 smithi081 ceph-mon[30991]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T02:55:01.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:01 smithi164 ceph-mon[34236]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T02:55:01.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:01 smithi181 ceph-mon[34096]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T02:55:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:03 smithi081 ceph-mon[30991]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-21T02:55:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:55:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:03 smithi081 ceph-mon[30991]: Deploying daemon osd.6 on smithi081 2024-09-21T02:55:03.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:03 smithi181 ceph-mon[34096]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-21T02:55:03.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:55:03.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:03.569 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:03 smithi181 ceph-mon[34096]: Deploying daemon osd.6 on smithi081 2024-09-21T02:55:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:03 smithi164 ceph-mon[34236]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-21T02:55:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:55:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:03 smithi164 ceph-mon[34236]: Deploying daemon osd.6 on smithi081 2024-09-21T02:55:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:05 smithi081 ceph-mon[30991]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:55:05.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:05 smithi164 ceph-mon[34236]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:55:05.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:05 smithi181 ceph-mon[34096]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:55:07.401 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:07 smithi081 ceph-mon[30991]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T02:55:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:07 smithi164 ceph-mon[34236]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T02:55:07.752 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:07 smithi181 ceph-mon[34096]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T02:55:09.437 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:09 smithi081 ceph-mon[30991]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:55:09.437 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:09.437 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:09.437 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:09.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:09 smithi164 ceph-mon[34236]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:55:09.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:09.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:09.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:09.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:09 smithi181 ceph-mon[34096]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:55:09.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:09.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:09.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:11 smithi164 ceph-mon[34236]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:11.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:11 smithi181 ceph-mon[34096]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:11 smithi081 ceph-mon[30991]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:12.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:12.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:12.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:12 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.708+0000 7ff7267fc640 1 -- 172.21.15.81:0/2733270187 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff730063800 con 0x7ff71c0b6590 2024-09-21T02:55:12.710 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 6 on host 'smithi081' 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff71c0b6590 msgr2=0x7ff71c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff71c0b6590 0x7ff71c0b8aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0058c0 tx=0x7ff72c00a4c0 comp rx=0 tx=0).stop 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730103720 msgr2=0x7ff73019c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730103720 0x7ff73019c800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff72000b4a0 tx=0x7ff72000b960 comp rx=0 tx=0).stop 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 shutdown_connections 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff71c0b6590 0x7ff71c0b8aa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7301040c0 0x7ff73019d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff730103720 0x7ff73019c800 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 --2- 172.21.15.81:0/2733270187 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff730102690 0x7ff73019c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 >> 172.21.15.81:0/2733270187 conn(0x7ff7300fe000 msgr2=0x7ff7300ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 shutdown_connections 2024-09-21T02:55:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:55:12.710+0000 7ff71bfff640 1 -- 172.21.15.81:0/2733270187 wait complete. 2024-09-21T02:55:12.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:12 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:12 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:12 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:12.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:12 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:12.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:12 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:12 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:12 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:12.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:12 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:12.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:12 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:12.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:12 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:13.377 DEBUG:teuthology.orchestra.run.smithi081:osd.6> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T02:55:13.379 INFO:tasks.cephadm:Deploying osd.7 on smithi164 with /dev/vg_nvme/lv_2... 2024-09-21T02:55:13.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:55:13.638 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:55:13.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:13 smithi164 ceph-mon[34236]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:13.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:13.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:13.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:13.937 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:13 smithi081 ceph-mon[30991]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:13.937 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:13.937 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:13.937 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:13.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:13 smithi181 ceph-mon[34096]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:14.879 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 02:55:14 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T02:55:14.796+0000 7f0cb581e640 -1 osd.6 0 log_to_monitors true 2024-09-21T02:55:15.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:15 smithi164 ceph-mon[34236]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:15.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:15 smithi164 ceph-mon[34236]: from='osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:55:15.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:15 smithi164 ceph-mon[34236]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:55:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:15 smithi181 ceph-mon[34096]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:15 smithi181 ceph-mon[34096]: from='osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:55:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:15 smithi181 ceph-mon[34096]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:55:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:15 smithi081 ceph-mon[30991]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:15 smithi081 ceph-mon[30991]: from='osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:55:16.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:15 smithi081 ceph-mon[30991]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:55:16.203 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:55:16.230 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi164:vg_nvme/lv_2 2024-09-21T02:55:16.486 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:16.769 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:16.770 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.770 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:55:16.770 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:55:16.770 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:16.806 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T02:55:16.650+0000 7f0cb17a0640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T02:55:16.806 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T02:55:16.657+0000 7f0cad59e640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:55:16.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:55:16.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:55:16.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:55:16.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:55:16.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:16.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 -- 172.21.15.164:0/900185526 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 msgr2=0x7fe194101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:16.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 --2- 172.21.15.164:0/900185526 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194101f10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe184009900 tx=0x7fe18402a410 comp rx=0 tx=0).stop 2024-09-21T02:55:16.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 -- 172.21.15.164:0/900185526 shutdown_connections 2024-09-21T02:55:16.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 --2- 172.21.15.164:0/900185526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe194109500 0x7fe19410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 --2- 172.21.15.164:0/900185526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194106ba0 0x7fe194108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 --2- 172.21.15.164:0/900185526 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194101f10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 -- 172.21.15.164:0/900185526 >> 172.21.15.164:0/900185526 conn(0x7fe1940fd770 msgr2=0x7fe1940ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 -- 172.21.15.164:0/900185526 shutdown_connections 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 -- 172.21.15.164:0/900185526 wait complete. 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.948+0000 7fe199630640 1 Processor -- start 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe199630640 1 -- start start 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe199630640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe199630640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194106ba0 0x7fe19419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe199630640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe194109500 0x7fe19419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe199630640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410f230 con 0x7fe194106ba0 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe199630640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410f0b0 con 0x7fe194101b00 2024-09-21T02:55:16.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe199630640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe19410f3b0 con 0x7fe194109500 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34820/0 (socket says 172.21.15.164:34820) 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe192ffd640 1 -- 172.21.15.164:0/4053999272 learned_addr learned my addr 172.21.15.164:0/4053999272 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe1927fc640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194106ba0 0x7fe19419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe1937fe640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe194109500 0x7fe19419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe192ffd640 1 -- 172.21.15.164:0/4053999272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe194109500 msgr2=0x7fe19419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe192ffd640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe194109500 0x7fe19419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe192ffd640 1 -- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194106ba0 msgr2=0x7fe19419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.949+0000 7fe192ffd640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194106ba0 0x7fe19419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe192ffd640 1 -- 172.21.15.164:0/4053999272 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19419b8f0 con 0x7fe194101b00 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe1927fc640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194106ba0 0x7fe19419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe192ffd640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194199ec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe184009230 tx=0x7fe1840040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe17bfff640 1 -- 172.21.15.164:0/4053999272 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18403f030 con 0x7fe194101b00 2024-09-21T02:55:16.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe17bfff640 1 -- 172.21.15.164:0/4053999272 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1840044c0 con 0x7fe194101b00 2024-09-21T02:55:16.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19419bb80 con 0x7fe194101b00 2024-09-21T02:55:16.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe17bfff640 1 -- 172.21.15.164:0/4053999272 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184035070 con 0x7fe194101b00 2024-09-21T02:55:16.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.950+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1941a2110 con 0x7fe194101b00 2024-09-21T02:55:16.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.951+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1940ff290 con 0x7fe194101b00 2024-09-21T02:55:16.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.953+0000 7fe17bfff640 1 -- 172.21.15.164:0/4053999272 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe184042030 con 0x7fe194101b00 2024-09-21T02:55:16.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.953+0000 7fe17bfff640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe17c0b6510 0x7fe17c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:16.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.954+0000 7fe17bfff640 1 -- 172.21.15.164:0/4053999272 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4685+0+0 (secure 0 0 0) 0x7fe184106e20 con 0x7fe194101b00 2024-09-21T02:55:16.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.954+0000 7fe1927fc640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe17c0b6510 0x7fe17c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:16.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.954+0000 7fe1927fc640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe17c0b6510 0x7fe17c0b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe188009fc0 tx=0x7fe188005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:55:16.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:16.961+0000 7fe17bfff640 1 -- 172.21.15.164:0/4053999272 <== mon.2 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1840ce4e0 con 0x7fe194101b00 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:55:17.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:17.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:17.155+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe194063800 con 0x7fe17c0b6510 2024-09-21T02:55:17.807 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:17 smithi164 ceph-mon[34236]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:17.807 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:17 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi081 2024-09-21T02:55:17.807 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:17 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-21T02:55:17.807 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:17 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:17.807 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:17 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:55:17.807 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:17 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:55:17.807 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:17 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:17 smithi181 ceph-mon[34096]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:17 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi081 2024-09-21T02:55:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:17 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-21T02:55:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:17 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:17 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:55:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:17 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:55:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:17 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:17 smithi081 ceph-mon[30991]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:17 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi081 2024-09-21T02:55:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:17 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-21T02:55:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:17 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:17 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:55:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:17 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:55:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:17 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:18.886 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:18 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:55:18.886 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:18 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:55:18.886 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:18 smithi164 ceph-mon[34236]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:18.886 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:18.887 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:18 smithi164 ceph-mon[34236]: osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] boot 2024-09-21T02:55:18.887 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:18 smithi164 ceph-mon[34236]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T02:55:18.887 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:18.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:18 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:55:18.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:18 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:55:18.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:18 smithi181 ceph-mon[34096]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:18.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:18.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:18 smithi181 ceph-mon[34096]: osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] boot 2024-09-21T02:55:18.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:18 smithi181 ceph-mon[34096]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T02:55:18.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:19.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:18 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:55:19.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:18 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:55:19.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:18 smithi081 ceph-mon[30991]: from='client.24398 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:19.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:19.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:18 smithi081 ceph-mon[30991]: osd.6 [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] boot 2024-09-21T02:55:19.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:18 smithi081 ceph-mon[30991]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T02:55:19.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:55:19.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:19 smithi164 ceph-mon[34236]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:19.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:19 smithi164 ceph-mon[34236]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:55:19.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:19 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/453299939' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"} : dispatch 2024-09-21T02:55:19.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:19 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"} : dispatch 2024-09-21T02:55:19.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:19 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"}]': finished 2024-09-21T02:55:19.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:19 smithi164 ceph-mon[34236]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T02:55:19.904 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:19 smithi181 ceph-mon[34096]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:19 smithi181 ceph-mon[34096]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:55:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:19 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/453299939' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"} : dispatch 2024-09-21T02:55:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:19 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"} : dispatch 2024-09-21T02:55:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:19 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"}]': finished 2024-09-21T02:55:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:19 smithi181 ceph-mon[34096]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T02:55:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:19 smithi081 ceph-mon[30991]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:55:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:19 smithi081 ceph-mon[30991]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:55:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:19 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/453299939' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"} : dispatch 2024-09-21T02:55:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:19 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"} : dispatch 2024-09-21T02:55:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:19 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86891d46-f33c-4a5f-a736-373042a6b9c5"}]': finished 2024-09-21T02:55:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:19 smithi081 ceph-mon[30991]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T02:55:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:20.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:20 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/1385429892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:55:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:20 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/1385429892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:55:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:20 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/1385429892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:55:21.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:21 smithi164 ceph-mon[34236]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:21.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:21 smithi181 ceph-mon[34096]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:21 smithi081 ceph-mon[30991]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:22.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:22 smithi164 ceph-mon[34236]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:22.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:22 smithi181 ceph-mon[34096]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:23.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:22 smithi081 ceph-mon[30991]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:24.927 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:24 smithi164 ceph-mon[34236]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:24.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:24 smithi181 ceph-mon[34096]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:25.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:24 smithi081 ceph-mon[30991]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:26.898 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:26 smithi164 ceph-mon[34236]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:26.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:26 smithi181 ceph-mon[34096]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:26 smithi081 ceph-mon[30991]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:28.925 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:28 smithi164 ceph-mon[34236]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:28.926 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:55:28.926 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:28.926 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:28 smithi164 ceph-mon[34236]: Deploying daemon osd.7 on smithi164 2024-09-21T02:55:28.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:28 smithi181 ceph-mon[34096]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:55:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:28.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:28 smithi181 ceph-mon[34096]: Deploying daemon osd.7 on smithi164 2024-09-21T02:55:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:28 smithi081 ceph-mon[30991]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:55:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:29.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:28 smithi081 ceph-mon[30991]: Deploying daemon osd.7 on smithi164 2024-09-21T02:55:30.776 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:30 smithi164 ceph-mon[34236]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:30.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:30 smithi181 ceph-mon[34096]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:31.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:30 smithi081 ceph-mon[30991]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:32.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:32 smithi164 ceph-mon[34236]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:32.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:32 smithi181 ceph-mon[34096]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:33.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:32 smithi081 ceph-mon[30991]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:34 smithi164 ceph-mon[34236]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:34.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:34 smithi181 ceph-mon[34096]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:34.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:34 smithi081 ceph-mon[30991]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:36.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:36 smithi181 ceph-mon[34096]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:37.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:36 smithi081 ceph-mon[30991]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:37.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:36 smithi164 ceph-mon[34236]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:37.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.982+0000 7fe17bfff640 1 -- 172.21.15.164:0/4053999272 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe194063800 con 0x7fe17c0b6510 2024-09-21T02:55:37.983 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 7 on host 'smithi164' 2024-09-21T02:55:37.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.984+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe17c0b6510 msgr2=0x7fe17c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:37.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.984+0000 7fe199630640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe17c0b6510 0x7fe17c0b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe188009fc0 tx=0x7fe188005f90 comp rx=0 tx=0).stop 2024-09-21T02:55:37.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 msgr2=0x7fe194199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:37.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194199ec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe184009230 tx=0x7fe1840040c0 comp rx=0 tx=0).stop 2024-09-21T02:55:37.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 shutdown_connections 2024-09-21T02:55:37.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe17c0b6510 0x7fe17c0b8a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:37.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe194109500 0x7fe19419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe194106ba0 0x7fe19419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 --2- 172.21.15.164:0/4053999272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe194101b00 0x7fe194199ec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 >> 172.21.15.164:0/4053999272 conn(0x7fe1940fd770 msgr2=0x7fe194107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:55:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 shutdown_connections 2024-09-21T02:55:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:55:37.985+0000 7fe199630640 1 -- 172.21.15.164:0/4053999272 wait complete. 2024-09-21T02:55:38.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:38.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:38.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:38.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:38.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:38.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:38.613 DEBUG:teuthology.orchestra.run.smithi164:osd.7> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T02:55:38.616 INFO:tasks.cephadm:Deploying osd.8 on smithi181 with /dev/vg_nvme/lv_2... 2024-09-21T02:55:38.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:55:38.871 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:55:38.991 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:38 smithi181 ceph-mon[34096]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:38.992 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:38.992 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:38.992 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:39.022 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:38 smithi164 ceph-mon[34236]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:39.023 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:39.023 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:39.023 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:38 smithi081 ceph-mon[30991]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:39.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:40.138 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 02:55:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T02:55:40.000+0000 7f1e44b6a640 -1 osd.7 0 log_to_monitors true 2024-09-21T02:55:41.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:40 smithi081 ceph-mon[30991]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:41.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:40 smithi081 ceph-mon[30991]: from='osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:55:41.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:40 smithi081 ceph-mon[30991]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:55:41.055 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:40 smithi181 ceph-mon[34096]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:41.055 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:40 smithi181 ceph-mon[34096]: from='osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:55:41.055 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:40 smithi181 ceph-mon[34096]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:55:41.058 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:40 smithi164 ceph-mon[34236]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:41.058 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:40 smithi164 ceph-mon[34236]: from='osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:55:41.058 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:40 smithi164 ceph-mon[34236]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:55:41.343 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:55:41.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-09-21T02:55:41.624 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi164 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi164 to 5696M 2024-09-21T02:55:42.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:42.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:42.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:41 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi164 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi164 to 5696M 2024-09-21T02:55:42.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:42.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:42.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:41 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.094+0000 7f4168e22640 1 -- 172.21.15.181:0/1299375043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4164106900 msgr2=0x7f4164108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:42.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.094+0000 7f4168e22640 1 --2- 172.21.15.181:0/1299375043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4164106900 0x7f4164108d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4158009900 tx=0x7f415802a410 comp rx=0 tx=0).stop 2024-09-21T02:55:42.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.094+0000 7f4168e22640 1 -- 172.21.15.181:0/1299375043 shutdown_connections 2024-09-21T02:55:42.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.094+0000 7f4168e22640 1 --2- 172.21.15.181:0/1299375043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4164106900 0x7f4164108d60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.094+0000 7f4168e22640 1 --2- 172.21.15.181:0/1299375043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41641094a0 0x7f416410b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.094+0000 7f4168e22640 1 --2- 172.21.15.181:0/1299375043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f416406c340 0x7f41641063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.095+0000 7f4168e22640 1 -- 172.21.15.181:0/1299375043 >> 172.21.15.181:0/1299375043 conn(0x7f41640fdfe0 msgr2=0x7f4164100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.095+0000 7f4168e22640 1 -- 172.21.15.181:0/1299375043 shutdown_connections 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.095+0000 7f4168e22640 1 -- 172.21.15.181:0/1299375043 wait complete. 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.095+0000 7f4168e22640 1 Processor -- start 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.095+0000 7f4168e22640 1 -- start start 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4168e22640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f416406c340 0x7f416419c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4168e22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164106900 0x7f416419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4168e22640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41641094a0 0x7f416419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4168e22640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f416410f260 con 0x7f4164106900 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4168e22640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f416410f0e0 con 0x7f416406c340 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4168e22640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f416410f3e0 con 0x7f41641094a0 2024-09-21T02:55:42.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41641094a0 0x7f416419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f416259c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f416406c340 0x7f416419c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41641094a0 0x7f416419d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:56878/0 (socket says 172.21.15.181:56878) 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 -- 172.21.15.181:0/467619418 learned_addr learned my addr 172.21.15.181:0/467619418 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4161d9b640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164106900 0x7f416419c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 -- 172.21.15.181:0/467619418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f416406c340 msgr2=0x7f416419c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f416406c340 0x7f416419c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 -- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164106900 msgr2=0x7f416419c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164106900 0x7f416419c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 -- 172.21.15.181:0/467619418 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416419db40 con 0x7f41641094a0 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f416259c640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f416406c340 0x7f416419c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f4162d9d640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41641094a0 0x7f416419d320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f415c00eb10 tx=0x7f415c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.096+0000 7f41537fe640 1 -- 172.21.15.181:0/467619418 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c004b20 con 0x7f41641094a0 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.097+0000 7f41537fe640 1 -- 172.21.15.181:0/467619418 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f415c004cc0 con 0x7f41641094a0 2024-09-21T02:55:42.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.097+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416419de30 con 0x7f41641094a0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.097+0000 7f41537fe640 1 -- 172.21.15.181:0/467619418 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c010690 con 0x7f41641094a0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.097+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41641a4530 con 0x7f41641094a0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.098+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41641a4700 con 0x7f41641094a0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.099+0000 7f41537fe640 1 -- 172.21.15.181:0/467619418 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f415c005000 con 0x7f41641094a0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.100+0000 7f41537fe640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f414c0b6510 0x7f414c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.100+0000 7f41537fe640 1 -- 172.21.15.181:0/467619418 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f415c0e6df0 con 0x7f41641094a0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.100+0000 7f416259c640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f414c0b6510 0x7f414c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.101+0000 7f416259c640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f414c0b6510 0x7f414c0b8a20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f415400bfd0 tx=0x7f415400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:55:42.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.103+0000 7f41537fe640 1 -- 172.21.15.181:0/467619418 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f415c056710 con 0x7f41641094a0 2024-09-21T02:55:42.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi164 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi164 to 5696M 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:42.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:55:42.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:41 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:55:42.291+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f416410b4e0 con 0x7f414c0b6510 2024-09-21T02:55:42.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T02:55:42.196+0000 7f1e40aec640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T02:55:42.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T02:55:42.205+0000 7f1e388e2640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:55:42.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:42.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:55:42.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:55:42.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:42.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:42.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='osd.7 ' entity='osd.7' 2024-09-21T02:55:42.930 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:42.931 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:55:42.931 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:55:42.931 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:42 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='osd.7 ' entity='osd.7' 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:55:43.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:55:43.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:42 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='osd.7 ' entity='osd.7' 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:55:43.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:42 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:43.964 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:43 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:55:43.964 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:43 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:55:43.964 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:43 smithi181 ceph-mon[34096]: osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] boot 2024-09-21T02:55:43.964 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:43 smithi181 ceph-mon[34096]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T02:55:43.965 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:43 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:44.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:43 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:55:44.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:43 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:55:44.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:43 smithi081 ceph-mon[30991]: osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] boot 2024-09-21T02:55:44.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:43 smithi081 ceph-mon[30991]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T02:55:44.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:43 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:44.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:43 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:55:44.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:43 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:55:44.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:43 smithi164 ceph-mon[34236]: osd.7 [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] boot 2024-09-21T02:55:44.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:43 smithi164 ceph-mon[34236]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T02:55:44.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:43 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:55:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:44 smithi081 ceph-mon[30991]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:44 smithi081 ceph-mon[30991]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:55:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:44 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/34233121' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"} : dispatch 2024-09-21T02:55:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:44 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"} : dispatch 2024-09-21T02:55:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:44 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"}]': finished 2024-09-21T02:55:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:44 smithi081 ceph-mon[30991]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T02:55:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:55:45.056 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:44 smithi181 ceph-mon[34096]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:45.056 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:44 smithi181 ceph-mon[34096]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:55:45.056 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:44 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/34233121' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"} : dispatch 2024-09-21T02:55:45.056 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:44 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"} : dispatch 2024-09-21T02:55:45.056 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:44 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"}]': finished 2024-09-21T02:55:45.056 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:44 smithi181 ceph-mon[34096]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T02:55:45.056 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:55:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:44 smithi164 ceph-mon[34236]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:55:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:44 smithi164 ceph-mon[34236]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:55:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:44 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/34233121' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"} : dispatch 2024-09-21T02:55:45.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:44 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"} : dispatch 2024-09-21T02:55:45.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:44 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ceaa3ef3-df5f-4349-8798-cd94dc9f8610"}]': finished 2024-09-21T02:55:45.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:44 smithi164 ceph-mon[34236]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T02:55:45.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:55:46.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:45 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/854384999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:55:46.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:45 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/854384999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:55:46.304 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:45 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/854384999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:55:47.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:46 smithi164 ceph-mon[34236]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:55:47.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:46 smithi181 ceph-mon[34096]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:55:47.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:46 smithi081 ceph-mon[30991]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:55:49.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:48 smithi164 ceph-mon[34236]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:55:49.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:48 smithi181 ceph-mon[34096]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:55:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:48 smithi081 ceph-mon[30991]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:55:50.985 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:50 smithi181 ceph-mon[34096]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T02:55:51.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:50 smithi081 ceph-mon[30991]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T02:55:51.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:50 smithi164 ceph-mon[34236]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T02:55:53.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:52 smithi164 ceph-mon[34236]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:55:53.182 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:52 smithi181 ceph-mon[34096]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:55:53.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:52 smithi081 ceph-mon[30991]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:55:53.919 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:53 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:55:53.920 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:53 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:53.920 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:53 smithi181 ceph-mon[34096]: Deploying daemon osd.8 on smithi181 2024-09-21T02:55:54.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:53 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:55:54.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:53 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:54.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:53 smithi164 ceph-mon[34236]: Deploying daemon osd.8 on smithi181 2024-09-21T02:55:54.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:53 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:55:54.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:53 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:55:54.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:53 smithi081 ceph-mon[30991]: Deploying daemon osd.8 on smithi181 2024-09-21T02:55:54.912 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:54 smithi181 ceph-mon[34096]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:55:55.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:54 smithi164 ceph-mon[34236]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:55:55.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:54 smithi081 ceph-mon[30991]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:55:56.928 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:56 smithi181 ceph-mon[34096]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T02:55:57.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:56 smithi164 ceph-mon[34236]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T02:55:57.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:56 smithi081 ceph-mon[30991]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T02:55:58.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:58 smithi181 ceph-mon[34096]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:55:59.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:58 smithi164 ceph-mon[34236]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:55:59.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:58 smithi081 ceph-mon[30991]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:55:59.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:55:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:55:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:55:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:55:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:00.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:00.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:00.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:55:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:01.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:01 smithi081 ceph-mon[30991]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:01.567 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:01 smithi181 ceph-mon[34096]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:01.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:01 smithi164 ceph-mon[34236]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:02 smithi181 ceph-mon[34096]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:02.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.065+0000 7f41537fe640 1 -- 172.21.15.181:0/467619418 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f416410b4e0 con 0x7f414c0b6510 2024-09-21T02:56:03.067 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 8 on host 'smithi181' 2024-09-21T02:56:03.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f414c0b6510 msgr2=0x7f414c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f414c0b6510 0x7f414c0b8a20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f415400bfd0 tx=0x7f415400b390 comp rx=0 tx=0).stop 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41641094a0 msgr2=0x7f416419d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41641094a0 0x7f416419d320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f415c00eb10 tx=0x7f415c00c2d0 comp rx=0 tx=0).stop 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 shutdown_connections 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f414c0b6510 0x7f414c0b8a20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41641094a0 0x7f416419d320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4164106900 0x7f416419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 --2- 172.21.15.181:0/467619418 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f416406c340 0x7f416419c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 >> 172.21.15.181:0/467619418 conn(0x7f41640fdfe0 msgr2=0x7f4164100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 shutdown_connections 2024-09-21T02:56:03.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:03.068+0000 7f4168e22640 1 -- 172.21.15.181:0/467619418 wait complete. 2024-09-21T02:56:03.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:02 smithi164 ceph-mon[34236]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:03.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:03.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:03.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:02 smithi081 ceph-mon[30991]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:03.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:03.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:03.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.679 DEBUG:teuthology.orchestra.run.smithi181:osd.8> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T02:56:03.682 INFO:tasks.cephadm:Deploying osd.9 on smithi081 with /dev/vg_nvme/lv_1... 2024-09-21T02:56:03.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:56:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:56:03.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:03.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:03.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:04.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:04.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:04.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:04.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:04.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:04.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:05.166 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:05 smithi181 ceph-mon[34096]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:05.380 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:05 smithi081 ceph-mon[30991]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:05.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:05 smithi164 ceph-mon[34236]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:05.839 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 02:56:05 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T02:56:05.586+0000 7f65413e2640 -1 osd.8 0 log_to_monitors true 2024-09-21T02:56:06.209 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:06 smithi181 ceph-mon[34096]: from='osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:56:06.209 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:06 smithi181 ceph-mon[34096]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:56:06.276 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:06 smithi081 ceph-mon[30991]: from='osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:56:06.276 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:06 smithi081 ceph-mon[30991]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:56:06.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:06 smithi164 ceph-mon[34236]: from='osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:56:06.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:06 smithi164 ceph-mon[34236]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:56:06.689 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:56:06.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-09-21T02:56:06.974 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi181 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi181 to 5695M 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:07.349 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:07.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi181 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi181 to 5695M 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:07.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2945979085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1241036d0 msgr2=0x7fe124103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2945979085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1241036d0 0x7fe124103ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe118009900 tx=0x7fe11802a480 comp rx=0 tx=0).stop 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2945979085 shutdown_connections 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2945979085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe124104070 0x7fe12410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2945979085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1241036d0 0x7fe124103ae0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2945979085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe124102640 0x7fe124102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2945979085 >> 172.21.15.81:0/2945979085 conn(0x7fe1240fdfb0 msgr2=0x7fe124100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2945979085 shutdown_connections 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.440+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2945979085 wait complete. 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 Processor -- start 2024-09-21T02:56:07.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 -- start start 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe124102640 0x7fe12406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1241036d0 0x7fe12419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe124104070 0x7fe1241a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe12410e140 con 0x7fe124104070 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe12410dfc0 con 0x7fe1241036d0 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe12a3f4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe12410e2c0 con 0x7fe124102640 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.441+0000 7fe128991640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe124104070 0x7fe1241a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe123fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe124102640 0x7fe12406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe124104070 0x7fe1241a1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54362/0 (socket says 172.21.15.81:54362) 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 -- 172.21.15.81:0/2287508718 learned_addr learned my addr 172.21.15.81:0/2287508718 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe1237fe640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1241036d0 0x7fe12419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:07.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 -- 172.21.15.81:0/2287508718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe124102640 msgr2=0x7fe12406b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe124102640 0x7fe12406b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 -- 172.21.15.81:0/2287508718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1241036d0 msgr2=0x7fe12419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1241036d0 0x7fe12419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 -- 172.21.15.81:0/2287508718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1241a1a00 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe128991640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe124104070 0x7fe1241a1200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00cad0 tx=0x7fe11c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe1217fa640 1 -- 172.21.15.81:0/2287508718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00ae20 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe1217fa640 1 -- 172.21.15.81:0/2287508718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe11c005020 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1241a1cf0 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe1217fa640 1 -- 172.21.15.81:0/2287508718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00f6b0 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.442+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1241a2180 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.443+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe124109820 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.445+0000 7fe1217fa640 1 -- 172.21.15.81:0/2287508718 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe11c0051d0 con 0x7fe124104070 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.446+0000 7fe1217fa640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe10c0b6590 0x7fe10c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:07.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.446+0000 7fe123fff640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe10c0b6590 0x7fe10c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.446+0000 7fe1217fa640 1 -- 172.21.15.81:0/2287508718 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7fe11c0e6c10 con 0x7fe124104070 2024-09-21T02:56:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.446+0000 7fe123fff640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe10c0b6590 0x7fe10c0b8aa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe114009bd0 tx=0x7fe114005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:56:07.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.449+0000 7fe1217fa640 1 -- 172.21.15.81:0/2287508718 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe11c014030 con 0x7fe124104070 2024-09-21T02:56:07.499 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T02:56:07.088+0000 7f653d364640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T02:56:07.499 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T02:56:07.097+0000 7f6539162640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:56:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:56:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T02:56:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:56:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:56:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi181 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi181 to 5695M 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:07.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:07.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:07.639+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe124063800 con 0x7fe10c0b6590 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:56:08.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:08.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:56:08.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:56:08.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:08.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:08.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:08.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:56:08.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:56:08.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:08.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:56:08.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:56:08.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:08.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:08.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:08.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:56:08.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:56:08.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:09.417 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:09 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:56:09.417 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:09 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:56:09.417 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:09 smithi081 ceph-mon[30991]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:09.417 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:09.417 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:09 smithi081 ceph-mon[30991]: osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] boot 2024-09-21T02:56:09.417 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:09 smithi081 ceph-mon[30991]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T02:56:09.417 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:09 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:56:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:09 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:56:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:09 smithi164 ceph-mon[34236]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:09.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:09.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:09 smithi164 ceph-mon[34236]: osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] boot 2024-09-21T02:56:09.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:09 smithi164 ceph-mon[34236]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T02:56:09.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:09.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:09 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:56:09.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:09 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:56:09.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:09 smithi181 ceph-mon[34096]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:56:09.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:09.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:09 smithi181 ceph-mon[34096]: osd.8 [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] boot 2024-09-21T02:56:09.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:09 smithi181 ceph-mon[34096]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T02:56:09.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:56:10.401 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:10 smithi081 ceph-mon[30991]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T02:56:10.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:10 smithi164 ceph-mon[34236]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T02:56:10.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:10 smithi181 ceph-mon[34096]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T02:56:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:11 smithi164 ceph-mon[34236]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:11 smithi164 ceph-mon[34236]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:56:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:11 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/628253126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9b8dcc89-4e4a-4834-9953-d7dfc14fa192"} : dispatch 2024-09-21T02:56:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:11 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/628253126' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b8dcc89-4e4a-4834-9953-d7dfc14fa192"}]': finished 2024-09-21T02:56:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:11 smithi164 ceph-mon[34236]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T02:56:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:11.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:11 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1008016555' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:56:11.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:11 smithi181 ceph-mon[34096]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:11 smithi181 ceph-mon[34096]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:56:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:11 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/628253126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9b8dcc89-4e4a-4834-9953-d7dfc14fa192"} : dispatch 2024-09-21T02:56:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:11 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/628253126' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b8dcc89-4e4a-4834-9953-d7dfc14fa192"}]': finished 2024-09-21T02:56:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:11 smithi181 ceph-mon[34096]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T02:56:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:11.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:11 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1008016555' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:56:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:11 smithi081 ceph-mon[30991]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:11 smithi081 ceph-mon[30991]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:56:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:11 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/628253126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9b8dcc89-4e4a-4834-9953-d7dfc14fa192"} : dispatch 2024-09-21T02:56:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:11 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/628253126' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b8dcc89-4e4a-4834-9953-d7dfc14fa192"}]': finished 2024-09-21T02:56:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:11 smithi081 ceph-mon[30991]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T02:56:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:11 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1008016555' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:56:13.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:13 smithi164 ceph-mon[34236]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:13.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:13 smithi181 ceph-mon[34096]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:13.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:13 smithi081 ceph-mon[30991]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:15.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:15 smithi081 ceph-mon[30991]: pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:15.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:15 smithi164 ceph-mon[34236]: pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:15.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:15 smithi181 ceph-mon[34096]: pgmap v207: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:17.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:17 smithi081 ceph-mon[30991]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T02:56:17.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:17 smithi164 ceph-mon[34236]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T02:56:17.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:17 smithi181 ceph-mon[34096]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-21T02:56:19.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:19 smithi164 ceph-mon[34236]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:56:19.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:19 smithi181 ceph-mon[34096]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:56:19.511 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:19 smithi081 ceph-mon[30991]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:56:20.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:56:20.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:20.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:20 smithi164 ceph-mon[34236]: Deploying daemon osd.9 on smithi081 2024-09-21T02:56:20.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:56:20.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:20.472 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:20 smithi081 ceph-mon[30991]: Deploying daemon osd.9 on smithi081 2024-09-21T02:56:20.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:56:20.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:20.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:20 smithi181 ceph-mon[34096]: Deploying daemon osd.9 on smithi081 2024-09-21T02:56:21.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:21 smithi164 ceph-mon[34236]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T02:56:21.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:21 smithi181 ceph-mon[34096]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T02:56:21.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:21 smithi081 ceph-mon[30991]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T02:56:23.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:23 smithi081 ceph-mon[30991]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T02:56:23.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:23 smithi164 ceph-mon[34236]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T02:56:23.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:23 smithi181 ceph-mon[34096]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T02:56:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:25 smithi081 ceph-mon[30991]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:25.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:25 smithi164 ceph-mon[34236]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:25.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:25 smithi181 ceph-mon[34096]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:26.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:26 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:26.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:26 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:26.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:26 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:26.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:26 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:26.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:26 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:26.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:26 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:26.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:26 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:26.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:26 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:26.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:26 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:27.265 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:27 smithi081 ceph-mon[30991]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:27 smithi181 ceph-mon[34096]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:27.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:27 smithi164 ceph-mon[34236]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:56:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.098+0000 7fe1217fa640 1 -- 172.21.15.81:0/2287508718 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe124063800 con 0x7fe10c0b6590 2024-09-21T02:56:29.100 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 9 on host 'smithi081' 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.101+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe10c0b6590 msgr2=0x7fe10c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.101+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe10c0b6590 0x7fe10c0b8aa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe114009bd0 tx=0x7fe114005f90 comp rx=0 tx=0).stop 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.101+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe124104070 msgr2=0x7fe1241a1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.101+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe124104070 0x7fe1241a1200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00cad0 tx=0x7fe11c00cf90 comp rx=0 tx=0).stop 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 shutdown_connections 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe10c0b6590 0x7fe10c0b8aa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe124104070 0x7fe1241a1200 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1241036d0 0x7fe12419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 --2- 172.21.15.81:0/2287508718 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe124102640 0x7fe12406b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 >> 172.21.15.81:0/2287508718 conn(0x7fe1240fdfb0 msgr2=0x7fe1241069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:56:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 shutdown_connections 2024-09-21T02:56:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:56:29.102+0000 7fe12a3f4640 1 -- 172.21.15.81:0/2287508718 wait complete. 2024-09-21T02:56:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:29.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:29.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:29 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.729 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:29 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:29 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:29.755 DEBUG:teuthology.orchestra.run.smithi081:osd.9> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T02:56:29.757 INFO:tasks.cephadm:Deploying osd.10 on smithi164 with /dev/vg_nvme/lv_1... 2024-09-21T02:56:29.757 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:56:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:56:31.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:31 smithi081 ceph-mon[30991]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:31.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:31 smithi081 ceph-mon[30991]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:56:31.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 02:56:31 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T02:56:31.308+0000 7f8a8a71f640 -1 osd.9 0 log_to_monitors true 2024-09-21T02:56:31.626 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:31 smithi164 ceph-mon[34236]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:31.626 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:31 smithi164 ceph-mon[34236]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:56:31.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:31 smithi181 ceph-mon[34096]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:31.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:31 smithi181 ceph-mon[34096]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:56:32.591 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:32 smithi164 ceph-mon[34236]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:56:32.591 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:32 smithi164 ceph-mon[34236]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T02:56:32.591 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:32 smithi164 ceph-mon[34236]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:56:32.591 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:32 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:32.591 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:32 smithi164 ceph-mon[34236]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:56:32.591 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:32 smithi164 ceph-mon[34236]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:56:32.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-mon[30991]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:56:32.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-mon[30991]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T02:56:32.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-mon[30991]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:56:32.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:32.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-mon[30991]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:56:32.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-mon[30991]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:56:32.720 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-21T02:56:32.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:32 smithi181 ceph-mon[34096]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:56:32.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:32 smithi181 ceph-mon[34096]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T02:56:32.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:32 smithi181 ceph-mon[34096]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]} : dispatch 2024-09-21T02:56:32.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:32 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:32.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:32 smithi181 ceph-mon[34096]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-21T02:56:32.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:32 smithi181 ceph-mon[34096]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:56:32.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi164:vg_nvme/lv_1 2024-09-21T02:56:33.008 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:56:33.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T02:56:32.769+0000 7f8a866a1640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T02:56:33.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 02:56:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T02:56:32.782+0000 7f8a7e497640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' 2024-09-21T02:56:33.380 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:33 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 -- 172.21.15.164:0/3772824809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 msgr2=0x7fb87410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 --2- 172.21.15.164:0/3772824809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87410bb20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009ca0 tx=0x7fb86c02a950 comp rx=0 tx=0).stop 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 -- 172.21.15.164:0/3772824809 shutdown_connections 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 --2- 172.21.15.164:0/3772824809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87410bb20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 --2- 172.21.15.164:0/3772824809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8741047e0 0x7fb874104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 --2- 172.21.15.164:0/3772824809 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb874103750 0x7fb874103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 -- 172.21.15.164:0/3772824809 >> 172.21.15.164:0/3772824809 conn(0x7fb8740ff0c0 msgr2=0x7fb874101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 -- 172.21.15.164:0/3772824809 shutdown_connections 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.501+0000 7fb87bc15640 1 -- 172.21.15.164:0/3772824809 wait complete. 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 Processor -- start 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 -- start start 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb874103750 0x7fb874199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8741047e0 0x7fb87419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87419b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb87410f250 con 0x7fb8741047e0 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb87410f0d0 con 0x7fb874105180 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87bc15640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb87410f3d0 con 0x7fb874103750 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87419b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87419b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34226/0 (socket says 172.21.15.164:34226) 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 -- 172.21.15.164:0/167935696 learned_addr learned my addr 172.21.15.164:0/167935696 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb8799b1640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb874103750 0x7fb874199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb8791b0640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8741047e0 0x7fb87419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 -- 172.21.15.164:0/167935696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb874103750 msgr2=0x7fb874199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb874103750 0x7fb874199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 -- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8741047e0 msgr2=0x7fb87419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8741047e0 0x7fb87419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.502+0000 7fb87a1b2640 1 -- 172.21.15.164:0/167935696 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87419b8c0 con 0x7fb874105180 2024-09-21T02:56:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.503+0000 7fb87a1b2640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87419b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb86c02f800 tx=0x7fb86c003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:56:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.503+0000 7fb866ffd640 1 -- 172.21.15.164:0/167935696 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c034040 con 0x7fb874105180 2024-09-21T02:56:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.503+0000 7fb866ffd640 1 -- 172.21.15.164:0/167935696 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb86c030850 con 0x7fb874105180 2024-09-21T02:56:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.503+0000 7fb866ffd640 1 -- 172.21.15.164:0/167935696 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c039430 con 0x7fb874105180 2024-09-21T02:56:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.503+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87419bb50 con 0x7fb874105180 2024-09-21T02:56:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.503+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8741a22b0 con 0x7fb874105180 2024-09-21T02:56:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.504+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb874103bc0 con 0x7fb874105180 2024-09-21T02:56:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.506+0000 7fb866ffd640 1 -- 172.21.15.164:0/167935696 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb86c037020 con 0x7fb874105180 2024-09-21T02:56:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.506+0000 7fb866ffd640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb8600b6590 0x7fb8600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.506+0000 7fb8799b1640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb8600b6590 0x7fb8600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.506+0000 7fb866ffd640 1 -- 172.21.15.164:0/167935696 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5981+0+0 (secure 0 0 0) 0x7fb86c1079a0 con 0x7fb874105180 2024-09-21T02:56:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.507+0000 7fb8799b1640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb8600b6590 0x7fb8600b8aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb870005fd0 tx=0x7fb87000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:56:33.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.509+0000 7fb866ffd640 1 -- 172.21.15.164:0/167935696 <== mon.2 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb86c0cebe0 con 0x7fb874105180 2024-09-21T02:56:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:33.700+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb874063800 con 0x7fb8600b6590 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' 2024-09-21T02:56:33.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:33 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074]' entity='osd.9' 2024-09-21T02:56:33.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:33 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:34.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:56:34.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:56:34.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi081 2024-09-21T02:56:34.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-21T02:56:34.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:56:34.651 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:56:34.651 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:34.651 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] boot 2024-09-21T02:56:34.651 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T02:56:34.651 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:34 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:34.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:56:34.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:56:34.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi081 2024-09-21T02:56:34.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-21T02:56:34.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:56:34.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:56:34.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:34.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] boot 2024-09-21T02:56:34.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T02:56:34.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:34 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi081 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: osd.9 [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] boot 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T02:56:34.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:34 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:56:35.405 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:35 smithi164 ceph-mon[34236]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:35.405 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:35 smithi164 ceph-mon[34236]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:35.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:35 smithi181 ceph-mon[34096]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:35.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:35 smithi181 ceph-mon[34096]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:35 smithi081 ceph-mon[30991]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:56:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:35 smithi081 ceph-mon[30991]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:36.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:36 smithi164 ceph-mon[34236]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T02:56:36.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:36 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/172796390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"} : dispatch 2024-09-21T02:56:36.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:36 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"} : dispatch 2024-09-21T02:56:36.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:36 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"}]': finished 2024-09-21T02:56:36.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:36 smithi164 ceph-mon[34236]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T02:56:36.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:36 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:36.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:36 smithi181 ceph-mon[34096]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T02:56:36.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:36 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/172796390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"} : dispatch 2024-09-21T02:56:36.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:36 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"} : dispatch 2024-09-21T02:56:36.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:36 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"}]': finished 2024-09-21T02:56:36.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:36 smithi181 ceph-mon[34096]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T02:56:36.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:36 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:36 smithi081 ceph-mon[30991]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T02:56:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:36 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/172796390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"} : dispatch 2024-09-21T02:56:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:36 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"} : dispatch 2024-09-21T02:56:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:36 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f305743b-43b9-4558-95da-9c59836d2655"}]': finished 2024-09-21T02:56:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:36 smithi081 ceph-mon[30991]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T02:56:36.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:36 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:37.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:37 smithi164 ceph-mon[34236]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:37.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:37 smithi164 ceph-mon[34236]: from='client.? 172.21.15.164:0/481694737' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:56:37.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:37 smithi181 ceph-mon[34096]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:37.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:37 smithi181 ceph-mon[34096]: from='client.? 172.21.15.164:0/481694737' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:56:37.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:37 smithi081 ceph-mon[30991]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:37.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:37 smithi081 ceph-mon[30991]: from='client.? 172.21.15.164:0/481694737' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:56:39.607 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:39 smithi081 ceph-mon[30991]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:39.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:39 smithi164 ceph-mon[34236]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:39.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:39 smithi181 ceph-mon[34096]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:41.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:41 smithi164 ceph-mon[34236]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:41.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:41 smithi181 ceph-mon[34096]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:41.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:41 smithi081 ceph-mon[30991]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:43.604 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:43 smithi164 ceph-mon[34236]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:43.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:43 smithi181 ceph-mon[34096]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:43.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:43 smithi081 ceph-mon[30991]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:45.508 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:45 smithi164 ceph-mon[34236]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:45.508 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:56:45.508 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:45 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:45.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:45 smithi181 ceph-mon[34096]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:45.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:56:45.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:45 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:45.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:45 smithi081 ceph-mon[30991]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:45.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:56:45.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:45 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:46.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:46 smithi164 ceph-mon[34236]: Deploying daemon osd.10 on smithi164 2024-09-21T02:56:46.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:46 smithi181 ceph-mon[34096]: Deploying daemon osd.10 on smithi164 2024-09-21T02:56:46.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:46 smithi081 ceph-mon[30991]: Deploying daemon osd.10 on smithi164 2024-09-21T02:56:47.612 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:47 smithi164 ceph-mon[34236]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:47.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:47 smithi181 ceph-mon[34096]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:47.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:47 smithi081 ceph-mon[30991]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:49.628 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:49 smithi164 ceph-mon[34236]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:49.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:49 smithi181 ceph-mon[34096]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:49 smithi081 ceph-mon[30991]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:51.524 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:51 smithi164 ceph-mon[34236]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:51.525 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:51 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:51.525 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:51 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:51.525 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:51 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:51.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:51 smithi181 ceph-mon[34096]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:51 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:51 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:51 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:51.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:51 smithi081 ceph-mon[30991]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:51.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:51 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:51.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:51 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:51.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:51 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:53.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:53 smithi164 ceph-mon[34236]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:53.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:53 smithi181 ceph-mon[34096]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:53.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:53 smithi081 ceph-mon[30991]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:54.413 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 10 on host 'smithi164' 2024-09-21T02:56:54.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.411+0000 7fb866ffd640 1 -- 172.21.15.164:0/167935696 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb874063800 con 0x7fb8600b6590 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb8600b6590 msgr2=0x7fb8600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb8600b6590 0x7fb8600b8aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb870005fd0 tx=0x7fb87000b390 comp rx=0 tx=0).stop 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 msgr2=0x7fb87419b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87419b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb86c02f800 tx=0x7fb86c003f90 comp rx=0 tx=0).stop 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 shutdown_connections 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb8600b6590 0x7fb8600b8aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb874105180 0x7fb87419b0a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8741047e0 0x7fb87419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 --2- 172.21.15.164:0/167935696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb874103750 0x7fb874199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 >> 172.21.15.164:0/167935696 conn(0x7fb8740ff0c0 msgr2=0x7fb874107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:56:54.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 shutdown_connections 2024-09-21T02:56:54.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-21T02:56:54.414+0000 7fb87bc15640 1 -- 172.21.15.164:0/167935696 wait complete. 2024-09-21T02:56:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:54 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:54.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:54 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:55.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:54 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:55.110 DEBUG:teuthology.orchestra.run.smithi164:osd.10> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T02:56:55.112 INFO:tasks.cephadm:Deploying osd.11 on smithi181 with /dev/vg_nvme/lv_1... 2024-09-21T02:56:55.112 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:56:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:56:55.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:55 smithi181 ceph-mon[34096]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:55.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:55 smithi164 ceph-mon[34236]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:56.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:55 smithi081 ceph-mon[30991]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:57.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 02:56:57 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T02:56:57.169+0000 7f4b07842640 -1 osd.10 0 log_to_monitors true 2024-09-21T02:56:57.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:57 smithi181 ceph-mon[34096]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:57.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:57 smithi181 ceph-mon[34096]: from='osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:56:57.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:57 smithi181 ceph-mon[34096]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:56:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:57 smithi164 ceph-mon[34236]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:57 smithi164 ceph-mon[34236]: from='osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:56:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:57 smithi164 ceph-mon[34236]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:56:57.961 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-21T02:56:57.987 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi181:vg_nvme/lv_1 2024-09-21T02:56:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:57 smithi081 ceph-mon[30991]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:57 smithi081 ceph-mon[30991]: from='osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:56:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:57 smithi081 ceph-mon[30991]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:56:58.243 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:56:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 -- 172.21.15.181:0/4018652552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 msgr2=0x7fad80105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 --2- 172.21.15.181:0/4018652552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80105140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fad74009900 tx=0x7fad7402a410 comp rx=0 tx=0).stop 2024-09-21T02:56:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 -- 172.21.15.181:0/4018652552 shutdown_connections 2024-09-21T02:56:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 --2- 172.21.15.181:0/4018652552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad801083a0 0x7fad8010a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 --2- 172.21.15.181:0/4018652552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad80105780 0x7fad80107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 --2- 172.21.15.181:0/4018652552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80105140 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 -- 172.21.15.181:0/4018652552 >> 172.21.15.181:0/4018652552 conn(0x7fad800fd760 msgr2=0x7fad800ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 -- 172.21.15.181:0/4018652552 shutdown_connections 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.705+0000 7fad87191640 1 -- 172.21.15.181:0/4018652552 wait complete. 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 Processor -- start 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 -- start start 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad80105780 0x7fad8019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad801083a0 0x7fad8019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad8010f280 con 0x7fad80105780 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fad8010f100 con 0x7fad801083a0 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad87191640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fad8010f400 con 0x7fad80102cc0 2024-09-21T02:56:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad84f2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad84f2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:50148/0 (socket says 172.21.15.181:50148) 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.706+0000 7fad84f2d640 1 -- 172.21.15.181:0/3984004942 learned_addr learned my addr 172.21.15.181:0/3984004942 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad8572e640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad801083a0 0x7fad8019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad7ffff640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad80105780 0x7fad8019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad84f2d640 1 -- 172.21.15.181:0/3984004942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad801083a0 msgr2=0x7fad8019b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad84f2d640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad801083a0 0x7fad8019b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad84f2d640 1 -- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad80105780 msgr2=0x7fad8019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad84f2d640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad80105780 0x7fad8019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad84f2d640 1 -- 172.21.15.181:0/3984004942 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8019b910 con 0x7fad80102cc0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad84f2d640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80199ee0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad74009230 tx=0x7fad740040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad7dffb640 1 -- 172.21.15.181:0/3984004942 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7403f030 con 0x7fad80102cc0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad7dffb640 1 -- 172.21.15.181:0/3984004942 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad740044c0 con 0x7fad80102cc0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8019bba0 con 0x7fad80102cc0 2024-09-21T02:56:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad7dffb640 1 -- 172.21.15.181:0/3984004942 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74035070 con 0x7fad80102cc0 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.707+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad801a2130 con 0x7fad80102cc0 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.708+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad800ff280 con 0x7fad80102cc0 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.710+0000 7fad7dffb640 1 -- 172.21.15.181:0/3984004942 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fad74042030 con 0x7fad80102cc0 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.711+0000 7fad7dffb640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad700b6510 0x7fad700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.711+0000 7fad7dffb640 1 -- 172.21.15.181:0/3984004942 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6414+0+0 (secure 0 0 0) 0x7fad74107430 con 0x7fad80102cc0 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.711+0000 7fad7ffff640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad700b6510 0x7fad700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.712+0000 7fad7ffff640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad700b6510 0x7fad700b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00bbe0 tx=0x7fad6c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:56:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.714+0000 7fad7dffb640 1 -- 172.21.15.181:0/3984004942 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad740d2810 con 0x7fad80102cc0 2024-09-21T02:56:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:56:58.904+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fad80063800 con 0x7fad700b6510 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi164 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:58.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi164 to 4272M 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:59.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:58 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi164 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi164 to 4272M 2024-09-21T02:56:59.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:59.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:59.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:58 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]} : dispatch 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi164 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.132 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi164 to 4272M 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:56:59.133 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:58 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:56:59.431 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T02:56:59.130+0000 7f4b037c4640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T02:56:59.431 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T02:56:59.146+0000 7f4afb5ba640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:56:59.952 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:56:59.952 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:56:59.952 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:59.952 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:56:59.952 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:56:59.953 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:56:59.953 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:56:59.953 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:56:59.953 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:56:59 smithi181 ceph-mon[34096]: from='osd.10 ' entity='osd.10' 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:57:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:00.056 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:56:59 smithi081 ceph-mon[30991]: from='osd.10 ' entity='osd.10' 2024-09-21T02:57:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-09-21T02:57:00.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:57:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:57:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:57:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:00.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:56:59 smithi164 ceph-mon[34236]: from='osd.10 ' entity='osd.10' 2024-09-21T02:57:00.906 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:57:00.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:57:00.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:57:00.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:00.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] boot 2024-09-21T02:57:00.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T02:57:00.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:00.907 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:00 smithi181 ceph-mon[34096]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] boot 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:01.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:00 smithi081 ceph-mon[30991]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T02:57:01.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:57:01.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:57:01.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:57:01.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:01.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: osd.10 [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] boot 2024-09-21T02:57:01.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T02:57:01.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:57:01.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:00 smithi164 ceph-mon[34236]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T02:57:02.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:02 smithi181 ceph-mon[34096]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:57:02.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:02 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/2827076902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"} : dispatch 2024-09-21T02:57:02.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:02 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"} : dispatch 2024-09-21T02:57:02.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:02 smithi181 ceph-mon[34096]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"}]': finished 2024-09-21T02:57:02.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:02 smithi181 ceph-mon[34096]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T02:57:02.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:02 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:02.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:02 smithi181 ceph-mon[34096]: from='client.? 172.21.15.181:0/2744396281' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:57:02.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:02 smithi164 ceph-mon[34236]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:57:02.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:02 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/2827076902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"} : dispatch 2024-09-21T02:57:02.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:02 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"} : dispatch 2024-09-21T02:57:02.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:02 smithi164 ceph-mon[34236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"}]': finished 2024-09-21T02:57:02.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:02 smithi164 ceph-mon[34236]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T02:57:02.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:02 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:02.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:02 smithi164 ceph-mon[34236]: from='client.? 172.21.15.181:0/2744396281' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:57:02.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:02 smithi081 ceph-mon[30991]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:57:02.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:02 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/2827076902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"} : dispatch 2024-09-21T02:57:02.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:02 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"} : dispatch 2024-09-21T02:57:02.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:02 smithi081 ceph-mon[30991]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5"}]': finished 2024-09-21T02:57:02.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:02 smithi081 ceph-mon[30991]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T02:57:02.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:02 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:02.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:02 smithi081 ceph-mon[30991]: from='client.? 172.21.15.181:0/2744396281' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:57:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:03 smithi081 ceph-mon[30991]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:03 smithi164 ceph-mon[34236]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:03.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:03 smithi181 ceph-mon[34096]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:05.551 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:05 smithi181 ceph-mon[34096]: pgmap v243: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:05 smithi081 ceph-mon[30991]: pgmap v243: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:05.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:05 smithi164 ceph-mon[34236]: pgmap v243: 1 pgs: 1 peering; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:07 smithi181 ceph-mon[34096]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:57:07.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:07 smithi081 ceph-mon[30991]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:57:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:07 smithi164 ceph-mon[34236]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:57:09.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:09 smithi081 ceph-mon[30991]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T02:57:09.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:09 smithi164 ceph-mon[34236]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T02:57:09.737 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:09 smithi181 ceph-mon[34096]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T02:57:10.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:57:10.482 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:10 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:10.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:57:10.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:10 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:10.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:57:10.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:10 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:11.472 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:11 smithi181 ceph-mon[34096]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T02:57:11.472 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:11 smithi181 ceph-mon[34096]: Deploying daemon osd.11 on smithi181 2024-09-21T02:57:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:11 smithi081 ceph-mon[30991]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T02:57:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:11 smithi081 ceph-mon[30991]: Deploying daemon osd.11 on smithi181 2024-09-21T02:57:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:11 smithi164 ceph-mon[34236]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T02:57:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:11 smithi164 ceph-mon[34236]: Deploying daemon osd.11 on smithi181 2024-09-21T02:57:13.490 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:13 smithi181 ceph-mon[34096]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T02:57:13.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:13 smithi081 ceph-mon[30991]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T02:57:13.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:13 smithi164 ceph-mon[34236]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T02:57:15.600 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:15 smithi181 ceph-mon[34096]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:57:15.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:15 smithi164 ceph-mon[34236]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:57:15.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:15 smithi081 ceph-mon[30991]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:57:16.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:16.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:16.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:16 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:16.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:16.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:16.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:16 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:16.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:16.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:16.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:16 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:17.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:17 smithi181 ceph-mon[34096]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:57:17.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:17 smithi081 ceph-mon[30991]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:57:17.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:17 smithi164 ceph-mon[34236]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:57:19.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.018+0000 7fad7dffb640 1 -- 172.21.15.181:0/3984004942 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fad80063800 con 0x7fad700b6510 2024-09-21T02:57:19.021 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 11 on host 'smithi181' 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.020+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad700b6510 msgr2=0x7fad700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.020+0000 7fad87191640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad700b6510 0x7fad700b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00bbe0 tx=0x7fad6c00b390 comp rx=0 tx=0).stop 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.020+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 msgr2=0x7fad80199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.020+0000 7fad87191640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80199ee0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad74009230 tx=0x7fad740040c0 comp rx=0 tx=0).stop 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.020+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 shutdown_connections 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.020+0000 7fad87191640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad700b6510 0x7fad700b8a20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.021+0000 7fad87191640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad801083a0 0x7fad8019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:19.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.021+0000 7fad87191640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad80105780 0x7fad8019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:19.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.021+0000 7fad87191640 1 --2- 172.21.15.181:0/3984004942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad80102cc0 0x7fad80199ee0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:19.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.021+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 >> 172.21.15.181:0/3984004942 conn(0x7fad800fd760 msgr2=0x7fad80103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:19.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.021+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 shutdown_connections 2024-09-21T02:57:19.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:19.021+0000 7fad87191640 1 -- 172.21.15.181:0/3984004942 wait complete. 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.651 DEBUG:teuthology.orchestra.run.smithi181:osd.11> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T02:57:19.654 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T02:57:19.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:57:19.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:19.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 -- 172.21.15.81:0/4225561416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a94109470 msgr2=0x7f2a9410b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 --2- 172.21.15.81:0/4225561416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a94109470 0x7f2a9410b980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009ca0 tx=0x7f2a8c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 -- 172.21.15.81:0/4225561416 shutdown_connections 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 --2- 172.21.15.81:0/4225561416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a94109470 0x7f2a9410b980 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 --2- 172.21.15.81:0/4225561416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a941068d0 0x7f2a94108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 --2- 172.21.15.81:0/4225561416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a9406b980 0x7f2a94106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 -- 172.21.15.81:0/4225561416 >> 172.21.15.81:0/4225561416 conn(0x7f2a940fdfb0 msgr2=0x7f2a94100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:20.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 -- 172.21.15.81:0/4225561416 shutdown_connections 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.398+0000 7f2a9b685640 1 -- 172.21.15.81:0/4225561416 wait complete. 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 Processor -- start 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 -- start start 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a9406b980 0x7f2a941039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a941068d0 0x7f2a94102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a94109470 0x7f2a941027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9410f290 con 0x7f2a9406b980 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9410f110 con 0x7f2a94109470 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a9b685640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9410f410 con 0x7f2a941068d0 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a9406b980 0x7f2a941039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a9406b980 0x7f2a941039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38488/0 (socket says 172.21.15.81:38488) 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 -- 172.21.15.81:0/315118008 learned_addr learned my addr 172.21.15.81:0/315118008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:20.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a98c20640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a941068d0 0x7f2a94102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99c22640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a94109470 0x7f2a941027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 -- 172.21.15.81:0/315118008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a941068d0 msgr2=0x7f2a94102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a941068d0 0x7f2a94102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 -- 172.21.15.81:0/315118008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a94109470 msgr2=0x7f2a941027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a94109470 0x7f2a941027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99421640 1 -- 172.21.15.81:0/315118008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a94102ed0 con 0x7f2a9406b980 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.399+0000 7f2a99c22640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a94109470 0x7f2a941027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.400+0000 7f2a99421640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a9406b980 0x7f2a941039c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800d770 tx=0x7f2a8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.400+0000 7f2a867fc640 1 -- 172.21.15.81:0/315118008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88017070 con 0x7f2a9406b980 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.400+0000 7f2a867fc640 1 -- 172.21.15.81:0/315118008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a880054b0 con 0x7f2a9406b980 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.400+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a941a3f10 con 0x7f2a9406b980 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.400+0000 7f2a867fc640 1 -- 172.21.15.81:0/315118008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88004c60 con 0x7f2a9406b980 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.400+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a941a42b0 con 0x7f2a9406b980 2024-09-21T02:57:20.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.401+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a94106d20 con 0x7f2a9406b980 2024-09-21T02:57:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.402+0000 7f2a867fc640 1 -- 172.21.15.81:0/315118008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2a88004e00 con 0x7f2a9406b980 2024-09-21T02:57:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.403+0000 7f2a867fc640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2a800b6510 0x7f2a800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.403+0000 7f2a98c20640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2a800b6510 0x7f2a800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.403+0000 7f2a867fc640 1 -- 172.21.15.81:0/315118008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6809+0+0 (secure 0 0 0) 0x7f2a880e6780 con 0x7f2a9406b980 2024-09-21T02:57:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.404+0000 7f2a98c20640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2a800b6510 0x7f2a800b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2a900058c0 tx=0x7f2a9000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:20.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.408+0000 7f2a867fc640 1 -- 172.21.15.81:0/315118008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a880ad5f0 con 0x7f2a9406b980 2024-09-21T02:57:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.591+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2a94063fc0 con 0x7f2a9406b980 2024-09-21T02:57:20.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.592+0000 7f2a867fc640 1 -- 172.21.15.81:0/315118008 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f2a880b19d0 con 0x7f2a9406b980 2024-09-21T02:57:20.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2a800b6510 msgr2=0x7f2a800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2a800b6510 0x7f2a800b8a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2a900058c0 tx=0x7f2a9000a2d0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a9406b980 msgr2=0x7f2a941039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a9406b980 0x7f2a941039c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800d770 tx=0x7f2a8800dc30 comp rx=0 tx=0).stop 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 shutdown_connections 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2a800b6510 0x7f2a800b8a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2a941068d0 0x7f2a94102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2a94109470 0x7f2a941027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 --2- 172.21.15.81:0/315118008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a9406b980 0x7f2a941039c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 >> 172.21.15.81:0/315118008 conn(0x7f2a940fdfb0 msgr2=0x7f2a94104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 shutdown_connections 2024-09-21T02:57:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:20.594+0000 7f2a9b685640 1 -- 172.21.15.81:0/315118008 wait complete. 2024-09-21T02:57:21.320 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:21 smithi081 ceph-mon[30991]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:21.320 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:21 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/315118008' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:21.346 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726887419,"num_in_osds":12,"osd_in_since":1726887421,"num_remapped_pgs":0} 2024-09-21T02:57:21.386 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:21 smithi181 ceph-mon[34096]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:21.387 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:21 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/315118008' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:21.484 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:21 smithi164 ceph-mon[34236]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:21.484 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:21 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/315118008' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:21.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 02:57:21 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T02:57:21.614+0000 7f270be2d640 -1 osd.11 0 log_to_monitors true 2024-09-21T02:57:22.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:57:22.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:22 smithi181 ceph-mon[34096]: from='osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:57:22.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:22 smithi181 ceph-mon[34096]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:57:22.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:22 smithi081 ceph-mon[30991]: from='osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:57:22.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:22 smithi081 ceph-mon[30991]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:57:22.610 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:22.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:22 smithi164 ceph-mon[34236]: from='osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:57:22.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:22 smithi164 ceph-mon[34236]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:57:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.103+0000 7f4ccd06a640 1 -- 172.21.15.81:0/1162405658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 msgr2=0x7f4cc8104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.103+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/1162405658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc8104c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009900 tx=0x7f4cbc02a480 comp rx=0 tx=0).stop 2024-09-21T02:57:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 -- 172.21.15.81:0/1162405658 shutdown_connections 2024-09-21T02:57:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/1162405658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc8105210 0x7f4cc810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/1162405658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc8104c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/1162405658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4cc81037e0 0x7f4cc8103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 -- 172.21.15.81:0/1162405658 >> 172.21.15.81:0/1162405658 conn(0x7f4cc80ff150 msgr2=0x7f4cc8101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 -- 172.21.15.81:0/1162405658 shutdown_connections 2024-09-21T02:57:23.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 -- 172.21.15.81:0/1162405658 wait complete. 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.104+0000 7f4ccd06a640 1 Processor -- start 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4ccd06a640 1 -- start start 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4ccd06a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4cc81037e0 0x7f4cc8199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4ccd06a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4ccd06a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc8105210 0x7f4cc819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4ccd06a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc810f2e0 con 0x7f4cc8104870 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4ccd06a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc810f160 con 0x7f4cc81037e0 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4ccd06a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc810f460 con 0x7f4cc8105210 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32824/0 (socket says 172.21.15.81:32824) 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 -- 172.21.15.81:0/334889549 learned_addr learned my addr 172.21.15.81:0/334889549 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc759e640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc8105210 0x7f4cc819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc6d9d640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4cc81037e0 0x7f4cc8199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 -- 172.21.15.81:0/334889549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc8105210 msgr2=0x7f4cc819b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc8105210 0x7f4cc819b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 -- 172.21.15.81:0/334889549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4cc81037e0 msgr2=0x7f4cc8199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4cc81037e0 0x7f4cc8199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.105+0000 7f4cc659c640 1 -- 172.21.15.81:0/334889549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc819b9a0 con 0x7f4cc8104870 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.106+0000 7f4cc659c640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc819a5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009230 tx=0x7f4cbc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.106+0000 7f4caffff640 1 -- 172.21.15.81:0/334889549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc03f030 con 0x7f4cc8104870 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.106+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc819bc30 con 0x7f4cc8104870 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.106+0000 7f4caffff640 1 -- 172.21.15.81:0/334889549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cbc003c90 con 0x7f4cc8104870 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.106+0000 7f4caffff640 1 -- 172.21.15.81:0/334889549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc035070 con 0x7f4cc8104870 2024-09-21T02:57:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.106+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a2390 con 0x7f4cc8104870 2024-09-21T02:57:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.107+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc810a9c0 con 0x7f4cc8104870 2024-09-21T02:57:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.108+0000 7f4caffff640 1 -- 172.21.15.81:0/334889549 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4cbc042030 con 0x7f4cc8104870 2024-09-21T02:57:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.109+0000 7f4caffff640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4cb00b6510 0x7f4cb00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.109+0000 7f4cc6d9d640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4cb00b6510 0x7f4cb00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.109+0000 7f4caffff640 1 -- 172.21.15.81:0/334889549 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6831+0+0 (secure 0 0 0) 0x7f4cbc1076a0 con 0x7f4cc8104870 2024-09-21T02:57:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.110+0000 7f4cc6d9d640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4cb00b6510 0x7f4cb00b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009990 tx=0x7f4cb8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.112+0000 7f4caffff640 1 -- 172.21.15.81:0/334889549 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cbc0ce500 con 0x7f4cc8104870 2024-09-21T02:57:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.291+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4cc8063fc0 con 0x7f4cc8104870 2024-09-21T02:57:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.291+0000 7f4caffff640 1 -- 172.21.15.81:0/334889549 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f4cbc0d28e0 con 0x7f4cc8104870 2024-09-21T02:57:23.293 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:23.293 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:57:23.293 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T02:57:23.293 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: Detected new or changed devices on smithi181 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: Adjusting osd_memory_target on smithi181 to 4271M 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:23.295 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:23.295 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:23 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.293+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4cb00b6510 msgr2=0x7f4cb00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.293+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4cb00b6510 0x7f4cb00b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009990 tx=0x7f4cb8009110 comp rx=0 tx=0).stop 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.293+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 msgr2=0x7f4cc819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.293+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc819a5e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009230 tx=0x7f4cbc0042f0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 shutdown_connections 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4cb00b6510 0x7f4cb00b8a20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4cc8105210 0x7f4cc819b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8104870 0x7f4cc819a5e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 --2- 172.21.15.81:0/334889549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4cc81037e0 0x7f4cc8199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 >> 172.21.15.81:0/334889549 conn(0x7f4cc80ff150 msgr2=0x7f4cc8107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 shutdown_connections 2024-09-21T02:57:23.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:23.294+0000 7f4ccd06a640 1 -- 172.21.15.81:0/334889549 wait complete. 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: Detected new or changed devices on smithi181 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: Adjusting osd_memory_target on smithi181 to 4271M 2024-09-21T02:57:23.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:23.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:23.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]} : dispatch 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: Detected new or changed devices on smithi181 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: Adjusting osd_memory_target on smithi181 to 4271M 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:23.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:23 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:23.991 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726887419,"num_in_osds":12,"osd_in_since":1726887421,"num_remapped_pgs":0} 2024-09-21T02:57:23.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T02:57:23.654+0000 7f2707daf640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T02:57:23.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 02:57:23 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T02:57:23.673+0000 7f26ffba5640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:57:24.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:24 smithi181 ceph-mon[34096]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:57:24.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:24 smithi181 ceph-mon[34096]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:57:24.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:24.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:24 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:24.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:24 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/334889549' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:24.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:24 smithi181 ceph-mon[34096]: from='osd.11 ' entity='osd.11' 2024-09-21T02:57:24.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:24 smithi081 ceph-mon[30991]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:57:24.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:24 smithi081 ceph-mon[30991]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:57:24.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:24.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:24 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:24.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:24 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/334889549' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:24.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:24 smithi081 ceph-mon[30991]: from='osd.11 ' entity='osd.11' 2024-09-21T02:57:24.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:24 smithi164 ceph-mon[34236]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-09-21T02:57:24.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:24 smithi164 ceph-mon[34236]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:57:24.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:24.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:24 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:24.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:24 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/334889549' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:24.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:24 smithi164 ceph-mon[34236]: from='osd.11 ' entity='osd.11' 2024-09-21T02:57:24.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:57:25.244 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:25 smithi081 ceph-mon[30991]: purged_snaps scrub starts 2024-09-21T02:57:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:25 smithi081 ceph-mon[30991]: purged_snaps scrub ok 2024-09-21T02:57:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:25 smithi081 ceph-mon[30991]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:25 smithi081 ceph-mon[30991]: osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] boot 2024-09-21T02:57:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:25 smithi081 ceph-mon[30991]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T02:57:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:25 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:25.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:25 smithi181 ceph-mon[34096]: purged_snaps scrub starts 2024-09-21T02:57:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:25 smithi181 ceph-mon[34096]: purged_snaps scrub ok 2024-09-21T02:57:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:25 smithi181 ceph-mon[34096]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:25 smithi181 ceph-mon[34096]: osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] boot 2024-09-21T02:57:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:25 smithi181 ceph-mon[34096]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T02:57:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:25 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:25.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:25 smithi164 ceph-mon[34236]: purged_snaps scrub starts 2024-09-21T02:57:25.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:25 smithi164 ceph-mon[34236]: purged_snaps scrub ok 2024-09-21T02:57:25.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:25 smithi164 ceph-mon[34236]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:57:25.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:25.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:25 smithi164 ceph-mon[34236]: osd.11 [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] boot 2024-09-21T02:57:25.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:25 smithi164 ceph-mon[34236]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T02:57:25.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:25 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 -- 172.21.15.81:0/2369074344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 msgr2=0x7f893010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 --2- 172.21.15.81:0/2369074344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f893010aa10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8928009900 tx=0x7f892802a480 comp rx=0 tx=0).stop 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 -- 172.21.15.81:0/2369074344 shutdown_connections 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 --2- 172.21.15.81:0/2369074344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89301036d0 0x7f8930103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 --2- 172.21.15.81:0/2369074344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f893010aa10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 --2- 172.21.15.81:0/2369074344 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8930102640 0x7f8930102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 -- 172.21.15.81:0/2369074344 >> 172.21.15.81:0/2369074344 conn(0x7f89300fdfb0 msgr2=0x7f8930100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 -- 172.21.15.81:0/2369074344 shutdown_connections 2024-09-21T02:57:25.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 -- 172.21.15.81:0/2369074344 wait complete. 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.695+0000 7f8935912640 1 Processor -- start 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f8935912640 1 -- start start 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f8935912640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8930102640 0x7f893006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f8935912640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89301036d0 0x7f893019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f8935912640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f89301a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f8935912640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f893010e120 con 0x7f8930104070 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f8935912640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f893010dfa0 con 0x7f8930102640 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f8935912640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f893010e2a0 con 0x7f89301036d0 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f89301a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f89301a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32840/0 (socket says 172.21.15.81:32840) 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 -- 172.21.15.81:0/1530876096 learned_addr learned my addr 172.21.15.81:0/1530876096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892effd640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8930102640 0x7f893006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892e7fc640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89301036d0 0x7f893019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 -- 172.21.15.81:0/1530876096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89301036d0 msgr2=0x7f893019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89301036d0 0x7f893019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 -- 172.21.15.81:0/1530876096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8930102640 msgr2=0x7f893006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8930102640 0x7f893006b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 -- 172.21.15.81:0/1530876096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89301a1850 con 0x7f8930104070 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892effd640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8930102640 0x7f893006b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.696+0000 7f892f7fe640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f89301a10e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8928005ab0 tx=0x7f89280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.697+0000 7f8934910640 1 -- 172.21.15.81:0/1530876096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892803f030 con 0x7f8930104070 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.697+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89301a1ae0 con 0x7f8930104070 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.697+0000 7f8934910640 1 -- 172.21.15.81:0/1530876096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8928003c90 con 0x7f8930104070 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.697+0000 7f8934910640 1 -- 172.21.15.81:0/1530876096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8928035070 con 0x7f8930104070 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.697+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89301a2010 con 0x7f8930104070 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.698+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8930109820 con 0x7f8930104070 2024-09-21T02:57:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.699+0000 7f8934910640 1 -- 172.21.15.81:0/1530876096 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8928042030 con 0x7f8930104070 2024-09-21T02:57:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.700+0000 7f8934910640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f891c0b6510 0x7f891c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.701+0000 7f892effd640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f891c0b6510 0x7f891c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.701+0000 7f8934910640 1 -- 172.21.15.81:0/1530876096 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f8928107b60 con 0x7f8930104070 2024-09-21T02:57:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.701+0000 7f892effd640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f891c0b6510 0x7f891c0b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8920008e00 tx=0x7f8920008350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.704+0000 7f8934910640 1 -- 172.21.15.81:0/1530876096 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89280ce830 con 0x7f8930104070 2024-09-21T02:57:25.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.884+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f893002e890 con 0x7f8930104070 2024-09-21T02:57:25.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.884+0000 7f8934910640 1 -- 172.21.15.81:0/1530876096 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f89280d2c10 con 0x7f8930104070 2024-09-21T02:57:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:25.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f891c0b6510 msgr2=0x7f891c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f891c0b6510 0x7f891c0b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8920008e00 tx=0x7f8920008350 comp rx=0 tx=0).stop 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 msgr2=0x7f89301a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f89301a10e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8928005ab0 tx=0x7f89280042f0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 shutdown_connections 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f891c0b6510 0x7f891c0b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89301036d0 0x7f893019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930104070 0x7f89301a10e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 --2- 172.21.15.81:0/1530876096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8930102640 0x7f893006b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 >> 172.21.15.81:0/1530876096 conn(0x7f89300fdfb0 msgr2=0x7f89301069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 shutdown_connections 2024-09-21T02:57:25.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:25.887+0000 7f8935912640 1 -- 172.21.15.81:0/1530876096 wait complete. 2024-09-21T02:57:26.547 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:26 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1530876096' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:26.576 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726887444,"num_in_osds":12,"osd_in_since":1726887421,"num_remapped_pgs":0} 2024-09-21T02:57:26.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:57:26.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:26 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1530876096' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:26.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:26 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1530876096' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:57:26.821 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 -- 172.21.15.81:0/689082780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78103110 msgr2=0x7efd78107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 --2- 172.21.15.81:0/689082780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78103110 0x7efd78107640 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efd68009930 tx=0x7efd6802a420 comp rx=0 tx=0).stop 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 -- 172.21.15.81:0/689082780 shutdown_connections 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 --2- 172.21.15.81:0/689082780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd78107c00 0x7efd781080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 --2- 172.21.15.81:0/689082780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78103110 0x7efd78107640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 --2- 172.21.15.81:0/689082780 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd781027c0 0x7efd78102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 -- 172.21.15.81:0/689082780 >> 172.21.15.81:0/689082780 conn(0x7efd78079740 msgr2=0x7efd78079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 -- 172.21.15.81:0/689082780 shutdown_connections 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.286+0000 7efd7f63a640 1 -- 172.21.15.81:0/689082780 wait complete. 2024-09-21T02:57:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.287+0000 7efd7f63a640 1 Processor -- start 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.287+0000 7efd7f63a640 1 -- start start 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7f63a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd781027c0 0x7efd781a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7f63a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd78103110 0x7efd781a1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7f63a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78107c00 0x7efd781a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7f63a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd7811a030 con 0x7efd78107c00 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7f63a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efd78119eb0 con 0x7efd78103110 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7f63a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efd7811a1b0 con 0x7efd781027c0 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78107c00 0x7efd781a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78107c00 0x7efd781a63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32856/0 (socket says 172.21.15.81:32856) 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 -- 172.21.15.81:0/3675873410 learned_addr learned my addr 172.21.15.81:0/3675873410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7d3d6640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd781027c0 0x7efd781a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7cbd5640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd78103110 0x7efd781a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 -- 172.21.15.81:0/3675873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd781027c0 msgr2=0x7efd781a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd781027c0 0x7efd781a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 -- 172.21.15.81:0/3675873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd78103110 msgr2=0x7efd781a1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd78103110 0x7efd781a1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 -- 172.21.15.81:0/3675873410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd781a6ad0 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7dbd7640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78107c00 0x7efd781a63a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b970 tx=0x7efd7000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd6e7fc640 1 -- 172.21.15.81:0/3675873410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70019070 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd6e7fc640 1 -- 172.21.15.81:0/3675873410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd70014440 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.288+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd781a6dc0 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.289+0000 7efd6e7fc640 1 -- 172.21.15.81:0/3675873410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd700075d0 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.289+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd781ad520 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.290+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7806c240 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.291+0000 7efd6e7fc640 1 -- 172.21.15.81:0/3675873410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7efd7001c070 con 0x7efd78107c00 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.292+0000 7efd6e7fc640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efd640b6590 0x7efd640b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.292+0000 7efd7d3d6640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efd640b6590 0x7efd640b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.292+0000 7efd6e7fc640 1 -- 172.21.15.81:0/3675873410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7efd700e67a0 con 0x7efd78107c00 2024-09-21T02:57:27.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.292+0000 7efd7d3d6640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efd640b6590 0x7efd640b8aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efd7806c940 tx=0x7efd74008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:27.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.295+0000 7efd6e7fc640 1 -- 172.21.15.81:0/3675873410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd700ad4d0 con 0x7efd78107c00 2024-09-21T02:57:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.475+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd781ad8d0 con 0x7efd78107c00 2024-09-21T02:57:27.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:27 smithi081 ceph-mon[30991]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:27.478 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:27 smithi081 ceph-mon[30991]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T02:57:27.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.476+0000 7efd6e7fc640 1 -- 172.21.15.81:0/3675873410 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18513 (secure 0 0 0) 0x7efd700b18b0 con 0x7efd78107c00 2024-09-21T02:57:27.478 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:27.479 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:57:26.245345+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:57:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.478+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efd640b6590 msgr2=0x7efd640b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.478+0000 7efd7f63a640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efd640b6590 0x7efd640b8aa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efd7806c940 tx=0x7efd74008040 comp rx=0 tx=0).stop 2024-09-21T02:57:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.478+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78107c00 msgr2=0x7efd781a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.478+0000 7efd7f63a640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78107c00 0x7efd781a63a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b970 tx=0x7efd7000be30 comp rx=0 tx=0).stop 2024-09-21T02:57:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.478+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 shutdown_connections 2024-09-21T02:57:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.478+0000 7efd7f63a640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efd640b6590 0x7efd640b8aa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.479+0000 7efd7f63a640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd78107c00 0x7efd781a63a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.479+0000 7efd7f63a640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd78103110 0x7efd781a1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.479+0000 7efd7f63a640 1 --2- 172.21.15.81:0/3675873410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efd781027c0 0x7efd781a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.479+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 >> 172.21.15.81:0/3675873410 conn(0x7efd78079740 msgr2=0x7efd78105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.479+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 shutdown_connections 2024-09-21T02:57:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:27.479+0000 7efd7f63a640 1 -- 172.21.15.81:0/3675873410 wait complete. 2024-09-21T02:57:27.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:27 smithi164 ceph-mon[34236]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:27.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:27 smithi164 ceph-mon[34236]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T02:57:27.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:27 smithi181 ceph-mon[34096]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:27.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:27 smithi181 ceph-mon[34096]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T02:57:28.304 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T02:53:35.934095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T02:57:28.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T02:57:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:28.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:28 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3675873410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:57:28.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:28 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3675873410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:57:28.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:28 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3675873410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 -- 172.21.15.81:0/3168999660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d8102a80 msgr2=0x7fc8d8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3168999660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d8102a80 0x7fc8d8102e90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009900 tx=0x7fc8d402a410 comp rx=0 tx=0).stop 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 -- 172.21.15.81:0/3168999660 shutdown_connections 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3168999660 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8d8108d10 0x7fc8d810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3168999660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d81083c0 0x7fc8d81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3168999660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d8102a80 0x7fc8d8102e90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 -- 172.21.15.81:0/3168999660 >> 172.21.15.81:0/3168999660 conn(0x7fc8d8079740 msgr2=0x7fc8d8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 -- 172.21.15.81:0/3168999660 shutdown_connections 2024-09-21T02:57:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.064+0000 7fc8df58c640 1 -- 172.21.15.81:0/3168999660 wait complete. 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 Processor -- start 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 -- start start 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8d8102a80 0x7fc8d819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d81083c0 0x7fc8d819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8108d10 0x7fc8d819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d8113990 con 0x7fc8d81083c0 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d8113810 con 0x7fc8d8108d10 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8df58c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d8113b10 con 0x7fc8d8102a80 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8dcb27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d81083c0 0x7fc8d819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8dcb27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d81083c0 0x7fc8d819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32864/0 (socket says 172.21.15.81:32864) 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8dcb27640 1 -- 172.21.15.81:0/3953546377 learned_addr learned my addr 172.21.15.81:0/3953546377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8dd328640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8d8102a80 0x7fc8d819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.065+0000 7fc8ddb29640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8108d10 0x7fc8d819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8dcb27640 1 -- 172.21.15.81:0/3953546377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8d8102a80 msgr2=0x7fc8d819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8dcb27640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8d8102a80 0x7fc8d819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8dcb27640 1 -- 172.21.15.81:0/3953546377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8108d10 msgr2=0x7fc8d819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8dcb27640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8108d10 0x7fc8d819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8dcb27640 1 -- 172.21.15.81:0/3953546377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d81a0350 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8dd328640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8d8102a80 0x7fc8d819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8dcb27640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d81083c0 0x7fc8d819aa40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b450 tx=0x7fc8c800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8ce7fc640 1 -- 172.21.15.81:0/3953546377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8015020 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d81a0640 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8ce7fc640 1 -- 172.21.15.81:0/3953546377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8c8011d20 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8ce7fc640 1 -- 172.21.15.81:0/3953546377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8010e10 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.066+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d81a6e60 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.067+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d8103d00 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.069+0000 7fc8ce7fc640 1 -- 172.21.15.81:0/3953546377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc8c8018020 con 0x7fc8d81083c0 2024-09-21T02:57:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.069+0000 7fc8ce7fc640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc8c40b6540 0x7fc8c40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:29.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.069+0000 7fc8dd328640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc8c40b6540 0x7fc8c40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:29.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.070+0000 7fc8ce7fc640 1 -- 172.21.15.81:0/3953546377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fc8c80e6dd0 con 0x7fc8d81083c0 2024-09-21T02:57:29.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.070+0000 7fc8dd328640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc8c40b6540 0x7fc8c40b8a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4000c00 tx=0x7fc8d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:29.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.073+0000 7fc8ce7fc640 1 -- 172.21.15.81:0/3953546377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8c801f020 con 0x7fc8d81083c0 2024-09-21T02:57:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.247+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8d819b5d0 con 0x7fc8d81083c0 2024-09-21T02:57:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.248+0000 7fc8ce7fc640 1 -- 172.21.15.81:0/3953546377 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7fc8c800d040 con 0x7fc8d81083c0 2024-09-21T02:57:29.249 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-21T02:57:29.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc8c40b6540 msgr2=0x7fc8c40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc8c40b6540 0x7fc8c40b8a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4000c00 tx=0x7fc8d4005a20 comp rx=0 tx=0).stop 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d81083c0 msgr2=0x7fc8d819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d81083c0 0x7fc8d819aa40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b450 tx=0x7fc8c800b910 comp rx=0 tx=0).stop 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 shutdown_connections 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc8c40b6540 0x7fc8c40b8a50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d8108d10 0x7fc8d819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8d81083c0 0x7fc8d819aa40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 --2- 172.21.15.81:0/3953546377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8d8102a80 0x7fc8d819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 >> 172.21.15.81:0/3953546377 conn(0x7fc8d8079740 msgr2=0x7fc8d8101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 shutdown_connections 2024-09-21T02:57:29.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:29.251+0000 7fc8df58c640 1 -- 172.21.15.81:0/3953546377 wait complete. 2024-09-21T02:57:29.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:29 smithi081 ceph-mon[30991]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:29.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:29 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3953546377' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:57:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:29 smithi164 ceph-mon[34236]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:29 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3953546377' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:57:29.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:29 smithi181 ceph-mon[34096]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:29.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:29 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3953546377' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:57:30.053 INFO:tasks.cephadm:Adding mds.a on smithi081 2024-09-21T02:57:30.053 INFO:tasks.cephadm:Adding mds.d on smithi081 2024-09-21T02:57:30.053 INFO:tasks.cephadm:Adding mds.g on smithi081 2024-09-21T02:57:30.053 INFO:tasks.cephadm:Adding mds.j on smithi081 2024-09-21T02:57:30.053 INFO:tasks.cephadm:Adding mds.b on smithi164 2024-09-21T02:57:30.054 INFO:tasks.cephadm:Adding mds.e on smithi164 2024-09-21T02:57:30.054 INFO:tasks.cephadm:Adding mds.h on smithi164 2024-09-21T02:57:30.054 INFO:tasks.cephadm:Adding mds.k on smithi164 2024-09-21T02:57:30.054 INFO:tasks.cephadm:Adding mds.c on smithi181 2024-09-21T02:57:30.054 INFO:tasks.cephadm:Adding mds.f on smithi181 2024-09-21T02:57:30.054 INFO:tasks.cephadm:Adding mds.i on smithi181 2024-09-21T02:57:30.054 INFO:tasks.cephadm:Adding mds.l on smithi181 2024-09-21T02:57:30.054 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l' 2024-09-21T02:57:30.315 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:57:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 -- 172.21.15.181:0/389410013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8108370 msgr2=0x7fe9b810a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/389410013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8108370 0x7fe9b810a880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009ca0 tx=0x7fe9b002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:57:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 -- 172.21.15.181:0/389410013 shutdown_connections 2024-09-21T02:57:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/389410013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8108370 0x7fe9b810a880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/389410013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9b8105750 0x7fe9b8107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:30.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/389410013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8102cf0 0x7fe9b8105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 -- 172.21.15.181:0/389410013 >> 172.21.15.181:0/389410013 conn(0x7fe9b80fd770 msgr2=0x7fe9b80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 -- 172.21.15.181:0/389410013 shutdown_connections 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.831+0000 7fe9bdac9640 1 -- 172.21.15.181:0/389410013 wait complete. 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 Processor -- start 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 -- start start 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8102cf0 0x7fe9b8104950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8105750 0x7fe9b8103220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9b8108370 0x7fe9b8103760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b810e160 con 0x7fe9b8105750 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b810dfe0 con 0x7fe9b8108370 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9bdac9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b810e2e0 con 0x7fe9b8102cf0 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8102cf0 0x7fe9b8104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8102cf0 0x7fe9b8104950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:34874/0 (socket says 172.21.15.181:34874) 2024-09-21T02:57:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.832+0000 7fe9b77fe640 1 -- 172.21.15.181:0/3303665606 learned_addr learned my addr 172.21.15.181:0/3303665606 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9affff640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8105750 0x7fe9b8103220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b7fff640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9b8108370 0x7fe9b8103760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b77fe640 1 -- 172.21.15.181:0/3303665606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9b8108370 msgr2=0x7fe9b8103760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b77fe640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9b8108370 0x7fe9b8103760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b77fe640 1 -- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8105750 msgr2=0x7fe9b8103220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b77fe640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8105750 0x7fe9b8103220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b77fe640 1 -- 172.21.15.181:0/3303665606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b8103e60 con 0x7fe9b8102cf0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b77fe640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8102cf0 0x7fe9b8104950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e9f0 tx=0x7fe9a800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b57fa640 1 -- 172.21.15.181:0/3303665606 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a800cd80 con 0x7fe9b8102cf0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b81a3ee0 con 0x7fe9b8102cf0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b57fa640 1 -- 172.21.15.181:0/3303665606 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9a80108c0 con 0x7fe9b8102cf0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9b57fa640 1 -- 172.21.15.181:0/3303665606 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80187c0 con 0x7fe9b8102cf0 2024-09-21T02:57:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.833+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b81a4280 con 0x7fe9b8102cf0 2024-09-21T02:57:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.835+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b8105c20 con 0x7fe9b8102cf0 2024-09-21T02:57:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.836+0000 7fe9b57fa640 1 -- 172.21.15.181:0/3303665606 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe9a8010430 con 0x7fe9b8102cf0 2024-09-21T02:57:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.837+0000 7fe9b57fa640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe9a40b6510 0x7fe9a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.837+0000 7fe9b57fa640 1 -- 172.21.15.181:0/3303665606 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe9a80e7670 con 0x7fe9b8102cf0 2024-09-21T02:57:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.837+0000 7fe9affff640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe9a40b6510 0x7fe9a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.838+0000 7fe9affff640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe9a40b6510 0x7fe9a40b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00058c0 tx=0x7fe9a000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:30.840+0000 7fe9b57fa640 1 -- 172.21.15.181:0/3303665606 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9a80b2780 con 0x7fe9b8102cf0 2024-09-21T02:57:31.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.035+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}) -- 0x7fe9b80fec90 con 0x7fe9a40b6510 2024-09-21T02:57:31.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.044+0000 7fe9b57fa640 1 -- 172.21.15.181:0/3303665606 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fe9b80fec90 con 0x7fe9a40b6510 2024-09-21T02:57:31.045 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mds.all update... 2024-09-21T02:57:31.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe9a40b6510 msgr2=0x7fe9a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:31.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe9a40b6510 0x7fe9a40b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00058c0 tx=0x7fe9a000a2d0 comp rx=0 tx=0).stop 2024-09-21T02:57:31.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8102cf0 msgr2=0x7fe9b8104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:31.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8102cf0 0x7fe9b8104950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e9f0 tx=0x7fe9a800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:57:31.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 shutdown_connections 2024-09-21T02:57:31.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe9a40b6510 0x7fe9a40b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:31.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9b8108370 0x7fe9b8103760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:31.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8105750 0x7fe9b8103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:31.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 --2- 172.21.15.181:0/3303665606 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9b8102cf0 0x7fe9b8104950 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:31.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 >> 172.21.15.181:0/3303665606 conn(0x7fe9b80fd770 msgr2=0x7fe9b81078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:31.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 shutdown_connections 2024-09-21T02:57:31.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-21T02:57:31.047+0000 7fe9bdac9640 1 -- 172.21.15.181:0/3303665606 wait complete. 2024-09-21T02:57:31.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:31 smithi081 ceph-mon[30991]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:31.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:31 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:31.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:31 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:31.657 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:31 smithi181 ceph-mon[34096]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:31.657 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:31 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:31.657 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:31 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:31.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:31 smithi164 ceph-mon[34236]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:31.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:31 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:31.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:31 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:57:31.698 DEBUG:teuthology.orchestra.run.smithi081:mds.a> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T02:57:31.701 DEBUG:teuthology.orchestra.run.smithi081:mds.d> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T02:57:31.744 DEBUG:teuthology.orchestra.run.smithi081:mds.g> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T02:57:31.787 DEBUG:teuthology.orchestra.run.smithi081:mds.j> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T02:57:31.830 DEBUG:teuthology.orchestra.run.smithi164:mds.b> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T02:57:31.833 DEBUG:teuthology.orchestra.run.smithi164:mds.e> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T02:57:31.876 DEBUG:teuthology.orchestra.run.smithi164:mds.h> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T02:57:31.919 DEBUG:teuthology.orchestra.run.smithi164:mds.k> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T02:57:31.962 DEBUG:teuthology.orchestra.run.smithi181:mds.c> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T02:57:31.964 DEBUG:teuthology.orchestra.run.smithi181:mds.f> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T02:57:32.007 DEBUG:teuthology.orchestra.run.smithi181:mds.i> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T02:57:32.050 DEBUG:teuthology.orchestra.run.smithi181:mds.l> sudo journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T02:57:32.093 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T02:57:32.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:32.337 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:32.457 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:32.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:32 smithi081 ceph-mon[30991]: Deploying daemon mds.l on smithi181 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:32.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:32 smithi181 ceph-mon[34096]: Deploying daemon mds.l on smithi181 2024-09-21T02:57:32.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:57:32.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T02:57:32.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:32.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:57:32.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:32.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:32.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:32.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:32.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:32 smithi164 ceph-mon[34236]: Deploying daemon mds.l on smithi181 2024-09-21T02:57:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 -- 172.21.15.81:0/2036330503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084102030 msgr2=0x7f2084102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 --2- 172.21.15.81:0/2036330503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084102030 0x7f2084102440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2074009ca0 tx=0x7f207402a8e0 comp rx=0 tx=0).stop 2024-09-21T02:57:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 -- 172.21.15.81:0/2036330503 shutdown_connections 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 --2- 172.21.15.81:0/2036330503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2084106280 0x7f2084106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 --2- 172.21.15.81:0/2036330503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2084106bd0 0x7f2084110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 --2- 172.21.15.81:0/2036330503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084102030 0x7f2084102440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 -- 172.21.15.81:0/2036330503 >> 172.21.15.81:0/2036330503 conn(0x7f2084077c60 msgr2=0x7f20840780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 -- 172.21.15.81:0/2036330503 shutdown_connections 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.814+0000 7f208c377640 1 -- 172.21.15.81:0/2036330503 wait complete. 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 Processor -- start 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 -- start start 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2084102030 0x7f208419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084106280 0x7f208419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2084106bd0 0x7f208419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20841139b0 con 0x7f2084106280 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2084113830 con 0x7f2084102030 2024-09-21T02:57:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208c377640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2084113b30 con 0x7f2084106bd0 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084106280 0x7f208419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084106280 0x7f208419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58730/0 (socket says 172.21.15.81:58730) 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 -- 172.21.15.81:0/1080679351 learned_addr learned my addr 172.21.15.81:0/1080679351 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208a113640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2084102030 0x7f208419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208a914640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2084106bd0 0x7f208419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 -- 172.21.15.81:0/1080679351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2084106bd0 msgr2=0x7f208419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2084106bd0 0x7f208419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 -- 172.21.15.81:0/1080679351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2084102030 msgr2=0x7f208419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2084102030 0x7f208419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 -- 172.21.15.81:0/1080679351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20841a0410 con 0x7f2084106280 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f208a113640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2084102030 0x7f208419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.815+0000 7f2089912640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084106280 0x7f208419ab00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2078006fd0 tx=0x7f207800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.816+0000 7f20837fe640 1 -- 172.21.15.81:0/1080679351 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078011830 con 0x7f2084106280 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.816+0000 7f20837fe640 1 -- 172.21.15.81:0/1080679351 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2078016070 con 0x7f2084106280 2024-09-21T02:57:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.816+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20841a0700 con 0x7f2084106280 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.816+0000 7f20837fe640 1 -- 172.21.15.81:0/1080679351 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078010d30 con 0x7f2084106280 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.816+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20841a6f20 con 0x7f2084106280 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.817+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208406ab90 con 0x7f2084106280 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.818+0000 7f20837fe640 1 -- 172.21.15.81:0/1080679351 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f20780119d0 con 0x7f2084106280 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.819+0000 7f20837fe640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f206c0b6540 0x7f206c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.819+0000 7f208a113640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f206c0b6540 0x7f206c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.819+0000 7f20837fe640 1 -- 172.21.15.81:0/1080679351 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f20780e6b80 con 0x7f2084106280 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.820+0000 7f208a113640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f206c0b6540 0x7f206c0b8a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2074000f80 tx=0x7f2074031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:32.823+0000 7f20837fe640 1 -- 172.21.15.81:0/1080679351 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20780ad810 con 0x7f2084106280 2024-09-21T02:57:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.035+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2084102440 con 0x7f2084106280 2024-09-21T02:57:33.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.036+0000 7f20837fe640 1 -- 172.21.15.81:0/1080679351 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f2084102440 con 0x7f2084106280 2024-09-21T02:57:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:33.038 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"btime":"2024-09-21T02:49:53:484787+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T02:57:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 1 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f206c0b6540 msgr2=0x7f206c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f206c0b6540 0x7f206c0b8a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2074000f80 tx=0x7f2074031000 comp rx=0 tx=0).stop 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084106280 msgr2=0x7f208419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084106280 0x7f208419ab00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2078006fd0 tx=0x7f207800b8e0 comp rx=0 tx=0).stop 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 shutdown_connections 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f206c0b6540 0x7f206c0b8a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2084106bd0 0x7f208419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2084106280 0x7f208419ab00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 --2- 172.21.15.81:0/1080679351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2084102030 0x7f208419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 >> 172.21.15.81:0/1080679351 conn(0x7f2084077c60 msgr2=0x7f2084107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 shutdown_connections 2024-09-21T02:57:33.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:33.038+0000 7f208c377640 1 -- 172.21.15.81:0/1080679351 wait complete. 2024-09-21T02:57:33.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:33 smithi164 ceph-mon[34236]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:33.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:33 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1080679351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:33 smithi181 ceph-mon[34096]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:33 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1080679351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:33.749 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:33 smithi181 systemd[1]: Starting Ceph mds.l for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:33.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:33 smithi081 ceph-mon[30991]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:33.792 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:33 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1080679351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:34.029 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:33 smithi181 podman[62295]: 2024-09-21 02:57:33.679126375 +0000 UTC m=+0.016592227 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:34.029 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:33 smithi181 podman[62295]: 2024-09-21 02:57:33.784808458 +0000 UTC m=+0.122274349 container create 06691b4986b05eb39039bd7e1faea03eb30176d06cd6e2e86ad10c0be741009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T02:57:34.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:34 smithi181 podman[62295]: 2024-09-21 02:57:34.029309108 +0000 UTC m=+0.366774952 container init 06691b4986b05eb39039bd7e1faea03eb30176d06cd6e2e86ad10c0be741009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:57:34.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:34 smithi181 podman[62295]: 2024-09-21 02:57:34.032234805 +0000 UTC m=+0.369700659 container start 06691b4986b05eb39039bd7e1faea03eb30176d06cd6e2e86ad10c0be741009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:57:34.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:34 smithi181 ceph-mds[62314]: -- 172.21.15.181:0/435706706 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c02107c20 con 0x560c062afa80 2024-09-21T02:57:34.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:34 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l[62310]: starting mds.l at 2024-09-21T02:57:34.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:34 smithi181 bash[62295]: 06691b4986b05eb39039bd7e1faea03eb30176d06cd6e2e86ad10c0be741009f 2024-09-21T02:57:34.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 02:57:34 smithi181 systemd[1]: Started Ceph mds.l for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:35.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:35.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6832/2510878090,v1:172.21.15.181:6833/2510878090] up:boot 2024-09-21T02:57:35.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: fsmap 1 up:standby 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:35.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:35 smithi164 ceph-mon[34236]: Deploying daemon mds.k on smithi164 2024-09-21T02:57:35.400 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6832/2510878090,v1:172.21.15.181:6833/2510878090] up:boot 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: fsmap 1 up:standby 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:35.401 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:35 smithi181 ceph-mon[34096]: Deploying daemon mds.k on smithi164 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6832/2510878090,v1:172.21.15.181:6833/2510878090] up:boot 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: fsmap 1 up:standby 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:35.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:35 smithi081 ceph-mon[30991]: Deploying daemon mds.k on smithi164 2024-09-21T02:57:35.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:36.077 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:36.181 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 systemd[1]: Starting Ceph mds.k for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:36.512 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 podman[61890]: 2024-09-21 02:57:36.155587821 +0000 UTC m=+0.015989017 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:36.512 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 podman[61890]: 2024-09-21 02:57:36.266973009 +0000 UTC m=+0.127374203 container create 6791a4ffbc4aa7671cab87b5b60bd616384311fffe157493d01225b2c67eb12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T02:57:36.512 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 podman[61890]: 2024-09-21 02:57:36.511335934 +0000 UTC m=+0.371737131 container init 6791a4ffbc4aa7671cab87b5b60bd616384311fffe157493d01225b2c67eb12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T02:57:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.532+0000 7fe077e2d640 1 -- 172.21.15.81:0/3208455603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070108d10 msgr2=0x7fe07010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.532+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3208455603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070108d10 0x7fe07010f540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe068009ca0 tx=0x7fe06802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.532+0000 7fe077e2d640 1 -- 172.21.15.81:0/3208455603 shutdown_connections 2024-09-21T02:57:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.532+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3208455603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070108d10 0x7fe07010f540 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.532+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3208455603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0701083c0 0x7fe0701087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.532+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3208455603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe070102a80 0x7fe070102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.532+0000 7fe077e2d640 1 -- 172.21.15.81:0/3208455603 >> 172.21.15.81:0/3208455603 conn(0x7fe070079740 msgr2=0x7fe070079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.533+0000 7fe077e2d640 1 -- 172.21.15.81:0/3208455603 shutdown_connections 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.533+0000 7fe077e2d640 1 -- 172.21.15.81:0/3208455603 wait complete. 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.533+0000 7fe077e2d640 1 Processor -- start 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe077e2d640 1 -- start start 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe077e2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070102a80 0x7fe07019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe077e2d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0701083c0 0x7fe07019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe077e2d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe070108d10 0x7fe07019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe077e2d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701128e0 con 0x7fe070102a80 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe077e2d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe070112760 con 0x7fe070108d10 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe077e2d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe070112a60 con 0x7fe0701083c0 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070102a80 0x7fe07019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070102a80 0x7fe07019b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58750/0 (socket says 172.21.15.81:58750) 2024-09-21T02:57:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 -- 172.21.15.81:0/3948871558 learned_addr learned my addr 172.21.15.81:0/3948871558 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe0763ca640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe070108d10 0x7fe07019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 -- 172.21.15.81:0/3948871558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0701083c0 msgr2=0x7fe07019b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe0753c8640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0701083c0 0x7fe07019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0701083c0 0x7fe07019b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 -- 172.21.15.81:0/3948871558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe070108d10 msgr2=0x7fe07019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe070108d10 0x7fe07019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 -- 172.21.15.81:0/3948871558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0701a6470 con 0x7fe070102a80 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe0753c8640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0701083c0 0x7fe07019b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe0763ca640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe070108d10 0x7fe07019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.534+0000 7fe075bc9640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070102a80 0x7fe07019b1b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00b4a0 tx=0x7fe06c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.535+0000 7fe066ffd640 1 -- 172.21.15.81:0/3948871558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c014070 con 0x7fe070102a80 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.535+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701a6760 con 0x7fe070102a80 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.535+0000 7fe066ffd640 1 -- 172.21.15.81:0/3948871558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe06c010aa0 con 0x7fe070102a80 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.535+0000 7fe066ffd640 1 -- 172.21.15.81:0/3948871558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c017b70 con 0x7fe070102a80 2024-09-21T02:57:36.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.535+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0701a6ca0 con 0x7fe070102a80 2024-09-21T02:57:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.536+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe070103d00 con 0x7fe070102a80 2024-09-21T02:57:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.537+0000 7fe066ffd640 1 -- 172.21.15.81:0/3948871558 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe06c017070 con 0x7fe070102a80 2024-09-21T02:57:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.538+0000 7fe066ffd640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe05c0b6510 0x7fe05c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.538+0000 7fe0753c8640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe05c0b6510 0x7fe05c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.538+0000 7fe066ffd640 1 -- 172.21.15.81:0/3948871558 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe06c0e64c0 con 0x7fe070102a80 2024-09-21T02:57:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.538+0000 7fe0753c8640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe05c0b6510 0x7fe05c0b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe070079fb0 tx=0x7fe060005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.541+0000 7fe066ffd640 1 -- 172.21.15.81:0/3948871558 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe06c0ad1f0 con 0x7fe070102a80 2024-09-21T02:57:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.774+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe07006bf70 con 0x7fe070102a80 2024-09-21T02:57:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.775+0000 7fe066ffd640 1 -- 172.21.15.81:0/3948871558 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fe07006bf70 con 0x7fe070102a80 2024-09-21T02:57:36.777 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:36.777 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"btime":"2024-09-21T02:57:34:071241+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T02:57:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-21T02:57:36.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe05c0b6510 msgr2=0x7fe05c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:36.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe05c0b6510 0x7fe05c0b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe070079fb0 tx=0x7fe060005e50 comp rx=0 tx=0).stop 2024-09-21T02:57:36.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070102a80 msgr2=0x7fe07019b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070102a80 0x7fe07019b1b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00b4a0 tx=0x7fe06c00b960 comp rx=0 tx=0).stop 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 shutdown_connections 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe05c0b6510 0x7fe05c0b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe0701083c0 0x7fe07019b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe070108d10 0x7fe07019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 --2- 172.21.15.81:0/3948871558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe070102a80 0x7fe07019b1b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 >> 172.21.15.81:0/3948871558 conn(0x7fe070079740 msgr2=0x7fe070105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 shutdown_connections 2024-09-21T02:57:36.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:36.778+0000 7fe077e2d640 1 -- 172.21.15.81:0/3948871558 wait complete. 2024-09-21T02:57:36.931 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 podman[61890]: 2024-09-21 02:57:36.514557983 +0000 UTC m=+0.374959177 container start 6791a4ffbc4aa7671cab87b5b60bd616384311fffe157493d01225b2c67eb12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T02:57:36.931 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 ceph-mds[61910]: -- 172.21.15.164:0/1578143759 <== mon.2 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd94b3b860 con 0x55cd98ce3a80 2024-09-21T02:57:36.931 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k[61906]: starting mds.k at 2024-09-21T02:57:36.932 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 bash[61890]: 6791a4ffbc4aa7671cab87b5b60bd616384311fffe157493d01225b2c67eb12b 2024-09-21T02:57:36.932 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 02:57:36 smithi164 systemd[1]: Started Ceph mds.k for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:37.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:37.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:37.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:37.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:37.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:37 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3948871558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:37.500 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:37 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3948871558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:37.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:37 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3948871558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:38.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:38 smithi081 ceph-mon[30991]: Deploying daemon mds.j on smithi081 2024-09-21T02:57:38.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:38 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6832/2052229726,v1:172.21.15.164:6833/2052229726] up:boot 2024-09-21T02:57:38.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:38 smithi081 ceph-mon[30991]: fsmap 2 up:standby 2024-09-21T02:57:38.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:38 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:57:38.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:38 smithi164 ceph-mon[34236]: Deploying daemon mds.j on smithi081 2024-09-21T02:57:38.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:38 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6832/2052229726,v1:172.21.15.164:6833/2052229726] up:boot 2024-09-21T02:57:38.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:38 smithi164 ceph-mon[34236]: fsmap 2 up:standby 2024-09-21T02:57:38.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:38 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:57:38.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:38 smithi181 ceph-mon[34096]: Deploying daemon mds.j on smithi081 2024-09-21T02:57:38.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:38 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6832/2052229726,v1:172.21.15.164:6833/2052229726] up:boot 2024-09-21T02:57:38.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:38 smithi181 ceph-mon[34096]: fsmap 2 up:standby 2024-09-21T02:57:38.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:38 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:57:39.185 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:39 smithi081 ceph-mon[30991]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:39.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:39 smithi164 ceph-mon[34236]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:39.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:39 smithi181 ceph-mon[34096]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:39.555 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 systemd[1]: Starting Ceph mds.j for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:39.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:39.833 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 podman[69892]: 2024-09-21 02:57:39.479887399 +0000 UTC m=+0.016103547 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:39.833 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 podman[69892]: 2024-09-21 02:57:39.596402346 +0000 UTC m=+0.132618536 container create 909d0090824bc368dfeba950788950b08e6bcfb3f5536fad80d1df7dbc19b7f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T02:57:39.833 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 podman[69892]: 2024-09-21 02:57:39.832678697 +0000 UTC m=+0.368894845 container init 909d0090824bc368dfeba950788950b08e6bcfb3f5536fad80d1df7dbc19b7f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T02:57:40.007 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:40.129 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 podman[69892]: 2024-09-21 02:57:39.835956066 +0000 UTC m=+0.372172215 container start 909d0090824bc368dfeba950788950b08e6bcfb3f5536fad80d1df7dbc19b7f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T02:57:40.129 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 ceph-mds[69941]: -- 172.21.15.81:0/1858648538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556912021860 con 0x5569161c9a80 2024-09-21T02:57:40.129 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j[69925]: starting mds.j at 2024-09-21T02:57:40.129 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 bash[69892]: 909d0090824bc368dfeba950788950b08e6bcfb3f5536fad80d1df7dbc19b7f9 2024-09-21T02:57:40.129 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 02:57:39 smithi081 systemd[1]: Started Ceph mds.j for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 -- 172.21.15.81:0/1373360419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 msgr2=0x7f8e14102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 --2- 172.21.15.81:0/1373360419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e14102e90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009900 tx=0x7f8e1002a410 comp rx=0 tx=0).stop 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 -- 172.21.15.81:0/1373360419 shutdown_connections 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 --2- 172.21.15.81:0/1373360419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e14108d10 0x7f8e1410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 --2- 172.21.15.81:0/1373360419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e141083c0 0x7f8e141087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 --2- 172.21.15.81:0/1373360419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e14102e90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 -- 172.21.15.81:0/1373360419 >> 172.21.15.81:0/1373360419 conn(0x7f8e14079730 msgr2=0x7f8e14079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 -- 172.21.15.81:0/1373360419 shutdown_connections 2024-09-21T02:57:40.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.533+0000 7f8e1b717640 1 -- 172.21.15.81:0/1373360419 wait complete. 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 Processor -- start 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 -- start start 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e1419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e141083c0 0x7f8e1419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e14108d10 0x7f8e1419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e141139e0 con 0x7f8e14102a80 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14113860 con 0x7f8e14108d10 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e1b717640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14113b60 con 0x7f8e141083c0 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e194b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e1419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e194b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e1419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58778/0 (socket says 172.21.15.81:58778) 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.534+0000 7f8e194b3640 1 -- 172.21.15.81:0/140728140 learned_addr learned my addr 172.21.15.81:0/140728140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e18cb2640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e141083c0 0x7f8e1419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e19cb4640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e14108d10 0x7f8e1419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e194b3640 1 -- 172.21.15.81:0/140728140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e141083c0 msgr2=0x7f8e1419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e194b3640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e141083c0 0x7f8e1419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e194b3640 1 -- 172.21.15.81:0/140728140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e14108d10 msgr2=0x7f8e1419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e194b3640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e14108d10 0x7f8e1419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e194b3640 1 -- 172.21.15.81:0/140728140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e141a03e0 con 0x7f8e14102a80 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e19cb4640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e14108d10 0x7f8e1419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e194b3640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e1419a470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009230 tx=0x7f8e10004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e0a7fc640 1 -- 172.21.15.81:0/140728140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1003f030 con 0x7f8e14102a80 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e0a7fc640 1 -- 172.21.15.81:0/140728140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e10003a80 con 0x7f8e14102a80 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e141a0670 con 0x7f8e14102a80 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e0a7fc640 1 -- 172.21.15.81:0/140728140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10035070 con 0x7f8e14102a80 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.535+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e141a6e30 con 0x7f8e14102a80 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.536+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e14103d00 con 0x7f8e14102a80 2024-09-21T02:57:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.538+0000 7f8e0a7fc640 1 -- 172.21.15.81:0/140728140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8e10042030 con 0x7f8e14102a80 2024-09-21T02:57:40.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.539+0000 7f8e0a7fc640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8e000b6510 0x7f8e000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:40.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.539+0000 7f8e18cb2640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8e000b6510 0x7f8e000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:40.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.539+0000 7f8e0a7fc640 1 -- 172.21.15.81:0/140728140 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f8e10107b30 con 0x7f8e14102a80 2024-09-21T02:57:40.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.539+0000 7f8e18cb2640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8e000b6510 0x7f8e000b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e04005d00 tx=0x7f8e04005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:40.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.542+0000 7f8e0a7fc640 1 -- 172.21.15.81:0/140728140 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e100ce7c0 con 0x7f8e14102a80 2024-09-21T02:57:40.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.767+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e14102e90 con 0x7f8e14102a80 2024-09-21T02:57:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.767+0000 7f8e0a7fc640 1 -- 172.21.15.81:0/140728140 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f8e100d2ba0 con 0x7f8e14102a80 2024-09-21T02:57:40.769 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:40.769 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":4,"btime":"2024-09-21T02:57:40:091318+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T02:57:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 4 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8e000b6510 msgr2=0x7f8e000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8e000b6510 0x7f8e000b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e04005d00 tx=0x7f8e04005c50 comp rx=0 tx=0).stop 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 msgr2=0x7f8e1419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e1419a470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009230 tx=0x7f8e10004270 comp rx=0 tx=0).stop 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 shutdown_connections 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8e000b6510 0x7f8e000b8a20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e141083c0 0x7f8e1419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e14108d10 0x7f8e1419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 --2- 172.21.15.81:0/140728140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e14102a80 0x7f8e1419a470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 >> 172.21.15.81:0/140728140 conn(0x7f8e14079730 msgr2=0x7f8e14106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 shutdown_connections 2024-09-21T02:57:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:40.770+0000 7f8e1b717640 1 -- 172.21.15.81:0/140728140 wait complete. 2024-09-21T02:57:41.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:41.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:41.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:41.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:41.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: Deploying daemon mds.d on smithi081 2024-09-21T02:57:41.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.81:6834/2295096585,v1:172.21.15.81:6835/2295096585] up:boot 2024-09-21T02:57:41.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: fsmap 3 up:standby 2024-09-21T02:57:41.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:57:41.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:40 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/140728140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:41.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:41.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: Deploying daemon mds.d on smithi081 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.81:6834/2295096585,v1:172.21.15.81:6835/2295096585] up:boot 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: fsmap 3 up:standby 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:57:41.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:40 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/140728140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:41.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:41.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: Deploying daemon mds.d on smithi081 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.81:6834/2295096585,v1:172.21.15.81:6835/2295096585] up:boot 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: fsmap 3 up:standby 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:57:41.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:40 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/140728140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:43.238 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:42 smithi081 ceph-mon[30991]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:43.238 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 systemd[1]: Starting Ceph mds.d for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:43.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:42 smithi181 ceph-mon[34096]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:43.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:42 smithi164 ceph-mon[34236]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:43.527 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 podman[70287]: 2024-09-21 02:57:43.139415777 +0000 UTC m=+0.016082303 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:43.528 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 podman[70287]: 2024-09-21 02:57:43.275357547 +0000 UTC m=+0.152024116 container create 9e701b94b302b6eef48d85fedb98cfa546c51861ab4005f4a1e3c9c4cef77999 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T02:57:43.528 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 podman[70287]: 2024-09-21 02:57:43.526956054 +0000 UTC m=+0.403622589 container init 9e701b94b302b6eef48d85fedb98cfa546c51861ab4005f4a1e3c9c4cef77999 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T02:57:43.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:43.805 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 podman[70287]: 2024-09-21 02:57:43.529740131 +0000 UTC m=+0.406406665 container start 9e701b94b302b6eef48d85fedb98cfa546c51861ab4005f4a1e3c9c4cef77999 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T02:57:43.805 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 ceph-mds[70306]: -- 172.21.15.81:0/1221967890 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601ed60d860 con 0x5601f17b5600 2024-09-21T02:57:43.805 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d[70302]: starting mds.d at 2024-09-21T02:57:43.805 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 bash[70287]: 9e701b94b302b6eef48d85fedb98cfa546c51861ab4005f4a1e3c9c4cef77999 2024-09-21T02:57:43.805 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 02:57:43 smithi081 systemd[1]: Started Ceph mds.d for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:44.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3215873445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e4102a80 msgr2=0x7fe6e4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3215873445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e4102a80 0x7fe6e4102e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009900 tx=0x7fe6d402a410 comp rx=0 tx=0).stop 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3215873445 shutdown_connections 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3215873445 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e41083c0 0x7fe6e41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3215873445 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e4108d10 0x7fe6e410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3215873445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e4102a80 0x7fe6e4102e90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3215873445 >> 172.21.15.81:0/3215873445 conn(0x7fe6e4079740 msgr2=0x7fe6e4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3215873445 shutdown_connections 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.378+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3215873445 wait complete. 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.379+0000 7fe6e9d1c640 1 Processor -- start 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.379+0000 7fe6e9d1c640 1 -- start start 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e9d1c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e4102a80 0x7fe6e4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e9d1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e41083c0 0x7fe6e41998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:44.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e9d1c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e4108d10 0x7fe6e419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e9d1c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e4112830 con 0x7fe6e41083c0 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e9d1c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41126b0 con 0x7fe6e4102a80 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e9d1c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41129b0 con 0x7fe6e4108d10 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e41083c0 0x7fe6e41998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e37fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e4102a80 0x7fe6e4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e41083c0 0x7fe6e41998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33380/0 (socket says 172.21.15.81:33380) 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 -- 172.21.15.81:0/3227311202 learned_addr learned my addr 172.21.15.81:0/3227311202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e3fff640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e4108d10 0x7fe6e419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 -- 172.21.15.81:0/3227311202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e4108d10 msgr2=0x7fe6e419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e4108d10 0x7fe6e419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 -- 172.21.15.81:0/3227311202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e4102a80 msgr2=0x7fe6e4199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e4102a80 0x7fe6e4199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 -- 172.21.15.81:0/3227311202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e419f290 con 0x7fe6e41083c0 2024-09-21T02:57:44.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6daffd640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e41083c0 0x7fe6e41998c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c970 tx=0x7fe6cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e17fa640 1 -- 172.21.15.81:0/3227311202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc007bb0 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e17fa640 1 -- 172.21.15.81:0/3227311202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6cc007d50 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e419f580 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.380+0000 7fe6e17fa640 1 -- 172.21.15.81:0/3227311202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc004e10 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.381+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e41a5ce0 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.381+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e4103d00 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.384+0000 7fe6e17fa640 1 -- 172.21.15.81:0/3227311202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe6cc005000 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.385+0000 7fe6e17fa640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6d00b6510 0x7fe6d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.385+0000 7fe6e37fe640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6d00b6510 0x7fe6d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.385+0000 7fe6e17fa640 1 -- 172.21.15.81:0/3227311202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe6cc0e6ea0 con 0x7fe6e41083c0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.385+0000 7fe6e37fe640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6d00b6510 0x7fe6d00b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40057c0 tx=0x7fe6d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:44.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.388+0000 7fe6e17fa640 1 -- 172.21.15.81:0/3227311202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6cc014030 con 0x7fe6e41083c0 2024-09-21T02:57:44.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.601+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6e4102e90 con 0x7fe6e41083c0 2024-09-21T02:57:44.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.602+0000 7fe6e17fa640 1 -- 172.21.15.81:0/3227311202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7fe6cc0adbd0 con 0x7fe6e41083c0 2024-09-21T02:57:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:44.603 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"btime":"2024-09-21T02:57:43:978563+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T02:57:44.604 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 5 2024-09-21T02:57:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6d00b6510 msgr2=0x7fe6d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6d00b6510 0x7fe6d00b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40057c0 tx=0x7fe6d40058d0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e41083c0 msgr2=0x7fe6e41998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e41083c0 0x7fe6e41998c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c970 tx=0x7fe6cc00ce30 comp rx=0 tx=0).stop 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 shutdown_connections 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6d00b6510 0x7fe6d00b8a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e4108d10 0x7fe6e419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e41083c0 0x7fe6e41998c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 --2- 172.21.15.81:0/3227311202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6e4102a80 0x7fe6e4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 >> 172.21.15.81:0/3227311202 conn(0x7fe6e4079740 msgr2=0x7fe6e41016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 shutdown_connections 2024-09-21T02:57:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:44.604+0000 7fe6e9d1c640 1 -- 172.21.15.81:0/3227311202 wait complete. 2024-09-21T02:57:44.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.81:6836/982276876,v1:172.21.15.81:6837/982276876] up:boot 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: fsmap 4 up:standby 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:57:44.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:44 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3227311202' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:44.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:44.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:44.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:44.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.81:6836/982276876,v1:172.21.15.81:6837/982276876] up:boot 2024-09-21T02:57:44.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: fsmap 4 up:standby 2024-09-21T02:57:44.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:57:44.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:44 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3227311202' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.81:6836/982276876,v1:172.21.15.81:6837/982276876] up:boot 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: fsmap 4 up:standby 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:57:44.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:44 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3227311202' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:45.864 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:45 smithi164 ceph-mon[34236]: Deploying daemon mds.e on smithi164 2024-09-21T02:57:45.864 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:45 smithi164 ceph-mon[34236]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:45 smithi181 ceph-mon[34096]: Deploying daemon mds.e on smithi164 2024-09-21T02:57:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:45 smithi181 ceph-mon[34096]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:46.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:45 smithi081 ceph-mon[30991]: Deploying daemon mds.e on smithi164 2024-09-21T02:57:46.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:45 smithi081 ceph-mon[30991]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:46.431 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 02:57:46 smithi164 systemd[1]: Started Ceph mds.e for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:47.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: Deploying daemon mds.f on smithi181 2024-09-21T02:57:47.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6834/1947556688,v1:172.21.15.164:6835/1947556688] up:boot 2024-09-21T02:57:47.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: fsmap 5 up:standby 2024-09-21T02:57:47.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:47 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:57:47.676 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:47.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:47.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: Deploying daemon mds.f on smithi181 2024-09-21T02:57:47.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6834/1947556688,v1:172.21.15.164:6835/1947556688] up:boot 2024-09-21T02:57:47.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: fsmap 5 up:standby 2024-09-21T02:57:47.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:47 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:47.694 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: Deploying daemon mds.f on smithi181 2024-09-21T02:57:47.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6834/1947556688,v1:172.21.15.164:6835/1947556688] up:boot 2024-09-21T02:57:47.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: fsmap 5 up:standby 2024-09-21T02:57:47.695 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:47 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:57:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 -- 172.21.15.81:0/2422549670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 msgr2=0x7fc1301087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 --2- 172.21.15.81:0/2422549670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301087e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009900 tx=0x7fc11c02a410 comp rx=0 tx=0).stop 2024-09-21T02:57:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 -- 172.21.15.81:0/2422549670 shutdown_connections 2024-09-21T02:57:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 --2- 172.21.15.81:0/2422549670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc130108d20 0x7fc13010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 --2- 172.21.15.81:0/2422549670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301087e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 --2- 172.21.15.81:0/2422549670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc130102a90 0x7fc130102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 -- 172.21.15.81:0/2422549670 >> 172.21.15.81:0/2422549670 conn(0x7fc130079750 msgr2=0x7fc130079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 -- 172.21.15.81:0/2422549670 shutdown_connections 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.153+0000 7fc136b29640 1 -- 172.21.15.81:0/2422549670 wait complete. 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 Processor -- start 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 -- start start 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc130102a90 0x7fc130199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc130108d20 0x7fc13019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc130112890 con 0x7fc1301083d0 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc130112710 con 0x7fc130102a90 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc136b29640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc130112a10 con 0x7fc130108d20 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc12ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc12ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33388/0 (socket says 172.21.15.81:33388) 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc12ffff640 1 -- 172.21.15.81:0/2910585334 learned_addr learned my addr 172.21.15.81:0/2910585334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc1350c6640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc130108d20 0x7fc13019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.154+0000 7fc1348c5640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc130102a90 0x7fc130199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12ffff640 1 -- 172.21.15.81:0/2910585334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc130108d20 msgr2=0x7fc13019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12ffff640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc130108d20 0x7fc13019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12ffff640 1 -- 172.21.15.81:0/2910585334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc130102a90 msgr2=0x7fc130199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12ffff640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc130102a90 0x7fc130199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12ffff640 1 -- 172.21.15.81:0/2910585334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13019f1f0 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12ffff640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301998e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc11c02a930 tx=0x7fc11c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12dffb640 1 -- 172.21.15.81:0/2910585334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c03f070 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12dffb640 1 -- 172.21.15.81:0/2910585334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc11c03baf0 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc12dffb640 1 -- 172.21.15.81:0/2910585334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c035030 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13019f480 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.155+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13019f910 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.156+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc130103d10 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.158+0000 7fc12dffb640 1 -- 172.21.15.81:0/2910585334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc11c042070 con 0x7fc1301083d0 2024-09-21T02:57:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.158+0000 7fc12dffb640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc1200b6540 0x7fc1200b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.158+0000 7fc1348c5640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc1200b6540 0x7fc1200b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.158+0000 7fc12dffb640 1 -- 172.21.15.81:0/2910585334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fc11c107550 con 0x7fc1301083d0 2024-09-21T02:57:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.159+0000 7fc1348c5640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc1200b6540 0x7fc1200b8a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc124009b60 tx=0x7fc124005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.163+0000 7fc12dffb640 1 -- 172.21.15.81:0/2910585334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc11c0ce280 con 0x7fc1301083d0 2024-09-21T02:57:48.249 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 systemd[1]: Starting Ceph mds.f for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.375+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc13019a470 con 0x7fc1301083d0 2024-09-21T02:57:48.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.375+0000 7fc12dffb640 1 -- 172.21.15.81:0/2910585334 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7fc11c0d2660 con 0x7fc1301083d0 2024-09-21T02:57:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:48.377 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":6,"btime":"2024-09-21T02:57:46:664764+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T02:57:48.377 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 6 2024-09-21T02:57:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc1200b6540 msgr2=0x7fc1200b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc1200b6540 0x7fc1200b8a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc124009b60 tx=0x7fc124005f90 comp rx=0 tx=0).stop 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 msgr2=0x7fc1301998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301998e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc11c02a930 tx=0x7fc11c003b90 comp rx=0 tx=0).stop 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 shutdown_connections 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc1200b6540 0x7fc1200b8a50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc130108d20 0x7fc13019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1301083d0 0x7fc1301998e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 --2- 172.21.15.81:0/2910585334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc130102a90 0x7fc130199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 >> 172.21.15.81:0/2910585334 conn(0x7fc130079750 msgr2=0x7fc1301044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 shutdown_connections 2024-09-21T02:57:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:48.378+0000 7fc136b29640 1 -- 172.21.15.81:0/2910585334 wait complete. 2024-09-21T02:57:48.657 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 podman[62566]: 2024-09-21 02:57:48.283460009 +0000 UTC m=+0.015852537 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:48.658 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 podman[62566]: 2024-09-21 02:57:48.404244717 +0000 UTC m=+0.136637276 container create dbb06427d56550ea34de83ee60fc2490acd5da99268fe04c85dad63fb57d4ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T02:57:48.999 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 podman[62566]: 2024-09-21 02:57:48.656802717 +0000 UTC m=+0.389195239 container init dbb06427d56550ea34de83ee60fc2490acd5da99268fe04c85dad63fb57d4ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T02:57:48.999 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 podman[62566]: 2024-09-21 02:57:48.659701861 +0000 UTC m=+0.392094368 container start dbb06427d56550ea34de83ee60fc2490acd5da99268fe04c85dad63fb57d4ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:57:48.999 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 ceph-mds[62585]: -- 172.21.15.181:0/437143187 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56448209b860 con 0x564486243180 2024-09-21T02:57:48.999 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f[62581]: starting mds.f at 2024-09-21T02:57:48.999 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 bash[62566]: dbb06427d56550ea34de83ee60fc2490acd5da99268fe04c85dad63fb57d4ba2 2024-09-21T02:57:48.999 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 02:57:48 smithi181 systemd[1]: Started Ceph mds.f for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2910585334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2910585334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2910585334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:50.551 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:50 smithi181 ceph-mon[34096]: Deploying daemon mds.c on smithi181 2024-09-21T02:57:50.551 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:50 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6834/3990133631,v1:172.21.15.181:6835/3990133631] up:boot 2024-09-21T02:57:50.551 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:50 smithi181 ceph-mon[34096]: fsmap 6 up:standby 2024-09-21T02:57:50.551 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:50 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:57:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:50 smithi081 ceph-mon[30991]: Deploying daemon mds.c on smithi181 2024-09-21T02:57:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:50 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6834/3990133631,v1:172.21.15.181:6835/3990133631] up:boot 2024-09-21T02:57:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:50 smithi081 ceph-mon[30991]: fsmap 6 up:standby 2024-09-21T02:57:50.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:50 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:57:50.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:50 smithi164 ceph-mon[34236]: Deploying daemon mds.c on smithi181 2024-09-21T02:57:50.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:50 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6834/3990133631,v1:172.21.15.181:6835/3990133631] up:boot 2024-09-21T02:57:50.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:50 smithi164 ceph-mon[34236]: fsmap 6 up:standby 2024-09-21T02:57:50.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:50 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:57:50.939 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:50 smithi181 systemd[1]: Starting Ceph mds.c for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:51.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:51.196 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:50 smithi181 podman[62833]: 2024-09-21 02:57:50.840790689 +0000 UTC m=+0.016051525 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:51.196 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:50 smithi181 podman[62833]: 2024-09-21 02:57:50.96831656 +0000 UTC m=+0.143577428 container create e50eaf792f765531330091200871a99bff954484cb860448eee194e099df3bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:57:51.196 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:51 smithi181 podman[62833]: 2024-09-21 02:57:51.195772178 +0000 UTC m=+0.371033006 container init e50eaf792f765531330091200871a99bff954484cb860448eee194e099df3bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T02:57:51.378 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:51 smithi181 ceph-mon[34096]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:51.499 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:51 smithi181 podman[62833]: 2024-09-21 02:57:51.198566843 +0000 UTC m=+0.373827674 container start e50eaf792f765531330091200871a99bff954484cb860448eee194e099df3bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T02:57:51.499 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:51 smithi181 ceph-mds[62852]: -- 172.21.15.181:0/2532268346 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a406717860 con 0x55a40a8bf600 2024-09-21T02:57:51.499 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c[62848]: starting mds.c at 2024-09-21T02:57:51.499 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:51 smithi181 bash[62833]: e50eaf792f765531330091200871a99bff954484cb860448eee194e099df3bb8 2024-09-21T02:57:51.499 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 02:57:51 smithi181 systemd[1]: Started Ceph mds.c for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:51.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:51 smithi081 ceph-mon[30991]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:51.582 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:51 smithi164 ceph-mon[34236]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 -- 172.21.15.81:0/1444355758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f01094b0 msgr2=0x7f44f01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 --2- 172.21.15.81:0/1444355758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f01094b0 0x7f44f01098c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009ca0 tx=0x7f44e402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 -- 172.21.15.81:0/1444355758 shutdown_connections 2024-09-21T02:57:51.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 --2- 172.21.15.81:0/1444355758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f0109e00 0x7f44f0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 --2- 172.21.15.81:0/1444355758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f01094b0 0x7f44f01098c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 --2- 172.21.15.81:0/1444355758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f0103bc0 0x7f44f0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 -- 172.21.15.81:0/1444355758 >> 172.21.15.81:0/1444355758 conn(0x7f44f007b910 msgr2=0x7f44f007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 -- 172.21.15.81:0/1444355758 shutdown_connections 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.882+0000 7f44f826b640 1 -- 172.21.15.81:0/1444355758 wait complete. 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 Processor -- start 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 -- start start 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f0103bc0 0x7f44f019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f01094b0 0x7f44f019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f0109e00 0x7f44f019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01139c0 con 0x7f44f0103bc0 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0113840 con 0x7f44f0109e00 2024-09-21T02:57:51.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f826b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0113b40 con 0x7f44f01094b0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f0103bc0 0x7f44f019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f0103bc0 0x7f44f019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43480/0 (socket says 172.21.15.81:43480) 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 -- 172.21.15.81:0/760659139 learned_addr learned my addr 172.21.15.81:0/760659139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6808640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f0109e00 0x7f44f019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f5806640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f01094b0 0x7f44f019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 -- 172.21.15.81:0/760659139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f01094b0 msgr2=0x7f44f019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f01094b0 0x7f44f019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 -- 172.21.15.81:0/760659139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f0109e00 msgr2=0x7f44f019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f0109e00 0x7f44f019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.883+0000 7f44f6007640 1 -- 172.21.15.81:0/760659139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f01a03a0 con 0x7f44f0103bc0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.884+0000 7f44f6007640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f0103bc0 0x7f44f019a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c970 tx=0x7f44e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.884+0000 7f44e37fe640 1 -- 172.21.15.81:0/760659139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8007bb0 con 0x7f44f0103bc0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.884+0000 7f44e37fe640 1 -- 172.21.15.81:0/760659139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44e8007d50 con 0x7f44f0103bc0 2024-09-21T02:57:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.884+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f01a0690 con 0x7f44f0103bc0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.884+0000 7f44e37fe640 1 -- 172.21.15.81:0/760659139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8004e40 con 0x7f44f0103bc0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.884+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f01a6df0 con 0x7f44f0103bc0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.885+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f0103fd0 con 0x7f44f0103bc0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.887+0000 7f44e37fe640 1 -- 172.21.15.81:0/760659139 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f44e8005020 con 0x7f44f0103bc0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.887+0000 7f44e37fe640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44dc0b6510 0x7f44dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.887+0000 7f44f5806640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44dc0b6510 0x7f44dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.887+0000 7f44e37fe640 1 -- 172.21.15.81:0/760659139 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f44e80e6ba0 con 0x7f44f0103bc0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.888+0000 7f44f5806640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44dc0b6510 0x7f44dc0b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006010 tx=0x7f44e4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:51.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:51.892+0000 7f44e37fe640 1 -- 172.21.15.81:0/760659139 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44e8014030 con 0x7f44f0103bc0 2024-09-21T02:57:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.106+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44f019b560 con 0x7f44f0103bc0 2024-09-21T02:57:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.106+0000 7f44e37fe640 1 -- 172.21.15.81:0/760659139 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7f44e80ad8d0 con 0x7f44f0103bc0 2024-09-21T02:57:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:52.108 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"btime":"2024-09-21T02:57:51:298194+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24547,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T02:57:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2024-09-21T02:57:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44dc0b6510 msgr2=0x7f44dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44dc0b6510 0x7f44dc0b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006010 tx=0x7f44e4000f40 comp rx=0 tx=0).stop 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f0103bc0 msgr2=0x7f44f019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f0103bc0 0x7f44f019a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c970 tx=0x7f44e800ce30 comp rx=0 tx=0).stop 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 shutdown_connections 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44dc0b6510 0x7f44dc0b8a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44f01094b0 0x7f44f019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f0109e00 0x7f44f019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 --2- 172.21.15.81:0/760659139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44f0103bc0 0x7f44f019a430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 >> 172.21.15.81:0/760659139 conn(0x7f44f007b910 msgr2=0x7f44f0105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 shutdown_connections 2024-09-21T02:57:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:52.109+0000 7f44f826b640 1 -- 172.21.15.81:0/760659139 wait complete. 2024-09-21T02:57:52.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6836/3046788185,v1:172.21.15.181:6837/3046788185] up:boot 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: fsmap 7 up:standby 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: Deploying daemon mds.h on smithi164 2024-09-21T02:57:52.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:52 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/760659139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6836/3046788185,v1:172.21.15.181:6837/3046788185] up:boot 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: fsmap 7 up:standby 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:52.535 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:52.536 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: Deploying daemon mds.h on smithi164 2024-09-21T02:57:52.536 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:52 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/760659139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6836/3046788185,v1:172.21.15.181:6837/3046788185] up:boot 2024-09-21T02:57:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: fsmap 7 up:standby 2024-09-21T02:57:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:57:52.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:52.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:52.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:52.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:52.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: Deploying daemon mds.h on smithi164 2024-09-21T02:57:52.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:52 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/760659139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:53.622 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:53 smithi164 ceph-mon[34236]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:53.623 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:53 smithi164 systemd[1]: Starting Ceph mds.h for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:53.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:53 smithi181 ceph-mon[34096]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:53.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:53 smithi081 ceph-mon[30991]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:53.899 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:53 smithi164 podman[62458]: 2024-09-21 02:57:53.523808286 +0000 UTC m=+0.016211667 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:53.900 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:53 smithi164 podman[62458]: 2024-09-21 02:57:53.645874286 +0000 UTC m=+0.138277669 container create ce2bdcf938d17ffbd6ae4fb33f139e292f8f82c37edb1294fd42724ebf9519a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T02:57:53.900 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:53 smithi164 podman[62458]: 2024-09-21 02:57:53.898770831 +0000 UTC m=+0.391174205 container init ce2bdcf938d17ffbd6ae4fb33f139e292f8f82c37edb1294fd42724ebf9519a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T02:57:54.181 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:53 smithi164 podman[62458]: 2024-09-21 02:57:53.90168649 +0000 UTC m=+0.394089862 container start ce2bdcf938d17ffbd6ae4fb33f139e292f8f82c37edb1294fd42724ebf9519a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T02:57:54.181 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:53 smithi164 ceph-mds[62477]: -- 172.21.15.164:0/1927217430 <== mon.2 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c98aee1c20 con 0x55c98f089600 2024-09-21T02:57:54.182 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:53 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h[62473]: starting mds.h at 2024-09-21T02:57:54.182 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:54 smithi164 bash[62458]: ce2bdcf938d17ffbd6ae4fb33f139e292f8f82c37edb1294fd42724ebf9519a8 2024-09-21T02:57:54.182 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 02:57:54 smithi164 systemd[1]: Started Ceph mds.h for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:54.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:55.088 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: Deploying daemon mds.i on smithi181 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] up:boot 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: fsmap 8 up:standby 2024-09-21T02:57:55.209 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:55 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:55.329 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: Deploying daemon mds.i on smithi181 2024-09-21T02:57:55.330 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] up:boot 2024-09-21T02:57:55.330 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: fsmap 8 up:standby 2024-09-21T02:57:55.330 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:55 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:57:55.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:55.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: Deploying daemon mds.i on smithi181 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] up:boot 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: fsmap 8 up:standby 2024-09-21T02:57:55.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:55 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:57:55.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/3165398178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98105310 msgr2=0x7fdc9810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:55.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/3165398178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98105310 0x7fdc9810d860 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009900 tx=0x7fdc8c02a410 comp rx=0 tx=0).stop 2024-09-21T02:57:55.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/3165398178 shutdown_connections 2024-09-21T02:57:55.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/3165398178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc9810de20 0x7fdc98110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/3165398178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc98105310 0x7fdc9810d860 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/3165398178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc981049c0 0x7fdc98104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/3165398178 >> 172.21.15.81:0/3165398178 conn(0x7fdc98079710 msgr2=0x7fdc98079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/3165398178 shutdown_connections 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.607+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/3165398178 wait complete. 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 Processor -- start 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 -- start start 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc981049c0 0x7fdc9819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc98105310 0x7fdc9819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9810de20 0x7fdc9819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc98113930 con 0x7fdc9810de20 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdc981137b0 con 0x7fdc981049c0 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9fbaa640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdc98113ab0 con 0x7fdc98105310 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9e147640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9810de20 0x7fdc9819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:55.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9e147640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9810de20 0x7fdc9819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43494/0 (socket says 172.21.15.81:43494) 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9e147640 1 -- 172.21.15.81:0/1303969073 learned_addr learned my addr 172.21.15.81:0/1303969073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9d145640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc98105310 0x7fdc9819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.608+0000 7fdc9d946640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc981049c0 0x7fdc9819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9e147640 1 -- 172.21.15.81:0/1303969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc98105310 msgr2=0x7fdc9819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9e147640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc98105310 0x7fdc9819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9e147640 1 -- 172.21.15.81:0/1303969073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc981049c0 msgr2=0x7fdc9819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9e147640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc981049c0 0x7fdc9819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9e147640 1 -- 172.21.15.81:0/1303969073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc981a0290 con 0x7fdc9810de20 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9d946640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc981049c0 0x7fdc9819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9e147640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9810de20 0x7fdc9819fc20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c970 tx=0x7fdc9000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc96ffd640 1 -- 172.21.15.81:0/1303969073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90007bb0 con 0x7fdc9810de20 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc96ffd640 1 -- 172.21.15.81:0/1303969073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc90007d50 con 0x7fdc9810de20 2024-09-21T02:57:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc981a0580 con 0x7fdc9810de20 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc96ffd640 1 -- 172.21.15.81:0/1303969073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90018660 con 0x7fdc9810de20 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.609+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc981a0a40 con 0x7fdc9810de20 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.610+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9806c260 con 0x7fdc9810de20 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.611+0000 7fdc96ffd640 1 -- 172.21.15.81:0/1303969073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdc9000f970 con 0x7fdc9810de20 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.612+0000 7fdc96ffd640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdc800b6540 0x7fdc800b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.612+0000 7fdc9d946640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdc800b6540 0x7fdc800b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.612+0000 7fdc96ffd640 1 -- 172.21.15.81:0/1303969073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fdc900e7000 con 0x7fdc9810de20 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.613+0000 7fdc9d946640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdc800b6540 0x7fdc800b8a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005fd0 tx=0x7fdc880093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.615+0000 7fdc96ffd640 1 -- 172.21.15.81:0/1303969073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc90056710 con 0x7fdc9810de20 2024-09-21T02:57:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.830+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc98104dd0 con 0x7fdc9810de20 2024-09-21T02:57:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.830+0000 7fdc96ffd640 1 -- 172.21.15.81:0/1303969073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7fdc90014030 con 0x7fdc9810de20 2024-09-21T02:57:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:55.832 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T02:57:54:366105+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24547,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24572,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T02:57:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T02:57:55.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdc800b6540 msgr2=0x7fdc800b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdc800b6540 0x7fdc800b8a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005fd0 tx=0x7fdc880093e0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9810de20 msgr2=0x7fdc9819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9810de20 0x7fdc9819fc20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000c970 tx=0x7fdc9000ce30 comp rx=0 tx=0).stop 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 shutdown_connections 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdc800b6540 0x7fdc800b8a50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc98105310 0x7fdc9819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc9810de20 0x7fdc9819fc20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 --2- 172.21.15.81:0/1303969073 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc981049c0 0x7fdc9819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 >> 172.21.15.81:0/1303969073 conn(0x7fdc98079710 msgr2=0x7fdc980ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 shutdown_connections 2024-09-21T02:57:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:55.833+0000 7fdc9fbaa640 1 -- 172.21.15.81:0/1303969073 wait complete. 2024-09-21T02:57:55.996 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:55 smithi181 systemd[1]: Starting Ceph mds.i for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:56.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:56 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1303969073' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:56.249 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 podman[63104]: 2024-09-21 02:57:56.111478905 +0000 UTC m=+0.016509754 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:56.249 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 podman[63104]: 2024-09-21 02:57:56.217343085 +0000 UTC m=+0.122373968 container create 55aa1f22a1f8f4a28aa96c803d8d325a95ff099c8f1ebe8f757081e50fe27c0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T02:57:56.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:56 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1303969073' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:56.532 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:56 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1303969073' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:57:56.749 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 podman[63104]: 2024-09-21 02:57:56.462075384 +0000 UTC m=+0.367106231 container init 55aa1f22a1f8f4a28aa96c803d8d325a95ff099c8f1ebe8f757081e50fe27c0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T02:57:56.749 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 podman[63104]: 2024-09-21 02:57:56.464972625 +0000 UTC m=+0.370003463 container start 55aa1f22a1f8f4a28aa96c803d8d325a95ff099c8f1ebe8f757081e50fe27c0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:57:56.749 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 ceph-mds[63124]: -- 172.21.15.181:0/1169463722 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c20bf9860 con 0x562c24da1180 2024-09-21T02:57:56.749 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i[63120]: starting mds.i at 2024-09-21T02:57:56.749 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 bash[63104]: 55aa1f22a1f8f4a28aa96c803d8d325a95ff099c8f1ebe8f757081e50fe27c0c 2024-09-21T02:57:56.749 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 02:57:56 smithi181 systemd[1]: Started Ceph mds.i for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: Deploying daemon mds.g on smithi081 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] up:boot 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: fsmap 9 up:standby 2024-09-21T02:57:57.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:57 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: Deploying daemon mds.g on smithi081 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] up:boot 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: fsmap 9 up:standby 2024-09-21T02:57:57.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:57 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: Deploying daemon mds.g on smithi081 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] up:boot 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: fsmap 9 up:standby 2024-09-21T02:57:58.000 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:57 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:57:58.554 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:58 smithi081 systemd[1]: Starting Ceph mds.g for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:57:58.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:57:58.840 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:58 smithi081 podman[71020]: 2024-09-21 02:57:58.593648803 +0000 UTC m=+0.017737096 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:57:58.841 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:58 smithi081 podman[71020]: 2024-09-21 02:57:58.717415058 +0000 UTC m=+0.141503340 container create c956db1e1f3cc4a883c9cf4cc3e05b4b50d7bdb2c59e92e4fd1d7da07646d512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T02:57:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:57:59.258 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:58 smithi081 podman[71020]: 2024-09-21 02:57:58.987019779 +0000 UTC m=+0.411108070 container init c956db1e1f3cc4a883c9cf4cc3e05b4b50d7bdb2c59e92e4fd1d7da07646d512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T02:57:59.258 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:58 smithi081 podman[71020]: 2024-09-21 02:57:58.990311934 +0000 UTC m=+0.414400227 container start c956db1e1f3cc4a883c9cf4cc3e05b4b50d7bdb2c59e92e4fd1d7da07646d512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T02:57:59.258 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mds[71074]: -- 172.21.15.81:0/1609188257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a43320f860 con 0x55a4373b7180 2024-09-21T02:57:59.259 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g[71058]: starting mds.g at 2024-09-21T02:57:59.259 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:59 smithi081 bash[71020]: c956db1e1f3cc4a883c9cf4cc3e05b4b50d7bdb2c59e92e4fd1d7da07646d512 2024-09-21T02:57:59.259 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 02:57:59 smithi081 systemd[1]: Started Ceph mds.g for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3950220492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 msgr2=0x7f9ef41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3950220492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef41098b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009900 tx=0x7f9edc02a410 comp rx=0 tx=0).stop 2024-09-21T02:57:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3950220492 shutdown_connections 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3950220492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ef4109df0 0x7f9ef4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3950220492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef41098b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3950220492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ef4103b60 0x7f9ef4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3950220492 >> 172.21.15.81:0/3950220492 conn(0x7f9ef407b850 msgr2=0x7f9ef407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3950220492 shutdown_connections 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.613+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3950220492 wait complete. 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.614+0000 7f9ef8d60640 1 Processor -- start 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.614+0000 7f9ef8d60640 1 -- start start 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef8d60640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ef4103b60 0x7f9ef4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef8d60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef8d60640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ef4109df0 0x7f9ef4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef8d60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef4113960 con 0x7f9ef41094a0 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef8d60640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef41137e0 con 0x7f9ef4103b60 2024-09-21T02:57:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef8d60640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef4113ae0 con 0x7f9ef4109df0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43544/0 (socket says 172.21.15.81:43544) 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 -- 172.21.15.81:0/3337705195 learned_addr learned my addr 172.21.15.81:0/3337705195 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef2d9d640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ef4109df0 0x7f9ef4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef259c640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ef4103b60 0x7f9ef4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 -- 172.21.15.81:0/3337705195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ef4109df0 msgr2=0x7f9ef4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ef4109df0 0x7f9ef4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 -- 172.21.15.81:0/3337705195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ef4103b60 msgr2=0x7f9ef4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ef4103b60 0x7f9ef4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.615+0000 7f9ef1d9b640 1 -- 172.21.15.81:0/3337705195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef41a86d0 con 0x7f9ef41094a0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.616+0000 7f9ef1d9b640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef4075c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9edc005940 tx=0x7f9edc0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.622+0000 7f9eeb7fe640 1 -- 172.21.15.81:0/3337705195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc03f030 con 0x7f9ef41094a0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.622+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef41a8960 con 0x7f9ef41094a0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.622+0000 7f9eeb7fe640 1 -- 172.21.15.81:0/3337705195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9edc003a80 con 0x7f9ef41094a0 2024-09-21T02:57:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.622+0000 7f9eeb7fe640 1 -- 172.21.15.81:0/3337705195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc035070 con 0x7f9ef41094a0 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.622+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef41a8e90 con 0x7f9ef41094a0 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.623+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef4103f70 con 0x7f9ef41094a0 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.625+0000 7f9eeb7fe640 1 -- 172.21.15.81:0/3337705195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9edc042030 con 0x7f9ef41094a0 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.626+0000 7f9eeb7fe640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9ee00b6590 0x7f9ee00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.626+0000 7f9ef259c640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9ee00b6590 0x7f9ee00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.626+0000 7f9eeb7fe640 1 -- 172.21.15.81:0/3337705195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f9edc107650 con 0x7f9ef41094a0 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.626+0000 7f9ef259c640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9ee00b6590 0x7f9ee00b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40058c0 tx=0x7f9ee400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:57:59.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.629+0000 7f9eeb7fe640 1 -- 172.21.15.81:0/3337705195 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9edc0d2760 con 0x7f9ef41094a0 2024-09-21T02:57:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mon[30991]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:57:59 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:59.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.852+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ef4076a10 con 0x7f9ef41094a0 2024-09-21T02:57:59.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.853+0000 7f9eeb7fe640 1 -- 172.21.15.81:0/3337705195 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8881 (secure 0 0 0) 0x7f9edc0d76a0 con 0x7f9ef41094a0 2024-09-21T02:57:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:57:59.854 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":11,"btime":"2024-09-21T02:57:59:614122+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24547,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24572,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T02:57:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 11 2024-09-21T02:57:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9ee00b6590 msgr2=0x7f9ee00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9ee00b6590 0x7f9ee00b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40058c0 tx=0x7f9ee400a2d0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 msgr2=0x7f9ef4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef4075c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9edc005940 tx=0x7f9edc0040e0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 shutdown_connections 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9ee00b6590 0x7f9ee00b8aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9ef4109df0 0x7f9ef4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef41094a0 0x7f9ef4075c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 --2- 172.21.15.81:0/3337705195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ef4103b60 0x7f9ef4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 >> 172.21.15.81:0/3337705195 conn(0x7f9ef407b850 msgr2=0x7f9ef41055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 shutdown_connections 2024-09-21T02:57:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:57:59.855+0000 7f9ef8d60640 1 -- 172.21.15.81:0/3337705195 wait complete. 2024-09-21T02:57:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:59 smithi164 ceph-mon[34236]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:59.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:57:59 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:57:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:59 smithi181 ceph-mon[34096]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:57:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:57:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:57:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:57:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:57:59 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:00.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:00 smithi081 ceph-mon[30991]: Deploying daemon mds.a on smithi081 2024-09-21T02:58:00.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:00 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.81:6838/1201929574,v1:172.21.15.81:6839/1201929574] up:boot 2024-09-21T02:58:00.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:00 smithi081 ceph-mon[30991]: fsmap 10 up:standby 2024-09-21T02:58:00.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:00 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:58:00.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:00 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3337705195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:00.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:00 smithi164 ceph-mon[34236]: Deploying daemon mds.a on smithi081 2024-09-21T02:58:00.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:00 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.81:6838/1201929574,v1:172.21.15.81:6839/1201929574] up:boot 2024-09-21T02:58:00.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:00 smithi164 ceph-mon[34236]: fsmap 10 up:standby 2024-09-21T02:58:00.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:00 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:58:00.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:00 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3337705195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:00 smithi181 ceph-mon[34096]: Deploying daemon mds.a on smithi081 2024-09-21T02:58:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:00 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.81:6838/1201929574,v1:172.21.15.81:6839/1201929574] up:boot 2024-09-21T02:58:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:00 smithi181 ceph-mon[34096]: fsmap 10 up:standby 2024-09-21T02:58:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:00 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:58:00.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:00 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3337705195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:01.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:01 smithi081 ceph-mon[30991]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:01.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:01 smithi164 ceph-mon[34236]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:01.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:01 smithi181 ceph-mon[34096]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:02.055 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:01 smithi081 systemd[1]: Starting Ceph mds.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T02:58:02.465 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 podman[71395]: 2024-09-21 02:58:02.053272442 +0000 UTC m=+0.016018802 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:58:02.465 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 podman[71395]: 2024-09-21 02:58:02.186283897 +0000 UTC m=+0.149030250 container create 34e6ee5b313aee38779d29a71217eb4e71986689edb6177e08b69d9289b307c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T02:58:02.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:58:02.805 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 podman[71395]: 2024-09-21 02:58:02.464458148 +0000 UTC m=+0.427204504 container init 34e6ee5b313aee38779d29a71217eb4e71986689edb6177e08b69d9289b307c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T02:58:02.806 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 podman[71395]: 2024-09-21 02:58:02.467260093 +0000 UTC m=+0.430006446 container start 34e6ee5b313aee38779d29a71217eb4e71986689edb6177e08b69d9289b307c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T02:58:02.806 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 ceph-mds[71414]: -- 172.21.15.81:0/2021244165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f6ee9f1860 con 0x55f6f2b99180 2024-09-21T02:58:02.806 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a[71410]: starting mds.a at 2024-09-21T02:58:02.806 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 bash[71395]: 34e6ee5b313aee38779d29a71217eb4e71986689edb6177e08b69d9289b307c4 2024-09-21T02:58:02.806 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 02:58:02 smithi081 systemd[1]: Started Ceph mds.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:58:02.826 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:03.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 -- 172.21.15.81:0/3105437478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108420 msgr2=0x7f509c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 --2- 172.21.15.81:0/3105437478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108420 0x7f509c108830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5090009ca0 tx=0x7f509002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 -- 172.21.15.81:0/3105437478 shutdown_connections 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 --2- 172.21.15.81:0/3105437478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f509c108d70 0x7f509c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 --2- 172.21.15.81:0/3105437478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c108420 0x7f509c108830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 --2- 172.21.15.81:0/3105437478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f509c102ae0 0x7f509c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 -- 172.21.15.81:0/3105437478 >> 172.21.15.81:0/3105437478 conn(0x7f509c079770 msgr2=0x7f509c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 -- 172.21.15.81:0/3105437478 shutdown_connections 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.321+0000 7f50a2118640 1 -- 172.21.15.81:0/3105437478 wait complete. 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 Processor -- start 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 -- start start 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c102ae0 0x7f509c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f509c108420 0x7f509c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f509c108d70 0x7f509c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:03.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f509c112930 con 0x7f509c102ae0 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1127b0 con 0x7f509c108420 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f50a2118640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f509c112ab0 con 0x7f509c108d70 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.322+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c102ae0 0x7f509c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c102ae0 0x7f509c199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58486/0 (socket says 172.21.15.81:58486) 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 -- 172.21.15.81:0/3836783576 learned_addr learned my addr 172.21.15.81:0/3836783576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509bfff640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f509c108d70 0x7f509c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509affd640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f509c108420 0x7f509c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 -- 172.21.15.81:0/3836783576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f509c108d70 msgr2=0x7f509c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f509c108d70 0x7f509c19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 -- 172.21.15.81:0/3836783576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f509c108420 msgr2=0x7f509c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f509c108420 0x7f509c1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 -- 172.21.15.81:0/3836783576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c19f2b0 con 0x7f509c102ae0 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509affd640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f509c108420 0x7f509c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:03.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f509b7fe640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c102ae0 0x7f509c199340 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c890 tx=0x7f508c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f5098ff9640 1 -- 172.21.15.81:0/3836783576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c004220 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c19f5a0 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f5098ff9640 1 -- 172.21.15.81:0/3836783576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f508c007e40 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f5098ff9640 1 -- 172.21.15.81:0/3836783576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c004a00 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.323+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1a5d00 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.324+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509c103d60 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.326+0000 7f5098ff9640 1 -- 172.21.15.81:0/3836783576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f508c0079b0 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.327+0000 7f5098ff9640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50840b8720 0x7f50840bac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.327+0000 7f509affd640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50840b8720 0x7f50840bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.327+0000 7f5098ff9640 1 -- 172.21.15.81:0/3836783576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f508c0e6f80 con 0x7f509c102ae0 2024-09-21T02:58:03.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.327+0000 7f509affd640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50840b8720 0x7f50840bac30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5090006010 tx=0x7f5090031570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:03.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.330+0000 7f5098ff9640 1 -- 172.21.15.81:0/3836783576 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f508c014030 con 0x7f509c102ae0 2024-09-21T02:58:03.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.542+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f509c102ef0 con 0x7f509c102ae0 2024-09-21T02:58:03.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.542+0000 7f5098ff9640 1 -- 172.21.15.81:0/3836783576 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9707 (secure 0 0 0) 0x7f508c0adcb0 con 0x7f509c102ae0 2024-09-21T02:58:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:03.544 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"btime":"2024-09-21T02:58:02:628767+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24547,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24572,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T02:58:03.544 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.544+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50840b8720 msgr2=0x7f50840bac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.544+0000 7f50a2118640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50840b8720 0x7f50840bac30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5090006010 tx=0x7f5090031570 comp rx=0 tx=0).stop 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.544+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c102ae0 msgr2=0x7f509c199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.544+0000 7f50a2118640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c102ae0 0x7f509c199340 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c890 tx=0x7f508c00cd50 comp rx=0 tx=0).stop 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 shutdown_connections 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50840b8720 0x7f50840bac30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f509c108d70 0x7f509c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f509c108420 0x7f509c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 --2- 172.21.15.81:0/3836783576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c102ae0 0x7f509c199340 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 >> 172.21.15.81:0/3836783576 conn(0x7f509c079770 msgr2=0x7f509c106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 shutdown_connections 2024-09-21T02:58:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:03.545+0000 7f50a2118640 1 -- 172.21.15.81:0/3836783576 wait complete. 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: Deploying daemon mds.b on smithi164 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.81:6840/1840355403,v1:172.21.15.81:6841/1840355403] up:boot 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: fsmap 11 up:standby 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:58:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:03 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3836783576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:03.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: Deploying daemon mds.b on smithi164 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.81:6840/1840355403,v1:172.21.15.81:6841/1840355403] up:boot 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: fsmap 11 up:standby 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:58:03.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:03 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3836783576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: Deploying daemon mds.b on smithi164 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.81:6840/1840355403,v1:172.21.15.81:6841/1840355403] up:boot 2024-09-21T02:58:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: fsmap 11 up:standby 2024-09-21T02:58:04.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:58:04.000 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:03 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3836783576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:05.616 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 02:58:05 smithi164 systemd[1]: Started Ceph mds.b for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T02:58:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:05 smithi164 ceph-mon[34236]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:05 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:58:05.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:05 smithi181 ceph-mon[34096]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:05.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:05.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:05 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:58:06.001 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:05 smithi081 ceph-mon[30991]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:06.001 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:06.001 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:06.002 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:06.002 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:06.002 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:06.002 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:05 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:58:06.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:58:06.530 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:06.921 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:06 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] up:boot 2024-09-21T02:58:06.921 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:06 smithi081 ceph-mon[30991]: fsmap 12 up:standby 2024-09-21T02:58:06.921 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:06 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:58:06.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:06 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] up:boot 2024-09-21T02:58:06.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:06 smithi164 ceph-mon[34236]: fsmap 12 up:standby 2024-09-21T02:58:06.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:06 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:58:06.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:06 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] up:boot 2024-09-21T02:58:06.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:06 smithi181 ceph-mon[34096]: fsmap 12 up:standby 2024-09-21T02:58:06.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:06 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 -- 172.21.15.81:0/3490655279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 msgr2=0x7f0ad81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 --2- 172.21.15.81:0/3490655279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad81087e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009900 tx=0x7f0acc02a410 comp rx=0 tx=0).stop 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 -- 172.21.15.81:0/3490655279 shutdown_connections 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 --2- 172.21.15.81:0/3490655279 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad8108d20 0x7f0ad810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 --2- 172.21.15.81:0/3490655279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad81087e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 --2- 172.21.15.81:0/3490655279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad8102ae0 0x7f0ad8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 -- 172.21.15.81:0/3490655279 >> 172.21.15.81:0/3490655279 conn(0x7f0ad8079760 msgr2=0x7f0ad8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 -- 172.21.15.81:0/3490655279 shutdown_connections 2024-09-21T02:58:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.009+0000 7f0add171640 1 -- 172.21.15.81:0/3490655279 wait complete. 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 Processor -- start 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 -- start start 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad8102ae0 0x7f0ad819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad8108d20 0x7f0ad819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8113960 con 0x7f0ad81083d0 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad81137e0 con 0x7f0ad8102ae0 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0add171640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8113ae0 con 0x7f0ad8108d20 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0ad659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0ad659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad819a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58508/0 (socket says 172.21.15.81:58508) 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0ad659c640 1 -- 172.21.15.81:0/3049715003 learned_addr learned my addr 172.21.15.81:0/3049715003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:07.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.010+0000 7f0ad759e640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad8108d20 0x7f0ad819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad6d9d640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad8102ae0 0x7f0ad819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad659c640 1 -- 172.21.15.81:0/3049715003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad8108d20 msgr2=0x7f0ad819fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad659c640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad8108d20 0x7f0ad819fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad659c640 1 -- 172.21.15.81:0/3049715003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad8102ae0 msgr2=0x7f0ad819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad659c640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad8102ae0 0x7f0ad819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad659c640 1 -- 172.21.15.81:0/3049715003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad81a02c0 con 0x7f0ad81083d0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad6d9d640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad8102ae0 0x7f0ad819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0ad659c640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad819a8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0acc005940 tx=0x7f0acc005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0abffff640 1 -- 172.21.15.81:0/3049715003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc03f030 con 0x7f0ad81083d0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad81a0550 con 0x7f0ad81083d0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0abffff640 1 -- 172.21.15.81:0/3049715003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0acc0043d0 con 0x7f0ad81083d0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0abffff640 1 -- 172.21.15.81:0/3049715003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc035070 con 0x7f0ad81083d0 2024-09-21T02:58:07.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.011+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad81a6d10 con 0x7f0ad81083d0 2024-09-21T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.012+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad8103d10 con 0x7f0ad81083d0 2024-09-21T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.014+0000 7f0abffff640 1 -- 172.21.15.81:0/3049715003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0acc042030 con 0x7f0ad81083d0 2024-09-21T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.015+0000 7f0abffff640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0ac00b6510 0x7f0ac00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.015+0000 7f0ad6d9d640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0ac00b6510 0x7f0ac00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.015+0000 7f0abffff640 1 -- 172.21.15.81:0/3049715003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f0acc107600 con 0x7f0ad81083d0 2024-09-21T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.015+0000 7f0ad6d9d640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0ac00b6510 0x7f0ac00b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009c30 tx=0x7f0ac8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:07.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.018+0000 7f0abffff640 1 -- 172.21.15.81:0/3049715003 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0acc0ce330 con 0x7f0ad81083d0 2024-09-21T02:58:07.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.261+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ad8102ef0 con 0x7f0ad81083d0 2024-09-21T02:58:07.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.261+0000 7f0abffff640 1 -- 172.21.15.81:0/3049715003 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f0acc0d2710 con 0x7f0ad81083d0 2024-09-21T02:58:07.263 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:07.263 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":13,"btime":"2024-09-21T02:58:05:612046+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24547,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24572,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T02:58:07.264 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 13 2024-09-21T02:58:07.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0ac00b6510 msgr2=0x7f0ac00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:07.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0ac00b6510 0x7f0ac00b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009c30 tx=0x7f0ac8005f90 comp rx=0 tx=0).stop 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 msgr2=0x7f0ad819a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad819a8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0acc005940 tx=0x7f0acc005e30 comp rx=0 tx=0).stop 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 shutdown_connections 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0ac00b6510 0x7f0ac00b8a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad8108d20 0x7f0ad819fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ad81083d0 0x7f0ad819a8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 --2- 172.21.15.81:0/3049715003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad8102ae0 0x7f0ad819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 >> 172.21.15.81:0/3049715003 conn(0x7f0ad8079760 msgr2=0x7f0ad81052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 shutdown_connections 2024-09-21T02:58:07.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:07.264+0000 7f0add171640 1 -- 172.21.15.81:0/3049715003 wait complete. 2024-09-21T02:58:07.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:07 smithi164 ceph-mon[34236]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:07.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:07 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:07 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3049715003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:07.951 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:07 smithi081 ceph-mon[30991]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:07.951 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:07 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:07 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3049715003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:07.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T02:58:07.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:07 smithi181 ceph-mon[34096]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:07 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:07 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3049715003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:08.250 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:08.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 -- 172.21.15.81:0/1759487453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe330102a70 msgr2=0x7fe330102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 --2- 172.21.15.81:0/1759487453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe330102a70 0x7fe330102e80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe320009900 tx=0x7fe32002a410 comp rx=0 tx=0).stop 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 -- 172.21.15.81:0/1759487453 shutdown_connections 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 --2- 172.21.15.81:0/1759487453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe330108d00 0x7fe33010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 --2- 172.21.15.81:0/1759487453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3301083b0 0x7fe3301087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 --2- 172.21.15.81:0/1759487453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe330102a70 0x7fe330102e80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 -- 172.21.15.81:0/1759487453 >> 172.21.15.81:0/1759487453 conn(0x7fe330079710 msgr2=0x7fe330079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 -- 172.21.15.81:0/1759487453 shutdown_connections 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 -- 172.21.15.81:0/1759487453 wait complete. 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 Processor -- start 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.786+0000 7fe3354bc640 1 -- start start 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe3354bc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe330102a70 0x7fe33019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe3354bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3301083b0 0x7fe33019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe3354bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe330108d00 0x7fe33019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe3354bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe330112870 con 0x7fe3301083b0 2024-09-21T02:58:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe3354bc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe3301126f0 con 0x7fe330102a70 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe3354bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe3301129f0 con 0x7fe330108d00 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3301083b0 0x7fe33019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3301083b0 0x7fe33019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58524/0 (socket says 172.21.15.81:58524) 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 -- 172.21.15.81:0/2815292527 learned_addr learned my addr 172.21.15.81:0/2815292527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32f7fe640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe330108d00 0x7fe33019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32effd640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe330102a70 0x7fe33019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 -- 172.21.15.81:0/2815292527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe330108d00 msgr2=0x7fe33019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe330108d00 0x7fe33019fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 -- 172.21.15.81:0/2815292527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe330102a70 msgr2=0x7fe33019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe330102a70 0x7fe33019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 -- 172.21.15.81:0/2815292527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3301a04a0 con 0x7fe3301083b0 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.787+0000 7fe32e7fc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3301083b0 0x7fe33019aad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e9f0 tx=0x7fe32400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.788+0000 7fe317fff640 1 -- 172.21.15.81:0/2815292527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32400ccc0 con 0x7fe3301083b0 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.788+0000 7fe317fff640 1 -- 172.21.15.81:0/2815292527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3240108c0 con 0x7fe3301083b0 2024-09-21T02:58:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.788+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3301a0790 con 0x7fe3301083b0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.788+0000 7fe317fff640 1 -- 172.21.15.81:0/2815292527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324018750 con 0x7fe3301083b0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.788+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3301a6ef0 con 0x7fe3301083b0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.789+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe330103cf0 con 0x7fe3301083b0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.790+0000 7fe317fff640 1 -- 172.21.15.81:0/2815292527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe324010430 con 0x7fe3301083b0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.791+0000 7fe317fff640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe3180b6590 0x7fe3180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.791+0000 7fe32effd640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe3180b6590 0x7fe3180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.791+0000 7fe317fff640 1 -- 172.21.15.81:0/2815292527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe3240e7570 con 0x7fe3301083b0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.792+0000 7fe32effd640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe3180b6590 0x7fe3180b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3200057c0 tx=0x7fe3200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.794+0000 7fe317fff640 1 -- 172.21.15.81:0/2815292527 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3240b2680 con 0x7fe3301083b0 2024-09-21T02:58:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.997+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe330102e80 con 0x7fe3301083b0 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:08.999 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:08 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:58:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:08.997+0000 7fe317fff640 1 -- 172.21.15.81:0/2815292527 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7fe3240b75c0 con 0x7fe3301083b0 2024-09-21T02:58:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:09.000 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-21T02:58:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T02:58:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-21T02:58:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-21T02:58:09.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T02:58:09.000 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe3180b6590 msgr2=0x7fe3180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe3180b6590 0x7fe3180b8aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3200057c0 tx=0x7fe3200058d0 comp rx=0 tx=0).stop 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3301083b0 msgr2=0x7fe33019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3301083b0 0x7fe33019aad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e9f0 tx=0x7fe32400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 shutdown_connections 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe3180b6590 0x7fe3180b8aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe330108d00 0x7fe33019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3301083b0 0x7fe33019aad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 --2- 172.21.15.81:0/2815292527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe330102a70 0x7fe33019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 >> 172.21.15.81:0/2815292527 conn(0x7fe330079710 msgr2=0x7fe330101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 shutdown_connections 2024-09-21T02:58:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:09.000+0000 7fe3354bc640 1 -- 172.21.15.81:0/2815292527 wait complete. 2024-09-21T02:58:09.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:09.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:09.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:58:09.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:08 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:58:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:58:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:09.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:08 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:58:10.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:09 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2815292527' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:58:10.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:09 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.268 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:09 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2815292527' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:58:10.268 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.268 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.268 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.268 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:09 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.342 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T02:58:10.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T02:58:10.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:09 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2815292527' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:58:10.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:09 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:10.634 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:11.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 -- 172.21.15.81:0/1393064898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102f50 msgr2=0x7fd98010fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:11.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1393064898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102f50 0x7fd98010fc70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd970009900 tx=0x7fd97002a480 comp rx=0 tx=0).stop 2024-09-21T02:58:11.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 -- 172.21.15.81:0/1393064898 shutdown_connections 2024-09-21T02:58:11.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1393064898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9801101b0 0x7fd9801125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:11.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1393064898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102f50 0x7fd98010fc70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1393064898 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd980102600 0x7fd980102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 -- 172.21.15.81:0/1393064898 >> 172.21.15.81:0/1393064898 conn(0x7fd980079720 msgr2=0x7fd980079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 -- 172.21.15.81:0/1393064898 shutdown_connections 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.149+0000 7fd9880fc640 1 -- 172.21.15.81:0/1393064898 wait complete. 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 Processor -- start 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 -- start start 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102600 0x7fd98019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd980102f50 0x7fd98019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9801101b0 0x7fd9801a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd980115b50 con 0x7fd980102600 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd9801159d0 con 0x7fd9801101b0 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd9880fc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd980115cd0 con 0x7fd980102f50 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd985e98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102600 0x7fd98019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd985e98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102600 0x7fd98019c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58548/0 (socket says 172.21.15.81:58548) 2024-09-21T02:58:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd985e98640 1 -- 172.21.15.81:0/1198830969 learned_addr learned my addr 172.21.15.81:0/1198830969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd986699640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9801101b0 0x7fd9801a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd985697640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd980102f50 0x7fd98019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd985e98640 1 -- 172.21.15.81:0/1198830969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd980102f50 msgr2=0x7fd98019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.150+0000 7fd985e98640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd980102f50 0x7fd98019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd985e98640 1 -- 172.21.15.81:0/1198830969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9801101b0 msgr2=0x7fd9801a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd985e98640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9801101b0 0x7fd9801a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd985e98640 1 -- 172.21.15.81:0/1198830969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9801a2590 con 0x7fd980102600 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd985697640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd980102f50 0x7fd98019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd985e98640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102600 0x7fd98019c620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00d950 tx=0x7fd97c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd976ffd640 1 -- 172.21.15.81:0/1198830969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c017070 con 0x7fd980102600 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd976ffd640 1 -- 172.21.15.81:0/1198830969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd97c009c30 con 0x7fd980102600 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9801a2880 con 0x7fd980102600 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd976ffd640 1 -- 172.21.15.81:0/1198830969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00f620 con 0x7fd980102600 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.151+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9801a8fe0 con 0x7fd980102600 2024-09-21T02:58:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.152+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98006c240 con 0x7fd980102600 2024-09-21T02:58:11.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.153+0000 7fd976ffd640 1 -- 172.21.15.81:0/1198830969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd97c010460 con 0x7fd980102600 2024-09-21T02:58:11.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.154+0000 7fd976ffd640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd96c0b6590 0x7fd96c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:11.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.154+0000 7fd985697640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd96c0b6590 0x7fd96c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:11.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.154+0000 7fd976ffd640 1 -- 172.21.15.81:0/1198830969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fd97c0e6a90 con 0x7fd980102600 2024-09-21T02:58:11.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.155+0000 7fd985697640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd96c0b6590 0x7fd96c0b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd970006010 tx=0x7fd970000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:11.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.159+0000 7fd976ffd640 1 -- 172.21.15.81:0/1198830969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd97c0ad7c0 con 0x7fd980102600 2024-09-21T02:58:11.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.336+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd98019d750 con 0x7fd980102600 2024-09-21T02:58:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:11 smithi081 ceph-mon[30991]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:58:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:11 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1198830969' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:58:11.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:11 smithi164 ceph-mon[34236]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:11.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:11.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:58:11.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:11 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1198830969' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:58:11.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:11 smithi181 ceph-mon[34096]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:11.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:58:11.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:58:11.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:58:11.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:11 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1198830969' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:58:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:11.998+0000 7fd976ffd640 1 -- 172.21.15.81:0/1198830969 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7fd97c009de0 con 0x7fd980102600 2024-09-21T02:58:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd96c0b6590 msgr2=0x7fd96c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd96c0b6590 0x7fd96c0b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd970006010 tx=0x7fd970000bc0 comp rx=0 tx=0).stop 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102600 msgr2=0x7fd98019c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102600 0x7fd98019c620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00d950 tx=0x7fd97c00de10 comp rx=0 tx=0).stop 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 shutdown_connections 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd96c0b6590 0x7fd96c0b8aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd980102f50 0x7fd98019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.002+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9801101b0 0x7fd9801a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.003+0000 7fd9880fc640 1 --2- 172.21.15.81:0/1198830969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd980102600 0x7fd98019c620 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.003+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 >> 172.21.15.81:0/1198830969 conn(0x7fd980079720 msgr2=0x7fd9801008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.003+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 shutdown_connections 2024-09-21T02:58:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:12.003+0000 7fd9880fc640 1 -- 172.21.15.81:0/1198830969 wait complete. 2024-09-21T02:58:12.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T02:58:12.966 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:13.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:13 smithi081 ceph-mon[30991]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:13.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:13 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1198830969' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:58:13.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:13 smithi081 ceph-mon[30991]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:58:13.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:13 smithi164 ceph-mon[34236]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:13.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:13 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1198830969' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:58:13.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:13 smithi164 ceph-mon[34236]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:58:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 -- 172.21.15.81:0/62874830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00102a80 msgr2=0x7f6d00102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 --2- 172.21.15.81:0/62874830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00102a80 0x7f6d00102e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009900 tx=0x7f6cf002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:58:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 -- 172.21.15.81:0/62874830 shutdown_connections 2024-09-21T02:58:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 --2- 172.21.15.81:0/62874830 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d00108d10 0x7f6d0010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 --2- 172.21.15.81:0/62874830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d001083c0 0x7f6d001087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:13.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 --2- 172.21.15.81:0/62874830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00102a80 0x7f6d00102e90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 -- 172.21.15.81:0/62874830 >> 172.21.15.81:0/62874830 conn(0x7f6d00079740 msgr2=0x7f6d00079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.461+0000 7f6d05dde640 1 -- 172.21.15.81:0/62874830 shutdown_connections 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.462+0000 7f6d05dde640 1 -- 172.21.15.81:0/62874830 wait complete. 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.462+0000 7f6d05dde640 1 Processor -- start 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.462+0000 7f6d05dde640 1 -- start start 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00102a80 0x7f6d00199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d001083c0 0x7f6d00199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00108d10 0x7f6d0019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00112890 con 0x7f6d00108d10 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00112710 con 0x7f6d00102a80 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00112a10 con 0x7f6d001083c0 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00108d10 0x7f6d0019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:13.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00108d10 0x7f6d0019ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47616/0 (socket says 172.21.15.81:47616) 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 -- 172.21.15.81:0/2475644552 learned_addr learned my addr 172.21.15.81:0/2475644552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00102a80 0x7f6d00199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfeffd640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d001083c0 0x7f6d00199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 -- 172.21.15.81:0/2475644552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d001083c0 msgr2=0x7f6d00199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d001083c0 0x7f6d00199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 -- 172.21.15.81:0/2475644552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00102a80 msgr2=0x7f6d00199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00102a80 0x7f6d00199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 -- 172.21.15.81:0/2475644552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0019f230 con 0x7f6d00108d10 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfffff640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00108d10 0x7f6d0019ebc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800b970 tx=0x7f6cf800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfcff9640 1 -- 172.21.15.81:0/2475644552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8019070 con 0x7f6d00108d10 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfcff9640 1 -- 172.21.15.81:0/2475644552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cf8014440 con 0x7f6d00108d10 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0019f520 con 0x7f6d00108d10 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6cfcff9640 1 -- 172.21.15.81:0/2475644552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80075d0 con 0x7f6d00108d10 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.463+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d001a5d40 con 0x7f6d00108d10 2024-09-21T02:58:13.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.465+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d00103d00 con 0x7f6d00108d10 2024-09-21T02:58:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.467+0000 7f6cfcff9640 1 -- 172.21.15.81:0/2475644552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6cf801c070 con 0x7f6d00108d10 2024-09-21T02:58:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.468+0000 7f6cfcff9640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ce80b6540 0x7f6ce80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.468+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ce80b6540 0x7f6ce80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:13.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.468+0000 7f6cfcff9640 1 -- 172.21.15.81:0/2475644552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7497+0+0 (secure 0 0 0) 0x7f6cf80e68d0 con 0x7f6d00108d10 2024-09-21T02:58:13.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.468+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ce80b6540 0x7f6ce80b8a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00057c0 tx=0x7f6cf00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:13.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.471+0000 7f6cfcff9640 1 -- 172.21.15.81:0/2475644552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6cf80b1870 con 0x7f6d00108d10 2024-09-21T02:58:13.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:13 smithi181 ceph-mon[34096]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:13.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:13 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1198830969' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:58:13.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:13 smithi181 ceph-mon[34096]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:58:13.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:13.654+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f6d0010ab40 con 0x7f6d00108d10 2024-09-21T02:58:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.014+0000 7f6cfcff9640 1 -- 172.21.15.81:0/2475644552 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v72) ==== 171+0+0 (secure 0 0 0) 0x7f6cf80b67b0 con 0x7f6d00108d10 2024-09-21T02:58:14.016 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-21T02:58:14.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ce80b6540 msgr2=0x7f6ce80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ce80b6540 0x7f6ce80b8a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00057c0 tx=0x7f6cf00058d0 comp rx=0 tx=0).stop 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00108d10 msgr2=0x7f6d0019ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00108d10 0x7f6d0019ebc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800b970 tx=0x7f6cf800be30 comp rx=0 tx=0).stop 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 shutdown_connections 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ce80b6540 0x7f6ce80b8a50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d001083c0 0x7f6d00199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d00108d10 0x7f6d0019ebc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 --2- 172.21.15.81:0/2475644552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00102a80 0x7f6d00199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 >> 172.21.15.81:0/2475644552 conn(0x7f6d00079740 msgr2=0x7f6d001015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 shutdown_connections 2024-09-21T02:58:14.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:14.018+0000 7f6d05dde640 1 -- 172.21.15.81:0/2475644552 wait complete. 2024-09-21T02:58:14.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:14 smithi081 ceph-mon[30991]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:58:14.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:14 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2475644552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:58:14.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:14 smithi164 ceph-mon[34236]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:58:14.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:14 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2475644552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:58:14.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:14 smithi181 ceph-mon[34096]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:58:14.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:14 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2475644552' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:58:14.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T02:58:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:15.027 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:15 smithi081 ceph-mon[30991]: pgmap v284: 33 pgs: 1 creating+peering, 28 unknown, 4 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:15.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:15 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2475644552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:58:15.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:15 smithi081 ceph-mon[30991]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:58:15.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1261847119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 msgr2=0x7fe4bc110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:15.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1261847119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc110300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009ca0 tx=0x7fe4b402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:15.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1261847119 shutdown_connections 2024-09-21T02:58:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1261847119 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4bc105300 0x7fe4bc10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1261847119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc110300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1261847119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4bc1049b0 0x7fe4bc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1261847119 >> 172.21.15.81:0/1261847119 conn(0x7fe4bc079730 msgr2=0x7fe4bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1261847119 shutdown_connections 2024-09-21T02:58:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.407+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1261847119 wait complete. 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 Processor -- start 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 -- start start 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4bc1049b0 0x7fe4bc19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4bc105300 0x7fe4bc19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc113990 con 0x7fe4bc10de10 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc113810 con 0x7fe4bc105300 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4c18b5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc113b10 con 0x7fe4bc1049b0 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc19fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47636/0 (socket says 172.21.15.81:47636) 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4bb7fe640 1 -- 172.21.15.81:0/1339239907 learned_addr learned my addr 172.21.15.81:0/1339239907 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4ba7fc640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4bc105300 0x7fe4bc19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.408+0000 7fe4baffd640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4bc1049b0 0x7fe4bc19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4bb7fe640 1 -- 172.21.15.81:0/1339239907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4bc1049b0 msgr2=0x7fe4bc19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4bb7fe640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4bc1049b0 0x7fe4bc19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4bb7fe640 1 -- 172.21.15.81:0/1339239907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4bc105300 msgr2=0x7fe4bc19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4bb7fe640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4bc105300 0x7fe4bc19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4bb7fe640 1 -- 172.21.15.81:0/1339239907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc1a02f0 con 0x7fe4bc10de10 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4bb7fe640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc19fbc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005cc0 tx=0x7fe4b4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4c08b3640 1 -- 172.21.15.81:0/1339239907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4032e00 con 0x7fe4bc10de10 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4c08b3640 1 -- 172.21.15.81:0/1339239907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4b40044d0 con 0x7fe4bc10de10 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc1a0580 con 0x7fe4bc10de10 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4c08b3640 1 -- 172.21.15.81:0/1339239907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4030b70 con 0x7fe4bc10de10 2024-09-21T02:58:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.409+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc1a6d40 con 0x7fe4bc10de10 2024-09-21T02:58:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.410+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4bc104dc0 con 0x7fe4bc10de10 2024-09-21T02:58:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.412+0000 7fe4c08b3640 1 -- 172.21.15.81:0/1339239907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe4b4030d10 con 0x7fe4bc10de10 2024-09-21T02:58:15.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.412+0000 7fe4c08b3640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a40b6590 0x7fe4a40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:15.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.412+0000 7fe4baffd640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a40b6590 0x7fe4a40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:15.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.413+0000 7fe4c08b3640 1 -- 172.21.15.81:0/1339239907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7879+0+0 (secure 0 0 0) 0x7fe4b4108440 con 0x7fe4bc10de10 2024-09-21T02:58:15.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.413+0000 7fe4baffd640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a40b6590 0x7fe4a40b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc06bc60 tx=0x7fe4ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.416+0000 7fe4c08b3640 1 -- 172.21.15.81:0/1339239907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4b40cee80 con 0x7fe4bc10de10 2024-09-21T02:58:15.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:15 smithi164 ceph-mon[34236]: pgmap v284: 33 pgs: 1 creating+peering, 28 unknown, 4 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:15.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:15 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2475644552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:58:15.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:15 smithi164 ceph-mon[34236]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:58:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:15 smithi181 ceph-mon[34096]: pgmap v284: 33 pgs: 1 creating+peering, 28 unknown, 4 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:15 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2475644552' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:58:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:15 smithi181 ceph-mon[34096]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:58:15.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:15.628+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe4bc108f70 con 0x7fe4bc10de10 2024-09-21T02:58:16.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.031+0000 7fe4c08b3640 1 -- 172.21.15.81:0/1339239907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fe4b40d3260 con 0x7fe4bc10de10 2024-09-21T02:58:16.033 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a40b6590 msgr2=0x7fe4a40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a40b6590 0x7fe4a40b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc06bc60 tx=0x7fe4ac00b390 comp rx=0 tx=0).stop 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 msgr2=0x7fe4bc19fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc19fbc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005cc0 tx=0x7fe4b4032a10 comp rx=0 tx=0).stop 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 shutdown_connections 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a40b6590 0x7fe4a40b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc10de10 0x7fe4bc19fbc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4bc105300 0x7fe4bc19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 --2- 172.21.15.81:0/1339239907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4bc1049b0 0x7fe4bc19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 >> 172.21.15.81:0/1339239907 conn(0x7fe4bc079730 msgr2=0x7fe4bc100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 shutdown_connections 2024-09-21T02:58:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:16.034+0000 7fe4c18b5640 1 -- 172.21.15.81:0/1339239907 wait complete. 2024-09-21T02:58:16.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:16 smithi081 ceph-mon[30991]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:58:16.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:16 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1339239907' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:58:16.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:16 smithi081 ceph-mon[30991]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:58:16.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:16 smithi164 ceph-mon[34236]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:58:16.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:16 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1339239907' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:58:16.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:16 smithi164 ceph-mon[34236]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:58:16.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:16 smithi181 ceph-mon[34096]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:58:16.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:16 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1339239907' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:58:16.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:16 smithi181 ceph-mon[34096]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:58:16.930 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T02:58:16.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T02:58:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:17.303 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:17 smithi081 ceph-mon[30991]: pgmap v287: 97 pgs: 11 creating+peering, 43 unknown, 43 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:17.303 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:17 smithi081 ceph-mon[30991]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:58:17.303 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:17 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1339239907' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:58:17.303 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:17 smithi081 ceph-mon[30991]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:58:17.304 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:17 smithi081 ceph-mon[30991]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:58:17.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:17 smithi164 ceph-mon[34236]: pgmap v287: 97 pgs: 11 creating+peering, 43 unknown, 43 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:17.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:17 smithi164 ceph-mon[34236]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:58:17.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:17 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1339239907' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:58:17.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:17 smithi164 ceph-mon[34236]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:58:17.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:17 smithi164 ceph-mon[34236]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:58:17.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:17 smithi181 ceph-mon[34096]: pgmap v287: 97 pgs: 11 creating+peering, 43 unknown, 43 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:17.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:17 smithi181 ceph-mon[34096]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:58:17.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:17 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1339239907' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:58:17.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:17 smithi181 ceph-mon[34096]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:58:17.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:17 smithi181 ceph-mon[34096]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:58:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.686+0000 7f2844a62640 1 -- 172.21.15.81:0/805985630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840102ae0 msgr2=0x7f2840102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.686+0000 7f2844a62640 1 --2- 172.21.15.81:0/805985630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840102ae0 0x7f2840102ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2830009900 tx=0x7f283002a410 comp rx=0 tx=0).stop 2024-09-21T02:58:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.686+0000 7f2844a62640 1 -- 172.21.15.81:0/805985630 shutdown_connections 2024-09-21T02:58:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.686+0000 7f2844a62640 1 --2- 172.21.15.81:0/805985630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2840108420 0x7f2840108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.686+0000 7f2844a62640 1 --2- 172.21.15.81:0/805985630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2840108d70 0x7f284010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.686+0000 7f2844a62640 1 --2- 172.21.15.81:0/805985630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840102ae0 0x7f2840102ef0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.686+0000 7f2844a62640 1 -- 172.21.15.81:0/805985630 >> 172.21.15.81:0/805985630 conn(0x7f28400796b0 msgr2=0x7f2840079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.687+0000 7f2844a62640 1 -- 172.21.15.81:0/805985630 shutdown_connections 2024-09-21T02:58:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.687+0000 7f2844a62640 1 -- 172.21.15.81:0/805985630 wait complete. 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.687+0000 7f2844a62640 1 Processor -- start 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.687+0000 7f2844a62640 1 -- start start 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f2844a62640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2840102ae0 0x7f284019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f2844a62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840108420 0x7f284019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f2844a62640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2840108d70 0x7f284019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f2844a62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2840113ab0 con 0x7f2840108420 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f2844a62640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2840113930 con 0x7f2840102ae0 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f2844a62640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2840113c30 con 0x7f2840108d70 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840108420 0x7f284019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840108420 0x7f284019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47650/0 (socket says 172.21.15.81:47650) 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 -- 172.21.15.81:0/3497321367 learned_addr learned my addr 172.21.15.81:0/3497321367 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283e59c640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2840102ae0 0x7f284019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283ed9d640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2840108d70 0x7f284019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 -- 172.21.15.81:0/3497321367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2840108d70 msgr2=0x7f284019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2840108d70 0x7f284019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 -- 172.21.15.81:0/3497321367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2840102ae0 msgr2=0x7f284019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2840102ae0 0x7f284019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 -- 172.21.15.81:0/3497321367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28401a0450 con 0x7f2840108420 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.688+0000 7f283dd9b640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840108420 0x7f284019aa80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2834006fd0 tx=0x7f283400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.689+0000 7f282f7fe640 1 -- 172.21.15.81:0/3497321367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834011830 con 0x7f2840108420 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.689+0000 7f282f7fe640 1 -- 172.21.15.81:0/3497321367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2834016070 con 0x7f2840108420 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.689+0000 7f282f7fe640 1 -- 172.21.15.81:0/3497321367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834010d30 con 0x7f2840108420 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.689+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28401a0740 con 0x7f2840108420 2024-09-21T02:58:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.689+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28401a6ea0 con 0x7f2840108420 2024-09-21T02:58:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.690+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2840103d60 con 0x7f2840108420 2024-09-21T02:58:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.692+0000 7f282f7fe640 1 -- 172.21.15.81:0/3497321367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f28340119d0 con 0x7f2840108420 2024-09-21T02:58:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.693+0000 7f282f7fe640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28280b6590 0x7f28280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.693+0000 7f283e59c640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28280b6590 0x7f28280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.693+0000 7f282f7fe640 1 -- 172.21.15.81:0/3497321367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f28340e6d20 con 0x7f2840108420 2024-09-21T02:58:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.694+0000 7f283e59c640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28280b6590 0x7f28280b8aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f28300057c0 tx=0x7f28300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.696+0000 7f282f7fe640 1 -- 172.21.15.81:0/3497321367 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28340ad700 con 0x7f2840108420 2024-09-21T02:58:17.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:17.883+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f2840102ef0 con 0x7f2840108420 2024-09-21T02:58:18.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.052+0000 7f282f7fe640 1 -- 172.21.15.81:0/3497321367 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v75) ==== 157+0+0 (secure 0 0 0) 0x7f2840102ef0 con 0x7f2840108420 2024-09-21T02:58:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28280b6590 msgr2=0x7f28280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28280b6590 0x7f28280b8aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f28300057c0 tx=0x7f28300058d0 comp rx=0 tx=0).stop 2024-09-21T02:58:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840108420 msgr2=0x7f284019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840108420 0x7f284019aa80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2834006fd0 tx=0x7f283400b8e0 comp rx=0 tx=0).stop 2024-09-21T02:58:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 shutdown_connections 2024-09-21T02:58:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28280b6590 0x7f28280b8aa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2840108d70 0x7f284019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2840108420 0x7f284019aa80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 --2- 172.21.15.81:0/3497321367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2840102ae0 0x7f284019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.054+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 >> 172.21.15.81:0/3497321367 conn(0x7f28400796b0 msgr2=0x7f2840106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.055+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 shutdown_connections 2024-09-21T02:58:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:18.055+0000 7f2844a62640 1 -- 172.21.15.81:0/3497321367 wait complete. 2024-09-21T02:58:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:18 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] up:active 2024-09-21T02:58:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:18 smithi081 ceph-mon[30991]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:18 smithi081 ceph-mon[30991]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:18.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:18 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3497321367' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:58:18.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:18 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] up:active 2024-09-21T02:58:18.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:18 smithi164 ceph-mon[34236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:18.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:18 smithi164 ceph-mon[34236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:18.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:18 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3497321367' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:58:18.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:18 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] up:active 2024-09-21T02:58:18.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:18 smithi181 ceph-mon[34096]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:18.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:18 smithi181 ceph-mon[34096]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:18.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:18 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3497321367' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:58:18.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T02:58:18.964 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:19 smithi081 ceph-mon[30991]: pgmap v289: 97 pgs: 10 creating+peering, 14 unknown, 73 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 436 B/s wr, 1 op/s 2024-09-21T02:58:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:19 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3497321367' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:58:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:19 smithi081 ceph-mon[30991]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:58:19.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:19 smithi164 ceph-mon[34236]: pgmap v289: 97 pgs: 10 creating+peering, 14 unknown, 73 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 436 B/s wr, 1 op/s 2024-09-21T02:58:19.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:19 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3497321367' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:58:19.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:19 smithi164 ceph-mon[34236]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/737426529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 msgr2=0x7fcd941098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/737426529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd941098d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009900 tx=0x7fcd8802a410 comp rx=0 tx=0).stop 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/737426529 shutdown_connections 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/737426529 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd94109e10 0x7fcd94110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/737426529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd941098d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/737426529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd94103b80 0x7fcd94103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/737426529 >> 172.21.15.81:0/737426529 conn(0x7fcd940ff5d0 msgr2=0x7fcd94101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/737426529 shutdown_connections 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.466+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/737426529 wait complete. 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 Processor -- start 2024-09-21T02:58:19.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 -- start start 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd94103b80 0x7fcd9419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd9419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd94109e10 0x7fcd9419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113980 con 0x7fcd941094c0 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113800 con 0x7fcd94109e10 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd9a0fd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94113b00 con 0x7fcd94103b80 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd9419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd9419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47666/0 (socket says 172.21.15.81:47666) 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.467+0000 7fcd92ffd640 1 -- 172.21.15.81:0/3139053104 learned_addr learned my addr 172.21.15.81:0/3139053104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd93fff640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd94109e10 0x7fcd9419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd937fe640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd94103b80 0x7fcd9419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd92ffd640 1 -- 172.21.15.81:0/3139053104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd94103b80 msgr2=0x7fcd9419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd92ffd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd94103b80 0x7fcd9419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:19.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd92ffd640 1 -- 172.21.15.81:0/3139053104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd94109e10 msgr2=0x7fcd9419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd92ffd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd94109e10 0x7fcd9419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd92ffd640 1 -- 172.21.15.81:0/3139053104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd941a0340 con 0x7fcd941094c0 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd937fe640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd94103b80 0x7fcd9419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd92ffd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd9419a970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd88005940 tx=0x7fcd880040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd90ff9640 1 -- 172.21.15.81:0/3139053104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8803f030 con 0x7fcd941094c0 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd941a05d0 con 0x7fcd941094c0 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd90ff9640 1 -- 172.21.15.81:0/3139053104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd88003a80 con 0x7fcd941094c0 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd90ff9640 1 -- 172.21.15.81:0/3139053104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88035070 con 0x7fcd941094c0 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.468+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd941a6d90 con 0x7fcd941094c0 2024-09-21T02:58:19.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.469+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd94104e00 con 0x7fcd941094c0 2024-09-21T02:58:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.471+0000 7fcd90ff9640 1 -- 172.21.15.81:0/3139053104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fcd88042030 con 0x7fcd941094c0 2024-09-21T02:58:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.471+0000 7fcd90ff9640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcd7c0b6510 0x7fcd7c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.472+0000 7fcd937fe640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcd7c0b6510 0x7fcd7c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.472+0000 7fcd90ff9640 1 -- 172.21.15.81:0/3139053104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8277+0+0 (secure 0 0 0) 0x7fcd88107c40 con 0x7fcd941094c0 2024-09-21T02:58:19.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.472+0000 7fcd937fe640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcd7c0b6510 0x7fcd7c0b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd840058c0 tx=0x7fcd84005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:19.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.475+0000 7fcd90ff9640 1 -- 172.21.15.81:0/3139053104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd880ce4a0 con 0x7fcd941094c0 2024-09-21T02:58:19.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:19 smithi181 ceph-mon[34096]: pgmap v289: 97 pgs: 10 creating+peering, 14 unknown, 73 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 436 B/s wr, 1 op/s 2024-09-21T02:58:19.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:19 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3497321367' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:58:19.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:19 smithi181 ceph-mon[34096]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:58:19.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:19.653+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcd94103f90 con 0x7fcd941094c0 2024-09-21T02:58:20.330 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:20 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3139053104' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:58:20.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:20 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3139053104' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:58:20.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:20 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3139053104' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:58:20.931 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 02:58:20 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b[62742]: 2024-09-21T02:58:20.631+0000 7fa9f839d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T02:58:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.060+0000 7fcd90ff9640 1 -- 172.21.15.81:0/3139053104 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v77) ==== 228+0+0 (secure 0 0 0) 0x7fcd880d2880 con 0x7fcd941094c0 2024-09-21T02:58:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcd7c0b6510 msgr2=0x7fcd7c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcd7c0b6510 0x7fcd7c0b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd840058c0 tx=0x7fcd84005d30 comp rx=0 tx=0).stop 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 msgr2=0x7fcd9419a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd9419a970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd88005940 tx=0x7fcd880040e0 comp rx=0 tx=0).stop 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 shutdown_connections 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcd7c0b6510 0x7fcd7c0b8a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd94109e10 0x7fcd9419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd941094c0 0x7fcd9419a970 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 --2- 172.21.15.81:0/3139053104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcd94103b80 0x7fcd9419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 >> 172.21.15.81:0/3139053104 conn(0x7fcd940ff5d0 msgr2=0x7fcd941019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:21.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.063+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 shutdown_connections 2024-09-21T02:58:21.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:21.064+0000 7fcd9a0fd640 1 -- 172.21.15.81:0/3139053104 wait complete. 2024-09-21T02:58:21.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:21 smithi164 ceph-mon[34236]: pgmap v291: 97 pgs: 97 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T02:58:21.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:21 smithi164 ceph-mon[34236]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:58:21.466 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:21 smithi081 ceph-mon[30991]: pgmap v291: 97 pgs: 97 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T02:58:21.466 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:21 smithi081 ceph-mon[30991]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:58:21.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:21 smithi181 ceph-mon[34096]: pgmap v291: 97 pgs: 97 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T02:58:21.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:21 smithi181 ceph-mon[34096]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:58:21.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T02:58:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:22.336 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:22 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3139053104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:58:22.337 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:22 smithi081 ceph-mon[30991]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:58:22.337 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:22 smithi081 ceph-mon[30991]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:58:22.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:22 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3139053104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:58:22.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:22 smithi164 ceph-mon[34236]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:58:22.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:22 smithi164 ceph-mon[34236]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:58:22.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3139053104' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:58:22.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:22 smithi181 ceph-mon[34096]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:58:22.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:22 smithi181 ceph-mon[34096]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 -- 172.21.15.81:0/663241087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c01094b0 msgr2=0x7fe4c01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/663241087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c01094b0 0x7fe4c01098c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009900 tx=0x7fe4b402a410 comp rx=0 tx=0).stop 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 -- 172.21.15.81:0/663241087 shutdown_connections 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/663241087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4c0109e00 0x7fe4c0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/663241087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c01094b0 0x7fe4c01098c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/663241087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c0103bc0 0x7fe4c0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 -- 172.21.15.81:0/663241087 >> 172.21.15.81:0/663241087 conn(0x7fe4c007b910 msgr2=0x7fe4c007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 -- 172.21.15.81:0/663241087 shutdown_connections 2024-09-21T02:58:22.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.556+0000 7fe4c6abc640 1 -- 172.21.15.81:0/663241087 wait complete. 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 Processor -- start 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 -- start start 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0103bc0 0x7fe4c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c01094b0 0x7fe4c0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4c0109e00 0x7fe4c0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c0113970 con 0x7fe4c0103bc0 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c01137f0 con 0x7fe4c01094b0 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c6abc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c0113af0 con 0x7fe4c0109e00 2024-09-21T02:58:22.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c4858640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0103bc0 0x7fe4c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c4858640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0103bc0 0x7fe4c0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58062/0 (socket says 172.21.15.81:58062) 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4c4858640 1 -- 172.21.15.81:0/3558690835 learned_addr learned my addr 172.21.15.81:0/3558690835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.557+0000 7fe4bffff640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c01094b0 0x7fe4c0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c5059640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4c0109e00 0x7fe4c0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c4858640 1 -- 172.21.15.81:0/3558690835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4c0109e00 msgr2=0x7fe4c0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c4858640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4c0109e00 0x7fe4c0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c4858640 1 -- 172.21.15.81:0/3558690835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c01094b0 msgr2=0x7fe4c0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c4858640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c01094b0 0x7fe4c0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c4858640 1 -- 172.21.15.81:0/3558690835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c01a8690 con 0x7fe4c0103bc0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c4858640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0103bc0 0x7fe4c0075710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800ebc0 tx=0x7fe4b800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4bdffb640 1 -- 172.21.15.81:0/3558690835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8010630 con 0x7fe4c0103bc0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4bdffb640 1 -- 172.21.15.81:0/3558690835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4b8010c60 con 0x7fe4c0103bc0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c01a8980 con 0x7fe4c0103bc0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4bdffb640 1 -- 172.21.15.81:0/3558690835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8018b00 con 0x7fe4c0103bc0 2024-09-21T02:58:22.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.558+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c01a8ee0 con 0x7fe4c0103bc0 2024-09-21T02:58:22.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.559+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c0103fd0 con 0x7fe4c0103bc0 2024-09-21T02:58:22.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.562+0000 7fe4bdffb640 1 -- 172.21.15.81:0/3558690835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe4b8018ca0 con 0x7fe4c0103bc0 2024-09-21T02:58:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.562+0000 7fe4bdffb640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a80b6590 0x7fe4a80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.563+0000 7fe4bffff640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a80b6590 0x7fe4a80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.563+0000 7fe4bdffb640 1 -- 172.21.15.81:0/3558690835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8770+0+0 (secure 0 0 0) 0x7fe4b80e7f70 con 0x7fe4c0103bc0 2024-09-21T02:58:22.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.563+0000 7fe4bffff640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a80b6590 0x7fe4a80b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005940 tx=0x7fe4b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:22.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.566+0000 7fe4bdffb640 1 -- 172.21.15.81:0/3558690835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4b80ae5e0 con 0x7fe4c0103bc0 2024-09-21T02:58:22.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:22.743+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe4c002e640 con 0x7fe4c0103bc0 2024-09-21T02:58:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.077+0000 7fe4bdffb640 1 -- 172.21.15.81:0/3558690835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v79) ==== 169+0+0 (secure 0 0 0) 0x7fe4b80b29c0 con 0x7fe4c0103bc0 2024-09-21T02:58:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a80b6590 msgr2=0x7fe4a80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a80b6590 0x7fe4a80b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005940 tx=0x7fe4b40058d0 comp rx=0 tx=0).stop 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0103bc0 msgr2=0x7fe4c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0103bc0 0x7fe4c0075710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800ebc0 tx=0x7fe4b800c6a0 comp rx=0 tx=0).stop 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 shutdown_connections 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe4a80b6590 0x7fe4a80b8aa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4c0109e00 0x7fe4c0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4c01094b0 0x7fe4c0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 --2- 172.21.15.81:0/3558690835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0103bc0 0x7fe4c0075710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 >> 172.21.15.81:0/3558690835 conn(0x7fe4c007b910 msgr2=0x7fe4c0105680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 shutdown_connections 2024-09-21T02:58:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:23.080+0000 7fe4c6abc640 1 -- 172.21.15.81:0/3558690835 wait complete. 2024-09-21T02:58:23.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:23 smithi081 ceph-mon[30991]: pgmap v294: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-21T02:58:23.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:23 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3558690835' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:58:23.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:23 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3558690835' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:58:23.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:23 smithi081 ceph-mon[30991]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:58:23.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:23 smithi164 ceph-mon[34236]: pgmap v294: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-21T02:58:23.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:23 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3558690835' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:58:23.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:23 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3558690835' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:58:23.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:23 smithi164 ceph-mon[34236]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:58:23.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:23 smithi181 ceph-mon[34096]: pgmap v294: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-21T02:58:23.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:23 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3558690835' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:58:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:23 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3558690835' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:58:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:23 smithi181 ceph-mon[34096]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:58:23.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T02:58:24.065 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:24.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 -- 172.21.15.81:0/2255491876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c001094a0 msgr2=0x7f8c001098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:24.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 --2- 172.21.15.81:0/2255491876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c001094a0 0x7f8c001098b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009900 tx=0x7f8bf402a410 comp rx=0 tx=0).stop 2024-09-21T02:58:24.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 -- 172.21.15.81:0/2255491876 shutdown_connections 2024-09-21T02:58:24.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 --2- 172.21.15.81:0/2255491876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00109df0 0x7f8c00110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 --2- 172.21.15.81:0/2255491876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c001094a0 0x7f8c001098b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 --2- 172.21.15.81:0/2255491876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c00103b60 0x7f8c00103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 -- 172.21.15.81:0/2255491876 >> 172.21.15.81:0/2255491876 conn(0x7f8c0007b850 msgr2=0x7f8c0007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 -- 172.21.15.81:0/2255491876 shutdown_connections 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.578+0000 7f8c06043640 1 -- 172.21.15.81:0/2255491876 wait complete. 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 Processor -- start 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 -- start start 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00103b60 0x7f8c0019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c001094a0 0x7f8c0019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c00109df0 0x7f8c0019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00113980 con 0x7f8c00109df0 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00113800 con 0x7f8c00103b60 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8c06043640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00113b00 con 0x7f8c001094a0 2024-09-21T02:58:24.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c00109df0 0x7f8c0019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c00109df0 0x7f8c0019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58076/0 (socket says 172.21.15.81:58076) 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 -- 172.21.15.81:0/3845289334 learned_addr learned my addr 172.21.15.81:0/3845289334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bff7fe640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00103b60 0x7f8c0019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfeffd640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c001094a0 0x7f8c0019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 -- 172.21.15.81:0/3845289334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c001094a0 msgr2=0x7f8c0019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c001094a0 0x7f8c0019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 -- 172.21.15.81:0/3845289334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00103b60 msgr2=0x7f8c0019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00103b60 0x7f8c0019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.579+0000 7f8bfffff640 1 -- 172.21.15.81:0/3845289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c001a0400 con 0x7f8c00109df0 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.580+0000 7f8bfeffd640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c001094a0 0x7f8c0019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.580+0000 7f8bfffff640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c00109df0 0x7f8c0019fcd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800cad0 tx=0x7f8bf800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.580+0000 7f8bfcff9640 1 -- 172.21.15.81:0/3845289334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800ae20 con 0x7f8c00109df0 2024-09-21T02:58:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.580+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c001a06f0 con 0x7f8c00109df0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.580+0000 7f8bfcff9640 1 -- 172.21.15.81:0/3845289334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8bf8005020 con 0x7f8c00109df0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.580+0000 7f8bfcff9640 1 -- 172.21.15.81:0/3845289334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800f6b0 con 0x7f8c00109df0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.580+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c001a6e50 con 0x7f8c00109df0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.581+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c00103f70 con 0x7f8c00109df0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.582+0000 7f8bfcff9640 1 -- 172.21.15.81:0/3845289334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8bf80051d0 con 0x7f8c00109df0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.583+0000 7f8bfcff9640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8be80b6510 0x7f8be80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.583+0000 7f8bff7fe640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8be80b6510 0x7f8be80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.583+0000 7f8bfcff9640 1 -- 172.21.15.81:0/3845289334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8770+0+0 (secure 0 0 0) 0x7f8bf80e7960 con 0x7f8c00109df0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.584+0000 7f8bff7fe640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8be80b6510 0x7f8be80b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009890 tx=0x7f8bf0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:24.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.588+0000 7f8bfcff9640 1 -- 172.21.15.81:0/3845289334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8bf8014030 con 0x7f8c00109df0 2024-09-21T02:58:24.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:24.805+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f8c0002e640 con 0x7f8c00109df0 2024-09-21T02:58:25.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.101+0000 7f8bfcff9640 1 -- 172.21.15.81:0/3845289334 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f8bf80adfd0 con 0x7f8c00109df0 2024-09-21T02:58:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 4 to fsmap 2024-09-21T02:58:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8be80b6510 msgr2=0x7f8be80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8be80b6510 0x7f8be80b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009890 tx=0x7f8bf0008040 comp rx=0 tx=0).stop 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c00109df0 msgr2=0x7f8c0019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c00109df0 0x7f8c0019fcd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800cad0 tx=0x7f8bf800cf90 comp rx=0 tx=0).stop 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 shutdown_connections 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8be80b6510 0x7f8be80b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8c001094a0 0x7f8c0019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c00109df0 0x7f8c0019fcd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 --2- 172.21.15.81:0/3845289334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8c00103b60 0x7f8c0019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 >> 172.21.15.81:0/3845289334 conn(0x7f8c0007b850 msgr2=0x7f8c00107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 shutdown_connections 2024-09-21T02:58:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:25.105+0000 7f8c06043640 1 -- 172.21.15.81:0/3845289334 wait complete. 2024-09-21T02:58:25.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:25 smithi164 ceph-mon[34236]: pgmap v297: 129 pgs: 13 creating+peering, 15 unknown, 101 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-21T02:58:25.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:25 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3845289334' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:58:25.473 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:25 smithi081 ceph-mon[30991]: pgmap v297: 129 pgs: 13 creating+peering, 15 unknown, 101 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-21T02:58:25.473 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:25 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3845289334' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:58:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:25 smithi181 ceph-mon[34096]: pgmap v297: 129 pgs: 13 creating+peering, 15 unknown, 101 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-21T02:58:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:25 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3845289334' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:58:25.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:58:26.077 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:26.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:26 smithi081 ceph-mon[30991]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:58:26.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:26 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3845289334' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:58:26.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:26 smithi081 ceph-mon[30991]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:26.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:26 smithi164 ceph-mon[34236]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:58:26.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:26 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3845289334' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:58:26.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:26 smithi164 ceph-mon[34236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:26.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:26 smithi181 ceph-mon[34096]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:58:26.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:26 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3845289334' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:58:26.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:26 smithi181 ceph-mon[34096]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:26.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 -- 172.21.15.81:0/3649217469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 msgr2=0x7f2888102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:26.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 --2- 172.21.15.81:0/3649217469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f2888102eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2878009900 tx=0x7f287802a410 comp rx=0 tx=0).stop 2024-09-21T02:58:26.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 -- 172.21.15.81:0/3649217469 shutdown_connections 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 --2- 172.21.15.81:0/3649217469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2888108d30 0x7f288810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 --2- 172.21.15.81:0/3649217469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28881083e0 0x7f28881087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 --2- 172.21.15.81:0/3649217469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f2888102eb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 -- 172.21.15.81:0/3649217469 >> 172.21.15.81:0/3649217469 conn(0x7f28880797e0 msgr2=0x7f2888079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 -- 172.21.15.81:0/3649217469 shutdown_connections 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.575+0000 7f288e586640 1 -- 172.21.15.81:0/3649217469 wait complete. 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 Processor -- start 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 -- start start 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f288819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28881083e0 0x7f288819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2888108d30 0x7f288819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28881128d0 con 0x7f2888102aa0 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2888112750 con 0x7f2888108d30 2024-09-21T02:58:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288e586640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2888112a50 con 0x7f28881083e0 2024-09-21T02:58:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f288819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f288819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58092/0 (socket says 172.21.15.81:58092) 2024-09-21T02:58:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 -- 172.21.15.81:0/716837613 learned_addr learned my addr 172.21.15.81:0/716837613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f287ffff640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28881083e0 0x7f288819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 -- 172.21.15.81:0/716837613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28881083e0 msgr2=0x7f288819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28881083e0 0x7f288819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288cb23640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2888108d30 0x7f288819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 -- 172.21.15.81:0/716837613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2888108d30 msgr2=0x7f288819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2888108d30 0x7f288819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f2887fff640 1 -- 172.21.15.81:0/716837613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28881a0420 con 0x7f2888102aa0 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f287ffff640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28881083e0 0x7f288819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:26.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.576+0000 7f288cb23640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2888108d30 0x7f288819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.577+0000 7f2887fff640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f288819a4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2878009a20 tx=0x7f2878004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.577+0000 7f2885ffb640 1 -- 172.21.15.81:0/716837613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287803f030 con 0x7f2888102aa0 2024-09-21T02:58:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.577+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28881a06b0 con 0x7f2888102aa0 2024-09-21T02:58:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.577+0000 7f2885ffb640 1 -- 172.21.15.81:0/716837613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28780035f0 con 0x7f2888102aa0 2024-09-21T02:58:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.577+0000 7f2885ffb640 1 -- 172.21.15.81:0/716837613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878035070 con 0x7f2888102aa0 2024-09-21T02:58:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.577+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28881a6e70 con 0x7f2888102aa0 2024-09-21T02:58:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.578+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2888103d20 con 0x7f2888102aa0 2024-09-21T02:58:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.579+0000 7f2885ffb640 1 -- 172.21.15.81:0/716837613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2878003aa0 con 0x7f2888102aa0 2024-09-21T02:58:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.580+0000 7f2885ffb640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28740b6510 0x7f28740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.580+0000 7f287ffff640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28740b6510 0x7f28740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.580+0000 7f2885ffb640 1 -- 172.21.15.81:0/716837613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f2878108550 con 0x7f2888102aa0 2024-09-21T02:58:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.581+0000 7f287ffff640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28740b6510 0x7f28740b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2888100c50 tx=0x7f2870008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:26.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.583+0000 7f2885ffb640 1 -- 172.21.15.81:0/716837613 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28780ceba0 con 0x7f2888102aa0 2024-09-21T02:58:26.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.795+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2888102eb0 con 0x7f2888102aa0 2024-09-21T02:58:26.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.795+0000 7f2885ffb640 1 -- 172.21.15.81:0/716837613 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f28780d2f80 con 0x7f2888102aa0 2024-09-21T02:58:26.797 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:26.797 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"btime":"2024-09-21T02:58:25:090376+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24547,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24572,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:24.807166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24599},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24599,"qdb_cluster":[24599]},"id":1}]} 2024-09-21T02:58:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28740b6510 msgr2=0x7f28740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28740b6510 0x7f28740b8a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2888100c50 tx=0x7f2870008040 comp rx=0 tx=0).stop 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 msgr2=0x7f288819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f288819a4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2878009a20 tx=0x7f2878004270 comp rx=0 tx=0).stop 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 shutdown_connections 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f28740b6510 0x7f28740b8a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28881083e0 0x7f288819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2888108d30 0x7f288819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 --2- 172.21.15.81:0/716837613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2888102aa0 0x7f288819a4b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 >> 172.21.15.81:0/716837613 conn(0x7f28880797e0 msgr2=0x7f28881067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 shutdown_connections 2024-09-21T02:58:26.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:26.798+0000 7f288e586640 1 -- 172.21.15.81:0/716837613 wait complete. 2024-09-21T02:58:27.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:27 smithi164 ceph-mon[34236]: pgmap v299: 129 pgs: 13 creating+peering, 116 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:27.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:27 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/716837613' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:27.476 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:27 smithi081 ceph-mon[30991]: pgmap v299: 129 pgs: 13 creating+peering, 116 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:27.476 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:27 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/716837613' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:27.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:27 smithi181 ceph-mon[34096]: pgmap v299: 129 pgs: 13 creating+peering, 116 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:27 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/716837613' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:27.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:58:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:28.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.241+0000 7fddcc5c1640 1 -- 172.21.15.81:0/3913768758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4102a80 msgr2=0x7fddc4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:28.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.241+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/3913768758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4102a80 0x7fddc4102e90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009900 tx=0x7fddc002a410 comp rx=0 tx=0).stop 2024-09-21T02:58:28.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 -- 172.21.15.81:0/3913768758 shutdown_connections 2024-09-21T02:58:28.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/3913768758 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc4108d10 0x7fddc410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/3913768758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddc41083c0 0x7fddc41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/3913768758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4102a80 0x7fddc4102e90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 -- 172.21.15.81:0/3913768758 >> 172.21.15.81:0/3913768758 conn(0x7fddc4079740 msgr2=0x7fddc4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:28.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 -- 172.21.15.81:0/3913768758 shutdown_connections 2024-09-21T02:58:28.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 -- 172.21.15.81:0/3913768758 wait complete. 2024-09-21T02:58:28.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 Processor -- start 2024-09-21T02:58:28.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.242+0000 7fddcc5c1640 1 -- start start 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcc5c1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc4102a80 0x7fddc4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcc5c1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddc41083c0 0x7fddc41998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcc5c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4108d10 0x7fddc419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcc5c1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4112830 con 0x7fddc4108d10 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcc5c1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41126b0 con 0x7fddc41083c0 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcc5c1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41129b0 con 0x7fddc4102a80 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4108d10 0x7fddc419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4108d10 0x7fddc419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58108/0 (socket says 172.21.15.81:58108) 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 -- 172.21.15.81:0/254753970 learned_addr learned my addr 172.21.15.81:0/254753970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddc9b5c640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddc41083c0 0x7fddc41998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddca35d640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc4102a80 0x7fddc4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 -- 172.21.15.81:0/254753970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc4102a80 msgr2=0x7fddc4199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:28.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc4102a80 0x7fddc4199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 -- 172.21.15.81:0/254753970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddc41083c0 msgr2=0x7fddc41998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddc41083c0 0x7fddc41998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 -- 172.21.15.81:0/254753970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc419f290 con 0x7fddc4108d10 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddcab5e640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4108d10 0x7fddc419eb60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00cad0 tx=0x7fddbc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.243+0000 7fddbb7fe640 1 -- 172.21.15.81:0/254753970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00ae20 con 0x7fddc4108d10 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.244+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc419f580 con 0x7fddc4108d10 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.244+0000 7fddbb7fe640 1 -- 172.21.15.81:0/254753970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddbc005020 con 0x7fddc4108d10 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.244+0000 7fddbb7fe640 1 -- 172.21.15.81:0/254753970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00f6b0 con 0x7fddc4108d10 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.244+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc41a5ce0 con 0x7fddc4108d10 2024-09-21T02:58:28.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.245+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc4103d00 con 0x7fddc4108d10 2024-09-21T02:58:28.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.246+0000 7fddbb7fe640 1 -- 172.21.15.81:0/254753970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fddbc0051d0 con 0x7fddc4108d10 2024-09-21T02:58:28.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.247+0000 7fddbb7fe640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fddb00b6510 0x7fddb00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:28.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.247+0000 7fddca35d640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fddb00b6510 0x7fddb00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:28.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.247+0000 7fddbb7fe640 1 -- 172.21.15.81:0/254753970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fddbc0e7740 con 0x7fddc4108d10 2024-09-21T02:58:28.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.247+0000 7fddca35d640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fddb00b6510 0x7fddb00b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddc00057c0 tx=0x7fddc00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:28.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.250+0000 7fddbb7fe640 1 -- 172.21.15.81:0/254753970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fddbc014030 con 0x7fddc4108d10 2024-09-21T02:58:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.428+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddc4102e90 con 0x7fddc4108d10 2024-09-21T02:58:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.430+0000 7fddbb7fe640 1 -- 172.21.15.81:0/254753970 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24257 (secure 0 0 0) 0x7fddc4102e90 con 0x7fddc4108d10 2024-09-21T02:58:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:28.432 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:24.807006+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:58:28.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fddb00b6510 msgr2=0x7fddb00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:28.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fddb00b6510 0x7fddb00b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddc00057c0 tx=0x7fddc00058d0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4108d10 msgr2=0x7fddc419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:28.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4108d10 0x7fddc419eb60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00cad0 tx=0x7fddbc00cf90 comp rx=0 tx=0).stop 2024-09-21T02:58:28.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 shutdown_connections 2024-09-21T02:58:28.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fddb00b6510 0x7fddb00b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddc4108d10 0x7fddc419eb60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddc41083c0 0x7fddc41998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 --2- 172.21.15.81:0/254753970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fddc4102a80 0x7fddc4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:28.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 >> 172.21.15.81:0/254753970 conn(0x7fddc4079740 msgr2=0x7fddc41015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:28.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 shutdown_connections 2024-09-21T02:58:28.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:28.432+0000 7fddcc5c1640 1 -- 172.21.15.81:0/254753970 wait complete. 2024-09-21T02:58:29.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:58:29.350 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:29.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:29 smithi164 ceph-mon[34236]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:29.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:29 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/254753970' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:29.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:29 smithi081 ceph-mon[30991]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:29.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:29 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/254753970' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:29.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:29 smithi181 ceph-mon[34096]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:29.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:29 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/254753970' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:29.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 -- 172.21.15.81:0/2780315779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 msgr2=0x7f98f4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/2780315779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f4102e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009900 tx=0x7f98e402a410 comp rx=0 tx=0).stop 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 -- 172.21.15.81:0/2780315779 shutdown_connections 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/2780315779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f4108cf0 0x7f98f410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/2780315779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98f41083a0 0x7f98f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/2780315779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f4102e70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 -- 172.21.15.81:0/2780315779 >> 172.21.15.81:0/2780315779 conn(0x7f98f4079730 msgr2=0x7f98f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 -- 172.21.15.81:0/2780315779 shutdown_connections 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.835+0000 7f98f8ac8640 1 -- 172.21.15.81:0/2780315779 wait complete. 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 Processor -- start 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 -- start start 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f41083a0 0x7f98f419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98f4108cf0 0x7f98f419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98f4113930 con 0x7f98f4102a60 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f98f41137b0 con 0x7f98f4108cf0 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f8ac8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f98f4113ab0 con 0x7f98f41083a0 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f419a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58134/0 (socket says 172.21.15.81:58134) 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 -- 172.21.15.81:0/4188424674 learned_addr learned my addr 172.21.15.81:0/4188424674 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f2d9d640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98f4108cf0 0x7f98f419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98ebfff640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f41083a0 0x7f98f419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 -- 172.21.15.81:0/4188424674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f41083a0 msgr2=0x7f98f419a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f41083a0 0x7f98f419a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 -- 172.21.15.81:0/4188424674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98f4108cf0 msgr2=0x7f98f419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98f4108cf0 0x7f98f419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98f259c640 1 -- 172.21.15.81:0/4188424674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f41a02d0 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.836+0000 7f98ebfff640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f41083a0 0x7f98f419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.837+0000 7f98f259c640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f419a360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009230 tx=0x7f98e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.837+0000 7f98eb7fe640 1 -- 172.21.15.81:0/4188424674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e403f030 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.837+0000 7f98eb7fe640 1 -- 172.21.15.81:0/4188424674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98e4003a80 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.837+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f41a0560 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.837+0000 7f98eb7fe640 1 -- 172.21.15.81:0/4188424674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4035070 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.837+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f41a6d20 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.838+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f4102e70 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.840+0000 7f98eb7fe640 1 -- 172.21.15.81:0/4188424674 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f98e4042030 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.841+0000 7f98eb7fe640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f98e00b6510 0x7f98e00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.841+0000 7f98ebfff640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f98e00b6510 0x7f98e00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.841+0000 7f98eb7fe640 1 -- 172.21.15.81:0/4188424674 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f98e4108170 con 0x7f98f4102a60 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.841+0000 7f98ebfff640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f98e00b6510 0x7f98e00b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98f4100cc0 tx=0x7f98dc005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:29.844+0000 7f98eb7fe640 1 -- 172.21.15.81:0/4188424674 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98e40ce7c0 con 0x7f98f4102a60 2024-09-21T02:58:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.025+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98f410aac0 con 0x7f98f4102a60 2024-09-21T02:58:30.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.027+0000 7f98eb7fe640 1 -- 172.21.15.81:0/4188424674 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24257 (secure 0 0 0) 0x7f98e40d2ba0 con 0x7f98f4102a60 2024-09-21T02:58:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:30.029 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:24.807006+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:58:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f98e00b6510 msgr2=0x7f98e00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f98e00b6510 0x7f98e00b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98f4100cc0 tx=0x7f98dc005d30 comp rx=0 tx=0).stop 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 msgr2=0x7f98f419a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f419a360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009230 tx=0x7f98e4004270 comp rx=0 tx=0).stop 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 shutdown_connections 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f98e00b6510 0x7f98e00b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98f41083a0 0x7f98f419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98f4108cf0 0x7f98f419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 --2- 172.21.15.81:0/4188424674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f4102a60 0x7f98f419a360 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 >> 172.21.15.81:0/4188424674 conn(0x7f98f4079730 msgr2=0x7f98f4101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 shutdown_connections 2024-09-21T02:58:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:30.030+0000 7f98f8ac8640 1 -- 172.21.15.81:0/4188424674 wait complete. 2024-09-21T02:58:30.304 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:30 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4188424674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:30.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:30 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4188424674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:30.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:30 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4188424674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:30.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:58:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:31.383 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:31 smithi081 ceph-mon[30991]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:31.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:31 smithi164 ceph-mon[34236]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 -- 172.21.15.81:0/333307832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108d70 msgr2=0x7f70f410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/333307832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108d70 0x7f70f410f5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009ca0 tx=0x7f70ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 -- 172.21.15.81:0/333307832 shutdown_connections 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/333307832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f4108420 0x7f70f4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/333307832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108d70 0x7f70f410f5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/333307832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70f4102ae0 0x7f70f4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 -- 172.21.15.81:0/333307832 >> 172.21.15.81:0/333307832 conn(0x7f70f4079770 msgr2=0x7f70f4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 -- 172.21.15.81:0/333307832 shutdown_connections 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 -- 172.21.15.81:0/333307832 wait complete. 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.471+0000 7f70fa0b9640 1 Processor -- start 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70fa0b9640 1 -- start start 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70fa0b9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f4102ae0 0x7f70f4110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70fa0b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108420 0x7f70f41105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70fa0b9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70f4108d70 0x7f70f4110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70fa0b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4113a30 con 0x7f70f4108420 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70fa0b9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41138b0 con 0x7f70f4108d70 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70fa0b9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4113bb0 con 0x7f70f4102ae0 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108420 0x7f70f41105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108420 0x7f70f41105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57278/0 (socket says 172.21.15.81:57278) 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 -- 172.21.15.81:0/2121799985 learned_addr learned my addr 172.21.15.81:0/2121799985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f37fe640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f4102ae0 0x7f70f4110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f3fff640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70f4108d70 0x7f70f4110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 -- 172.21.15.81:0/2121799985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f4102ae0 msgr2=0x7f70f4110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f4102ae0 0x7f70f4110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 -- 172.21.15.81:0/2121799985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70f4108d70 msgr2=0x7f70f4110b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70f4108d70 0x7f70f4110b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f2ffd640 1 -- 172.21.15.81:0/2121799985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f41a8670 con 0x7f70f4108420 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f3fff640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70f4108d70 0x7f70f4110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.472+0000 7f70f37fe640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f4102ae0 0x7f70f4110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.473+0000 7f70f2ffd640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108420 0x7f70f41105c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d740 tx=0x7f70e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.473+0000 7f70f0ff9640 1 -- 172.21.15.81:0/2121799985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8017070 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.473+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f41a8960 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.473+0000 7f70f0ff9640 1 -- 172.21.15.81:0/2121799985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70e800de50 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.473+0000 7f70f0ff9640 1 -- 172.21.15.81:0/2121799985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e800f620 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.473+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f41a8ef0 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.474+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f4103d60 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.476+0000 7f70f0ff9640 1 -- 172.21.15.81:0/2121799985 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f70e801a070 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.476+0000 7f70f0ff9640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70dc0b6510 0x7f70dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.476+0000 7f70f37fe640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70dc0b6510 0x7f70dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.476+0000 7f70f0ff9640 1 -- 172.21.15.81:0/2121799985 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f70e80e6f60 con 0x7f70f4108420 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.477+0000 7f70f37fe640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70dc0b6510 0x7f70dc0b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005fd0 tx=0x7f70e4005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.480+0000 7f70f0ff9640 1 -- 172.21.15.81:0/2121799985 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70e80ad5b0 con 0x7f70f4108420 2024-09-21T02:58:31.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:31 smithi181 ceph-mon[34096]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:31.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.692+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70f4102ef0 con 0x7f70f4108420 2024-09-21T02:58:31.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.693+0000 7f70f0ff9640 1 -- 172.21.15.81:0/2121799985 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f70e80b1990 con 0x7f70f4108420 2024-09-21T02:58:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:31.695 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"btime":"2024-09-21T02:58:25:090376+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24547,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24572,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:24.807166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24599},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24599,"qdb_cluster":[24599]},"id":1}]} 2024-09-21T02:58:31.695 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70dc0b6510 msgr2=0x7f70dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70dc0b6510 0x7f70dc0b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005fd0 tx=0x7f70e4005f40 comp rx=0 tx=0).stop 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108420 msgr2=0x7f70f41105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108420 0x7f70f41105c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70e800d740 tx=0x7f70e800dc00 comp rx=0 tx=0).stop 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 shutdown_connections 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f70dc0b6510 0x7f70dc0b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70f4108d70 0x7f70f4110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70f4108420 0x7f70f41105c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 --2- 172.21.15.81:0/2121799985 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f4102ae0 0x7f70f4110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 >> 172.21.15.81:0/2121799985 conn(0x7f70f4079770 msgr2=0x7f70f4106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 shutdown_connections 2024-09-21T02:58:31.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:31.696+0000 7f70fa0b9640 1 -- 172.21.15.81:0/2121799985 wait complete. 2024-09-21T02:58:32.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:32 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2121799985' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:32.464 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:32 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2121799985' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:32.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:58:32.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:32 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2121799985' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:58:32.745 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:33.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 -- 172.21.15.81:0/1844389223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c108cf0 msgr2=0x7f818c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 --2- 172.21.15.81:0/1844389223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c108cf0 0x7f818c10f520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8184009ca0 tx=0x7f818402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 -- 172.21.15.81:0/1844389223 shutdown_connections 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 --2- 172.21.15.81:0/1844389223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c108cf0 0x7f818c10f520 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 --2- 172.21.15.81:0/1844389223 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f818c1083a0 0x7f818c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 --2- 172.21.15.81:0/1844389223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c102a60 0x7f818c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 -- 172.21.15.81:0/1844389223 >> 172.21.15.81:0/1844389223 conn(0x7f818c079720 msgr2=0x7f818c079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 -- 172.21.15.81:0/1844389223 shutdown_connections 2024-09-21T02:58:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 -- 172.21.15.81:0/1844389223 wait complete. 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.251+0000 7f8192e27640 1 Processor -- start 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8192e27640 1 -- start start 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8192e27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c102a60 0x7f818c19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8192e27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c1083a0 0x7f818c19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8192e27640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f818c108cf0 0x7f818c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8192e27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f818c112860 con 0x7f818c1083a0 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8192e27640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f818c1126e0 con 0x7f818c108cf0 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8192e27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f818c1129e0 con 0x7f818c102a60 2024-09-21T02:58:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c1083a0 0x7f818c19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c1083a0 0x7f818c19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57296/0 (socket says 172.21.15.81:57296) 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 -- 172.21.15.81:0/1211889579 learned_addr learned my addr 172.21.15.81:0/1211889579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f8190bc3640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c102a60 0x7f818c19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f81913c4640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f818c108cf0 0x7f818c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 -- 172.21.15.81:0/1211889579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c102a60 msgr2=0x7f818c19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c102a60 0x7f818c19b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 -- 172.21.15.81:0/1211889579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f818c108cf0 msgr2=0x7f818c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f818c108cf0 0x7f818c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 -- 172.21.15.81:0/1211889579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c1a6460 con 0x7f818c1083a0 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f81913c4640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f818c108cf0 0x7f818c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.252+0000 7f818bfff640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c1083a0 0x7f818c19b710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f818000e9c0 tx=0x7f818000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.253+0000 7f8189ffb640 1 -- 172.21.15.81:0/1211889579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818000cd80 con 0x7f818c1083a0 2024-09-21T02:58:33.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.253+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818c1a6750 con 0x7f818c1083a0 2024-09-21T02:58:33.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.253+0000 7f8189ffb640 1 -- 172.21.15.81:0/1211889579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81800054b0 con 0x7f818c1083a0 2024-09-21T02:58:33.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.253+0000 7f8189ffb640 1 -- 172.21.15.81:0/1211889579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180010430 con 0x7f818c1083a0 2024-09-21T02:58:33.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.253+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818c1a6ce0 con 0x7f818c1083a0 2024-09-21T02:58:33.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.254+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818c103ce0 con 0x7f818c1083a0 2024-09-21T02:58:33.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.255+0000 7f8189ffb640 1 -- 172.21.15.81:0/1211889579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8180004f20 con 0x7f818c1083a0 2024-09-21T02:58:33.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.256+0000 7f8189ffb640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81740b6540 0x7f81740b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:33.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.256+0000 7f8189ffb640 1 -- 172.21.15.81:0/1211889579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f81800e7ac0 con 0x7f818c1083a0 2024-09-21T02:58:33.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.256+0000 7f8190bc3640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81740b6540 0x7f81740b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:33.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.256+0000 7f8190bc3640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81740b6540 0x7f81740b8a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f817c0058c0 tx=0x7f817c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:33.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.260+0000 7f8189ffb640 1 -- 172.21.15.81:0/1211889579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81800ae110 con 0x7f818c1083a0 2024-09-21T02:58:33.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:33 smithi164 ceph-mon[34236]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:33.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.438+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f818c06bf90 con 0x7f818c1083a0 2024-09-21T02:58:33.440 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:33 smithi081 ceph-mon[30991]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.440+0000 7f8189ffb640 1 -- 172.21.15.81:0/1211889579 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24257 (secure 0 0 0) 0x7f818c06bf90 con 0x7f818c1083a0 2024-09-21T02:58:33.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:33.442 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:24.807006+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:58:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81740b6540 msgr2=0x7f81740b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81740b6540 0x7f81740b8a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f817c0058c0 tx=0x7f817c00a250 comp rx=0 tx=0).stop 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c1083a0 msgr2=0x7f818c19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c1083a0 0x7f818c19b710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f818000e9c0 tx=0x7f818000ee80 comp rx=0 tx=0).stop 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 shutdown_connections 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81740b6540 0x7f81740b8a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f818c108cf0 0x7f818c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f818c1083a0 0x7f818c19b710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 --2- 172.21.15.81:0/1211889579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f818c102a60 0x7f818c19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 >> 172.21.15.81:0/1211889579 conn(0x7f818c079720 msgr2=0x7f818c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 shutdown_connections 2024-09-21T02:58:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:33.442+0000 7f8192e27640 1 -- 172.21.15.81:0/1211889579 wait complete. 2024-09-21T02:58:33.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:33 smithi181 ceph-mon[34096]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:34.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T02:58:15.629942+0000', 'modified': '2024-09-21T02:58:24.807166+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24599}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.164:6839/399869191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6838', 'nonce': 399869191}, {'type': 'v1', 'addr': '172.21.15.164:6839', 'nonce': 399869191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24599, 'qdb_cluster': [24599]} 2024-09-21T02:58:34.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T02:58:34.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:58:34.424 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:34 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1211889579' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:34.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:34 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1211889579' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:34.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:34 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1211889579' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:34.584 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 -- 172.21.15.81:0/2469751747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc108da0 msgr2=0x7fc3bc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2469751747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc108da0 0x7fc3bc10f5d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009ca0 tx=0x7fc3b402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 -- 172.21.15.81:0/2469751747 shutdown_connections 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2469751747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc108da0 0x7fc3bc10f5d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2469751747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3bc108450 0x7fc3bc108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2469751747 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3bc102b10 0x7fc3bc102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 -- 172.21.15.81:0/2469751747 >> 172.21.15.81:0/2469751747 conn(0x7fc3bc0796d0 msgr2=0x7fc3bc079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 -- 172.21.15.81:0/2469751747 shutdown_connections 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.091+0000 7fc3c273e640 1 -- 172.21.15.81:0/2469751747 wait complete. 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.092+0000 7fc3c273e640 1 Processor -- start 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.092+0000 7fc3c273e640 1 -- start start 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c273e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc102b10 0x7fc3bc19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c273e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3bc108450 0x7fc3bc19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c273e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3bc108da0 0x7fc3bc19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c273e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc112960 con 0x7fc3bc102b10 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c273e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc1127e0 con 0x7fc3bc108450 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c273e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc112ae0 con 0x7fc3bc108da0 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc102b10 0x7fc3bc19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc102b10 0x7fc3bc19b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57308/0 (socket says 172.21.15.81:57308) 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2051290725 learned_addr learned my addr 172.21.15.81:0/2051290725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3bc108450 0x7fc3bc19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3bc108da0 0x7fc3bc19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2051290725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3bc108da0 msgr2=0x7fc3bc19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3bc108da0 0x7fc3bc19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2051290725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3bc108450 msgr2=0x7fc3bc19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3bc108450 0x7fc3bc19b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2051290725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc1a6520 con 0x7fc3bc102b10 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3bc108450 0x7fc3bc19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc102b10 0x7fc3bc19b210 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00d950 tx=0x7fc3ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3b97fa640 1 -- 172.21.15.81:0/2051290725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac017030 con 0x7fc3bc102b10 2024-09-21T02:58:35.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc1a6810 con 0x7fc3bc102b10 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3b97fa640 1 -- 172.21.15.81:0/2051290725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ac004020 con 0x7fc3bc102b10 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.093+0000 7fc3b97fa640 1 -- 172.21.15.81:0/2051290725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0055d0 con 0x7fc3bc102b10 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.094+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc1a6da0 con 0x7fc3bc102b10 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.096+0000 7fc3b97fa640 1 -- 172.21.15.81:0/2051290725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc3ac009a30 con 0x7fc3bc102b10 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.096+0000 7fc3c8cb2740 1 Processor -- start 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c8cb2740 1 -- start start 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3b97fa640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc3a40b6510 0x7fc3a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc3a40b6510 0x7fc3a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d773ef60 0x5582d7ae4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3b97fa640 1 -- 172.21.15.81:0/2051290725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fc3ac0e6ff0 con 0x7fc3bc102b10 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7ae5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d771e280 0x5582d7ae5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5582d7a5cc10 con 0x5582d77160a0 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5582d7a4c040 con 0x5582d771e280 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5582d7a4fe50 con 0x5582d773ef60 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7ae5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7ae5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57318/0 (socket says 172.21.15.81:57318) 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/146419750 learned_addr learned my addr 172.21.15.81:0/146419750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d773ef60 0x5582d7ae4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/146419750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d773ef60 msgr2=0x5582d7ae4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d773ef60 0x5582d7ae4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc3a40b6510 0x7fc3a40b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4006010 tx=0x7fc3b4009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/146419750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d771e280 msgr2=0x5582d7ae5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d771e280 0x5582d7ae5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d771e280 0x5582d7ae5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/146419750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d77aa540 con 0x5582d77160a0 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.097+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d771e280 0x5582d7ae5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.098+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7ae5440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000cb90 tx=0x7fc3b000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c280b8a717b62d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.098+0000 7fc3a27fc640 1 -- 172.21.15.81:0/146419750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0005220 con 0x5582d77160a0 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.098+0000 7fc3a27fc640 1 -- 172.21.15.81:0/146419750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3b0004c30 con 0x5582d77160a0 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.098+0000 7fc3a27fc640 1 -- 172.21.15.81:0/146419750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0010700 con 0x5582d77160a0 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.098+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/146419750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 msgr2=0x5582d7ae5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.098+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7ae5440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000cb90 tx=0x7fc3b000e720 comp rx=0 tx=0).stop 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/146419750 shutdown_connections 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d771e280 0x5582d7ae5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7ae5440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/146419750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d773ef60 0x5582d7ae4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/146419750 >> 172.21.15.81:0/146419750 conn(0x5582d7733350 msgr2=0x5582d7ae2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/146419750 shutdown_connections 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/146419750 wait complete. 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 -- start start 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.099+0000 7fc3c8cb2740 1 Processor -- start 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d77160a0 0x5582d7af09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d771e280 0x5582d7af0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5582d78ad5f0 con 0x5582d771e280 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5582d79e7010 con 0x5582d773ef60 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5582d7af36e0 con 0x5582d77160a0 2024-09-21T02:58:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 10 client.0 _ll_register_callbacks cb 0x5582d7a46340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d771e280 0x5582d7af0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d771e280 0x5582d7af0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57326/0 (socket says 172.21.15.81:57326) 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/3332029260 learned_addr learned my addr 172.21.15.81:0/3332029260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d77160a0 0x5582d7af09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/3332029260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d77160a0 msgr2=0x5582d7af09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d77160a0 0x5582d7af09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 msgr2=0x5582d7afc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 -- 172.21.15.81:0/3332029260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d7a14a00 con 0x5582d771e280 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d771e280 0x5582d7af0ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c8d0 tx=0x7fc3b000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01bcc2fc188a9c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc39b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc39b7fe640 1 -- 172.21.15.81:0/3332029260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0029060 con 0x5582d771e280 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc39b7fe640 1 -- 172.21.15.81:0/3332029260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fc3b0004ff0 con 0x5582d771e280 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3b0004c30 con 0x5582d771e280 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.100+0000 7fc39b7fe640 1 -- 172.21.15.81:0/3332029260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc3b0030050 con 0x5582d771e280 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 10 client.14895 fetch_fsmap learned FSMap version 17 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5582d7aff540 con 0x5582d771e280 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc39b7fe640 1 -- 172.21.15.81:0/3332029260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3b0004c30 con 0x5582d771e280 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc39b7fe640 1 -- 172.21.15.81:0/3332029260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fc3b0010cd0 con 0x5582d771e280 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 10 client.14895 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T02:58:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 10 client.14895 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:58:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 20 client.14895 populate_metadata read hostname 'smithi081' 2024-09-21T02:58:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76fd8e0 0x5582d7b02bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 4 client.14895 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:58:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582d7a5eb60 con 0x5582d76fd8e0 2024-09-21T02:58:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.101+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76fd8e0 0x5582d7b02bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.102+0000 7fc39b7fe640 10 client.14895 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T02:58:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.102+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76fd8e0 0x5582d7b02bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f15c58dc063fc0 server_cookie=b8136a522507bd5b in_seq=0 out_seq=0 2024-09-21T02:58:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc39b7fe640 1 -- 172.21.15.81:0/3332029260 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582d7a5eb60 con 0x5582d76fd8e0 2024-09-21T02:58:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc39b7fe640 10 client.14895 handle_command_reply: tid=0 2024-09-21T02:58:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 client.14895 shutdown 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d771e280 msgr2=0x5582d7af0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d771e280 0x5582d7af0ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c8d0 tx=0x7fc3b000ceb0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 shutdown_connections 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76fd8e0 0x5582d7b02bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d771e280 0x5582d7af0ee0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3332029260 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d77160a0 0x5582d7af09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 >> 172.21.15.81:0/3332029260 conn(0x5582d7733350 msgr2=0x5582d7ae8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc39b7fe640 0 client.14895 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 shutdown_connections 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3332029260 wait complete. 2024-09-21T02:58:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.103+0000 7fc3c8cb2740 20 client.14895 trim_cache size 0 max 16384 2024-09-21T02:58:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 Processor -- start 2024-09-21T02:58:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 -- start start 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b02bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 0x5582d7aeb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5582d7b00ef0 con 0x5582d77160a0 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5582d7b015c0 con 0x5582d773ef60 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5582d7b01c90 con 0x5582d771e280 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b02bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b02bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57340/0 (socket says 172.21.15.81:57340) 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3bbfff640 1 -- 172.21.15.81:0/3169456056 learned_addr learned my addr 172.21.15.81:0/3169456056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3bbfff640 1 -- 172.21.15.81:0/3169456056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 msgr2=0x5582d7aeb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/3169456056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 0x5582d7aeb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3bbfff640 1 -- 172.21.15.81:0/3169456056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 msgr2=0x5582d7afc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.121+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/3169456056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.122+0000 7fc3bbfff640 1 -- 172.21.15.81:0/3169456056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d7ae71f0 con 0x5582d77160a0 2024-09-21T02:58:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.122+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/3169456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b02bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0acc40 tx=0x7fc3ac0e4780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b552f629ddfc9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.122+0000 7fc3a1ffb640 1 -- 172.21.15.81:0/3169456056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0aca50 con 0x5582d77160a0 2024-09-21T02:58:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.122+0000 7fc3a1ffb640 1 -- 172.21.15.81:0/3169456056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ac0ad640 con 0x5582d77160a0 2024-09-21T02:58:35.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.122+0000 7fc3a1ffb640 1 -- 172.21.15.81:0/3169456056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0042e0 con 0x5582d77160a0 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3169456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 msgr2=0x5582d7b02bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3169456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b02bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0acc40 tx=0x7fc3ac0e4780 comp rx=0 tx=0).stop 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3169456056 shutdown_connections 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3169456056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 0x5582d7aeb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3169456056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7afc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/3169456056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b02bb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3169456056 >> 172.21.15.81:0/3169456056 conn(0x5582d7733350 msgr2=0x5582d7af0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3169456056 shutdown_connections 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/3169456056 wait complete. 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 -- start start 2024-09-21T02:58:35.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.123+0000 7fc3c8cb2740 1 Processor -- start 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b0b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 0x5582d7b0b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7b04580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5582d7b02a30 con 0x5582d77160a0 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5582d7b02360 con 0x5582d773ef60 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5582d7b03100 con 0x5582d771e280 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 10 client.0 _ll_register_callbacks cb 0x7fc3b0014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b0b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57342/0 (socket says 172.21.15.81:57342) 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2335693461 learned_addr learned my addr 172.21.15.81:0/2335693461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 0x5582d7b0b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c0cdb640 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7b04580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2335693461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 msgr2=0x5582d7b0b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 0x5582d7b0b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 msgr2=0x5582d7b04580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7b04580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 -- 172.21.15.81:0/2335693461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d7b04c90 con 0x5582d77160a0 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b0b080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0aa1b0 tx=0x7fc3ac0b6960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9bc9d553524ed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc39b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc39b7fe640 1 -- 172.21.15.81:0/2335693461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0a91b0 con 0x5582d77160a0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc39b7fe640 1 -- 172.21.15.81:0/2335693461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fc3ac098100 con 0x5582d77160a0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.124+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3ac0ad640 con 0x5582d77160a0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc39b7fe640 1 -- 172.21.15.81:0/2335693461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc3ac0a9350 con 0x5582d77160a0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 10 client.14901 fetch_fsmap learned FSMap version 17 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5582d7b0a640 con 0x5582d77160a0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc39b7fe640 1 -- 172.21.15.81:0/2335693461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ac0ad640 con 0x5582d77160a0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc39b7fe640 1 -- 172.21.15.81:0/2335693461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fc3ac0a8a20 con 0x5582d77160a0 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 10 client.14901 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T02:58:35.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 10 client.14901 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 20 client.14901 populate_metadata read hostname 'smithi081' 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76d2c90 0x5582d7b70cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 4 client.14901 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "status"}) -- 0x5582d7a5a610 con 0x5582d76d2c90 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.125+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76d2c90 0x5582d7b70cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc39b7fe640 10 client.14901 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3bb7fe640 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76d2c90 0x5582d7b70cd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26236284a1a4f238 server_cookie=52d3756626347d0a in_seq=0 out_seq=0 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc39b7fe640 1 -- 172.21.15.81:0/2335693461 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5582d7a5a610 con 0x5582d76d2c90 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc39b7fe640 10 client.14901 handle_command_reply: tid=0 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 client.14901 shutdown 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 msgr2=0x5582d7b0b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b0b080 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0aa1b0 tx=0x7fc3ac0b6960 comp rx=0 tx=0).stop 2024-09-21T02:58:35.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 shutdown_connections 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5582d76d2c90 0x5582d7b70cd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582d771e280 0x5582d7b0b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5582d773ef60 0x5582d7b04580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc39b7fe640 0 client.14901 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 --2- 172.21.15.81:0/2335693461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5582d77160a0 0x5582d7b0b080 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 >> 172.21.15.81:0/2335693461 conn(0x5582d7733350 msgr2=0x5582d7aeb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 shutdown_connections 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.126+0000 7fc3c8cb2740 1 -- 172.21.15.81:0/2335693461 wait complete. 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c8cb2740 20 client.14901 trim_cache size 0 max 16384 2024-09-21T02:58:35.134 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24599, 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 19.09297643, 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 17, 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 80, 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 80, 2024-09-21T02:58:35.135 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 29.891328051999999 2024-09-21T02:58:35.136 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T02:58:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc3a40b6510 msgr2=0x7fc3a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc3a40b6510 0x7fc3a40b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4006010 tx=0x7fc3b4009410 comp rx=0 tx=0).stop 2024-09-21T02:58:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc102b10 msgr2=0x7fc3bc19b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc102b10 0x7fc3bc19b210 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac00d950 tx=0x7fc3ac00de10 comp rx=0 tx=0).stop 2024-09-21T02:58:35.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 shutdown_connections 2024-09-21T02:58:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc3a40b6510 0x7fc3a40b8a20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc3bc108da0 0x7fc3bc19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc3bc108450 0x7fc3bc19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 --2- 172.21.15.81:0/2051290725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc102b10 0x7fc3bc19b210 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 >> 172.21.15.81:0/2051290725 conn(0x7fc3bc0796d0 msgr2=0x7fc3bc106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 shutdown_connections 2024-09-21T02:58:35.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:35.127+0000 7fc3c273e640 1 -- 172.21.15.81:0/2051290725 wait complete. 2024-09-21T02:58:35.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:35 smithi081 ceph-mon[30991]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:35.400 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:35 smithi181 ceph-mon[34096]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:35.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:35 smithi164 ceph-mon[34236]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:36.060 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T02:58:36.061 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:36.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T02:58:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 -- 172.21.15.81:0/1271970699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba81083e0 msgr2=0x7f6ba81087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/1271970699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba81083e0 0x7f6ba81087f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009900 tx=0x7f6b9002a410 comp rx=0 tx=0).stop 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 -- 172.21.15.81:0/1271970699 shutdown_connections 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/1271970699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ba8108d30 0x7f6ba810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/1271970699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba81083e0 0x7f6ba81087f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/1271970699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ba8102aa0 0x7f6ba8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 -- 172.21.15.81:0/1271970699 >> 172.21.15.81:0/1271970699 conn(0x7f6ba80797e0 msgr2=0x7f6ba8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 -- 172.21.15.81:0/1271970699 shutdown_connections 2024-09-21T02:58:36.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 -- 172.21.15.81:0/1271970699 wait complete. 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.743+0000 7f6bad8b7640 1 Processor -- start 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6bad8b7640 1 -- start start 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6bad8b7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ba8102aa0 0x7f6ba819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6bad8b7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ba81083e0 0x7f6ba819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6bad8b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8108d30 0x7f6ba81a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6bad8b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112850 con 0x7f6ba8108d30 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6bad8b7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81126d0 con 0x7f6ba81083e0 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6bad8b7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba81129d0 con 0x7f6ba8102aa0 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8108d30 0x7f6ba81a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8108d30 0x7f6ba81a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57358/0 (socket says 172.21.15.81:57358) 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 -- 172.21.15.81:0/2854705819 learned_addr learned my addr 172.21.15.81:0/2854705819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba67fc640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ba81083e0 0x7f6ba819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba6ffd640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ba8102aa0 0x7f6ba819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:36.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 -- 172.21.15.81:0/2854705819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ba8102aa0 msgr2=0x7f6ba819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ba8102aa0 0x7f6ba819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 -- 172.21.15.81:0/2854705819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ba81083e0 msgr2=0x7f6ba819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ba81083e0 0x7f6ba819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 -- 172.21.15.81:0/2854705819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba81a25c0 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba6ffd640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ba8102aa0 0x7f6ba819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.744+0000 7f6ba77fe640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8108d30 0x7f6ba81a1e90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d750 tx=0x7f6b9800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.745+0000 7f6bac8b5640 1 -- 172.21.15.81:0/2854705819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98017070 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.745+0000 7f6bac8b5640 1 -- 172.21.15.81:0/2854705819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b980054b0 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.745+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba81a28b0 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.745+0000 7f6bac8b5640 1 -- 172.21.15.81:0/2854705819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98004b90 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.745+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba81a9010 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.746+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba8102eb0 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.747+0000 7f6bac8b5640 1 -- 172.21.15.81:0/2854705819 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6b98004d30 con 0x7f6ba8108d30 2024-09-21T02:58:36.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.748+0000 7f6bac8b5640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6b940b6510 0x7f6b940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:36.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.748+0000 7f6ba6ffd640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6b940b6510 0x7f6b940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:36.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.748+0000 7f6bac8b5640 1 -- 172.21.15.81:0/2854705819 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f6b980e72f0 con 0x7f6ba8108d30 2024-09-21T02:58:36.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.749+0000 7f6ba6ffd640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6b940b6510 0x7f6b940b8a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0005fd0 tx=0x7f6ba0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:36.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.752+0000 7f6bac8b5640 1 -- 172.21.15.81:0/2854705819 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b980ad940 con 0x7f6ba8108d30 2024-09-21T02:58:36.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.968+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6ba819d780 con 0x7f6ba8108d30 2024-09-21T02:58:36.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.969+0000 7f6bac8b5640 1 -- 172.21.15.81:0/2854705819 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f6ba819d780 con 0x7f6ba8108d30 2024-09-21T02:58:36.970 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T02:58:36.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6b940b6510 msgr2=0x7f6b940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:36.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6b940b6510 0x7f6b940b8a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0005fd0 tx=0x7f6ba0009500 comp rx=0 tx=0).stop 2024-09-21T02:58:36.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8108d30 msgr2=0x7f6ba81a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8108d30 0x7f6ba81a1e90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d750 tx=0x7f6b9800dc10 comp rx=0 tx=0).stop 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 shutdown_connections 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6b940b6510 0x7f6b940b8a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba8108d30 0x7f6ba81a1e90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ba81083e0 0x7f6ba819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 --2- 172.21.15.81:0/2854705819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6ba8102aa0 0x7f6ba819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 >> 172.21.15.81:0/2854705819 conn(0x7f6ba80797e0 msgr2=0x7f6ba806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 shutdown_connections 2024-09-21T02:58:36.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:36.971+0000 7f6bad8b7640 1 -- 172.21.15.81:0/2854705819 wait complete. 2024-09-21T02:58:37.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:37 smithi164 ceph-mon[34236]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:37.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:37 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2854705819' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:58:37.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:37 smithi181 ceph-mon[34096]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:37.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:37 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2854705819' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:58:37.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:37 smithi081 ceph-mon[30991]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:37.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:37 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2854705819' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:58:37.637 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T02:58:37.637 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T02:58:37.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T02:58:37.638 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T02:58:37.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:37.638 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T02:58:37.638 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T02:58:37.638 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T02:58:37.638 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T02:58:37.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:37.638 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:58:37.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42267sec preferred_lft 42267sec 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T02:58:37.655 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:58:37.655 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T02:58:37.656 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:58:37.656 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T02:58:37.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-21T02:58:37.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-21T02:58:37.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-21T02:58:37.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T02:58:37.656 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T02:58:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:58:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:58:37.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:37.857 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T02:58:37.881 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T02:58:37.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:37.883 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T02:58:37.953 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T02:58:37.954 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T02:58:37.954 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T02:58:37.954 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T02:58:37.954 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T02:58:37.954 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:58:37.954 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T02:58:37.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T02:58:37.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T02:58:37.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T02:58:37.955 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T02:58:38.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:58:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:58:38.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:38.291 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T02:58:38.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:38.307 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-21T02:58:38.362 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:58:38.363 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T02:58:38.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:58:38.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T02:58:38.363 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T02:58:38.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:58:38.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:58:38.479 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T02:58:38.479 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:58:38.479 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T02:58:38.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T02:58:38.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T02:58:38.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T02:58:38.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T02:58:38.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T02:58:38.480 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T02:58:38.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:58:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:58:38.603 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:58:38.603 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T02:58:38.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T02:58:38.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T02:58:38.603 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T02:58:38.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:58:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:58:38.679 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T02:58:38.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:58:38.679 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:38.694 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T02:58:38.694 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:58:38.694 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:38.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-21T02:58:38.815 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:58:38.871 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-21T02:58:38.872 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:58:38.873 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/71f5309a184372d14db39f8c06331334f4eb9dd07e817e770bbe747fc1c6aef9/merged 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/802f08e77b4ce30bf11e857633b63afe9de6b761be8ba3dd6f47d2ab6f61ad4a/merged 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/14917d725a749b2123439a03335f32c0fd141c4aadbfe4d9dc201b599fb8fa12/merged 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/7eb945be1c3fd6e1839b71210e54c369f7ec8035e9a4be33a28239377f615161/merged 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/8d5c3f5951619312f5d0693f8d1da5d0b8f2a88f2cf7f6b74344beee40d7ed77/merged 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/a34224a2f3044d43975f5b2027033f0b4e6612dcbe2447065be07fd9fb6eb08a/merged 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/cace0ddc3dd8c818be03a3fd8c14c9ffa9f8b799b84220224daf69b385bc9cc4/merged 2024-09-21T02:58:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/54227affdef979114705e5c41f9388ebe3aaf4a77807d6da427405ae351dda7b/merged 2024-09-21T02:58:38.875 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/689e63a7551a0c8390e5c49bbf28ab083213a4f683849d1cc963b8664fbaba4e/merged 2024-09-21T02:58:38.875 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/de17c92f254d8668eff4e43d1c6960d4538550bb04b575008e94c8e0ca6f36b1/merged 2024-09-21T02:58:38.875 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-21T02:58:38.875 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:58:38.875 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:58:38.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:38.875 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-21T02:58:38.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T02:58:38.928 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T02:58:38.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-21T02:58:38.995 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-21T02:58:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-21T02:58:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/71f5309a184372d14db39f8c06331334f4eb9dd07e817e770bbe747fc1c6aef9/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/802f08e77b4ce30bf11e857633b63afe9de6b761be8ba3dd6f47d2ab6f61ad4a/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/14917d725a749b2123439a03335f32c0fd141c4aadbfe4d9dc201b599fb8fa12/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/7eb945be1c3fd6e1839b71210e54c369f7ec8035e9a4be33a28239377f615161/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/8d5c3f5951619312f5d0693f8d1da5d0b8f2a88f2cf7f6b74344beee40d7ed77/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/a34224a2f3044d43975f5b2027033f0b4e6612dcbe2447065be07fd9fb6eb08a/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/cace0ddc3dd8c818be03a3fd8c14c9ffa9f8b799b84220224daf69b385bc9cc4/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/54227affdef979114705e5c41f9388ebe3aaf4a77807d6da427405ae351dda7b/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/689e63a7551a0c8390e5c49bbf28ab083213a4f683849d1cc963b8664fbaba4e/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/de17c92f254d8668eff4e43d1c6960d4538550bb04b575008e94c8e0ca6f36b1/merged 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-21T02:58:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:58:39.056 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:58:39.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:39.056 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-21T02:58:39.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2024-09-21T02:58:39.100+0000 7fb8585f7480 -1 init, newargv = 0x7fb83c0046a0 newargc=15 2024-09-21T02:58:39.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[74485]: starting ceph client 2024-09-21T02:58:39.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[74485]: starting fuse 2024-09-21T02:58:39.110 INFO:teuthology.orchestra.run.smithi081.stdout:120 2024-09-21T02:58:39.110 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T02:58:39.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-21T02:58:39.110 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-21T02:58:39.110 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-21T02:58:39.110 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-21T02:58:39.110 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-21T02:58:39.110 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T02:58:39.110 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-21T02:58:39.111 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-21T02:58:39.112 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T02:58:39.112 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T02:58:39.112 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2024-09-21T02:58:39.112 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-21T02:58:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.74485.asok 2024-09-21T02:58:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:58:39.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74485.asok 2024-09-21T02:58:39.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:39.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74485.asok status 2024-09-21T02:58:39.383 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T02:58:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-21T02:58:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T02:58:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:58:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2024-09-21T02:58:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-21T02:58:39.383 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "74485", 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 14913, 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 14913 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-21T02:58:39.384 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3328146280 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3328146280 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.14913 192.168.0.1:0/3328146280", 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/3328146280", 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 17, 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 80, 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-21T02:58:39.385 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T02:58:39.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:39.392 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-21T02:58:39.393 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:39.408 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-21T02:58:39.408 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:39.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:39.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:39.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:39 smithi081 ceph-mon[30991]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:39.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:39 smithi164 ceph-mon[34236]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:39.439 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T02:58:39.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:39 smithi181 ceph-mon[34096]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:39.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:58:39.553 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2024-09-21T02:58:39.553 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T02:58:39.553 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:39.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:58:39.560 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:58:39.560 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:58:39.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:58:39.873 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 -- 172.21.15.81:0/3488838926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 msgr2=0x7f19bc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 --2- 172.21.15.81:0/3488838926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc10f520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009ca0 tx=0x7f19b402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 -- 172.21.15.81:0/3488838926 shutdown_connections 2024-09-21T02:58:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 --2- 172.21.15.81:0/3488838926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc10f520 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 --2- 172.21.15.81:0/3488838926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc1083a0 0x7f19bc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 --2- 172.21.15.81:0/3488838926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc102a60 0x7f19bc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 -- 172.21.15.81:0/3488838926 >> 172.21.15.81:0/3488838926 conn(0x7f19bc079730 msgr2=0x7f19bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 -- 172.21.15.81:0/3488838926 shutdown_connections 2024-09-21T02:58:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.377+0000 7f19c353e640 1 -- 172.21.15.81:0/3488838926 wait complete. 2024-09-21T02:58:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 Processor -- start 2024-09-21T02:58:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 -- start start 2024-09-21T02:58:40.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc102a60 0x7f19bc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc1083a0 0x7f19bc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc112860 con 0x7f19bc108cf0 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc1126e0 con 0x7f19bc102a60 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c353e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc1129e0 con 0x7f19bc1083a0 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c1adb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c1adb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57384/0 (socket says 172.21.15.81:57384) 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c1adb640 1 -- 172.21.15.81:0/2696365533 learned_addr learned my addr 172.21.15.81:0/2696365533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c12da640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc102a60 0x7f19bc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.378+0000 7f19c0ad9640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc1083a0 0x7f19bc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c1adb640 1 -- 172.21.15.81:0/2696365533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc1083a0 msgr2=0x7f19bc199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c1adb640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc1083a0 0x7f19bc199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c1adb640 1 -- 172.21.15.81:0/2696365533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc102a60 msgr2=0x7f19bc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c1adb640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc102a60 0x7f19bc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c1adb640 1 -- 172.21.15.81:0/2696365533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc19f200 con 0x7f19bc108cf0 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c0ad9640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc1083a0 0x7f19bc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c1adb640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc19ead0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19b4005cc0 tx=0x7f19b4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19b27fc640 1 -- 172.21.15.81:0/2696365533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4032e00 con 0x7f19bc108cf0 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19b27fc640 1 -- 172.21.15.81:0/2696365533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19b40044d0 con 0x7f19bc108cf0 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc19f490 con 0x7f19bc108cf0 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19b27fc640 1 -- 172.21.15.81:0/2696365533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4030b70 con 0x7f19bc108cf0 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.379+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc06ae60 con 0x7f19bc108cf0 2024-09-21T02:58:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.380+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc103ce0 con 0x7f19bc108cf0 2024-09-21T02:58:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.382+0000 7f19b27fc640 1 -- 172.21.15.81:0/2696365533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f19b4030d10 con 0x7f19bc108cf0 2024-09-21T02:58:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.382+0000 7f19b27fc640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19a80b6510 0x7f19a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.383+0000 7f19c12da640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19a80b6510 0x7f19a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.383+0000 7f19b27fc640 1 -- 172.21.15.81:0/2696365533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f19b4108a30 con 0x7f19bc108cf0 2024-09-21T02:58:40.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.383+0000 7f19c12da640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19a80b6510 0x7f19a80b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19b8005fd0 tx=0x7f19b8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:40.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.386+0000 7f19b27fc640 1 -- 172.21.15.81:0/2696365533 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19b40cf080 con 0x7f19bc108cf0 2024-09-21T02:58:40.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.579+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f19bc102e70 con 0x7f19bc108cf0 2024-09-21T02:58:40.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.580+0000 7f19b27fc640 1 -- 172.21.15.81:0/2696365533 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+587 (secure 0 0 0) 0x7f19bc102e70 con 0x7f19bc108cf0 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3359413677 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2658968302 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2305526484 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/837683568 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2720123143 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:40.582 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/83784468 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:40.583 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-09-21T02:58:40.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19a80b6510 msgr2=0x7f19a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:40.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19a80b6510 0x7f19a80b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19b8005fd0 tx=0x7f19b8005850 comp rx=0 tx=0).stop 2024-09-21T02:58:40.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 msgr2=0x7f19bc19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc19ead0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f19b4005cc0 tx=0x7f19b4032a10 comp rx=0 tx=0).stop 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 shutdown_connections 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19a80b6510 0x7f19a80b8a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19bc1083a0 0x7f19bc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19bc108cf0 0x7f19bc19ead0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 --2- 172.21.15.81:0/2696365533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc102a60 0x7f19bc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 >> 172.21.15.81:0/2696365533 conn(0x7f19bc079730 msgr2=0x7f19bc104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 shutdown_connections 2024-09-21T02:58:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:40.582+0000 7f19c353e640 1 -- 172.21.15.81:0/2696365533 wait complete. 2024-09-21T02:58:41.208 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:58:41.208 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:58:41.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:58:41.288 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:41 smithi081 ceph-mon[30991]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:41.288 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:41 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2696365533' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:58:41.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:41 smithi164 ceph-mon[34236]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:41.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:41 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2696365533' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:58:41.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:41 smithi181 ceph-mon[34096]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:58:41.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:41 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2696365533' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:58:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.014+0000 7ff979a80640 1 -- 172.21.15.81:0/764833881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff974109df0 msgr2=0x7ff974110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.014+0000 7ff979a80640 1 --2- 172.21.15.81:0/764833881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff974109df0 0x7ff974110620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009ca0 tx=0x7ff96c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 -- 172.21.15.81:0/764833881 shutdown_connections 2024-09-21T02:58:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 --2- 172.21.15.81:0/764833881 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9741094a0 0x7ff9741098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 --2- 172.21.15.81:0/764833881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff974109df0 0x7ff974110620 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 --2- 172.21.15.81:0/764833881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff974103b60 0x7ff974103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 -- 172.21.15.81:0/764833881 >> 172.21.15.81:0/764833881 conn(0x7ff97407b850 msgr2=0x7ff97407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 -- 172.21.15.81:0/764833881 shutdown_connections 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 -- 172.21.15.81:0/764833881 wait complete. 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 Processor -- start 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.015+0000 7ff979a80640 1 -- start start 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff979a80640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff974103b60 0x7ff97419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff979a80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9741094a0 0x7ff97419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff979a80640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff974109df0 0x7ff97419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff979a80640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741139b0 con 0x7ff9741094a0 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff979a80640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff974113830 con 0x7ff974109df0 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff979a80640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff974113b30 con 0x7ff974103b60 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9741094a0 0x7ff97419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9741094a0 0x7ff97419a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43180/0 (socket says 172.21.15.81:43180) 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 -- 172.21.15.81:0/3221672570 learned_addr learned my addr 172.21.15.81:0/3221672570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff9737fe640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff974103b60 0x7ff97419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff973fff640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff974109df0 0x7ff97419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 -- 172.21.15.81:0/3221672570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff974103b60 msgr2=0x7ff97419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff974103b60 0x7ff97419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 -- 172.21.15.81:0/3221672570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff974109df0 msgr2=0x7ff97419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff974109df0 0x7ff97419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 -- 172.21.15.81:0/3221672570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9741a02b0 con 0x7ff9741094a0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.016+0000 7ff972ffd640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9741094a0 0x7ff97419a8e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff96800d750 tx=0x7ff96800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.017+0000 7ff970ff9640 1 -- 172.21.15.81:0/3221672570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968017070 con 0x7ff9741094a0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.017+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9741a05a0 con 0x7ff9741094a0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.017+0000 7ff970ff9640 1 -- 172.21.15.81:0/3221672570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9680054b0 con 0x7ff9741094a0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.017+0000 7ff970ff9640 1 -- 172.21.15.81:0/3221672570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968004bc0 con 0x7ff9741094a0 2024-09-21T02:58:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.017+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9741a6d00 con 0x7ff9741094a0 2024-09-21T02:58:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.018+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff974103f70 con 0x7ff9741094a0 2024-09-21T02:58:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.019+0000 7ff970ff9640 1 -- 172.21.15.81:0/3221672570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff968009c30 con 0x7ff9741094a0 2024-09-21T02:58:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.020+0000 7ff970ff9640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff95c0b6510 0x7ff95c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.020+0000 7ff9737fe640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff95c0b6510 0x7ff95c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.020+0000 7ff970ff9640 1 -- 172.21.15.81:0/3221672570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7ff9680e7340 con 0x7ff9741094a0 2024-09-21T02:58:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.021+0000 7ff9737fe640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff95c0b6510 0x7ff95c0b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff96400bbe0 tx=0x7ff96400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.023+0000 7ff970ff9640 1 -- 172.21.15.81:0/3221672570 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9680ad990 con 0x7ff9741094a0 2024-09-21T02:58:42.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.214+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff97410bc10 con 0x7ff9741094a0 2024-09-21T02:58:42.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.214+0000 7ff970ff9640 1 -- 172.21.15.81:0/3221672570 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+587 (secure 0 0 0) 0x7ff9680b1d70 con 0x7ff9741094a0 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3359413677 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2658968302 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2305526484 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/837683568 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:42.216 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2720123143 2024-09-22T02:50:47.609507+0000 2024-09-21T02:58:42.217 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/83784468 2024-09-22T02:50:22.009612+0000 2024-09-21T02:58:42.217 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-09-21T02:58:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff95c0b6510 msgr2=0x7ff95c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff95c0b6510 0x7ff95c0b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff96400bbe0 tx=0x7ff96400b390 comp rx=0 tx=0).stop 2024-09-21T02:58:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9741094a0 msgr2=0x7ff97419a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9741094a0 0x7ff97419a8e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff96800d750 tx=0x7ff96800dc10 comp rx=0 tx=0).stop 2024-09-21T02:58:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 shutdown_connections 2024-09-21T02:58:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff95c0b6510 0x7ff95c0b8a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff974109df0 0x7ff97419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9741094a0 0x7ff97419a8e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 --2- 172.21.15.81:0/3221672570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff974103b60 0x7ff97419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 >> 172.21.15.81:0/3221672570 conn(0x7ff97407b850 msgr2=0x7ff9741074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.216+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 shutdown_connections 2024-09-21T02:58:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:42.217+0000 7ff979a80640 1 -- 172.21.15.81:0/3221672570 wait complete. 2024-09-21T02:58:42.978 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-21T02:58:42.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:42.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:58:43.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[74485]: fuse finished with error 0 and tester_r 0 2024-09-21T02:58:43.046 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T02:58:43.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T02:58:43.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:58:43.177 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T02:58:43.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:58:43.265 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:43 smithi081 ceph-mon[30991]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:58:43.265 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:43 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3221672570' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:58:43.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:43 smithi164 ceph-mon[34236]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:58:43.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:43 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3221672570' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:58:43.487 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:43.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:43 smithi181 ceph-mon[34096]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:58:43.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:43 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3221672570' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 -- 172.21.15.81:0/2263819394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 msgr2=0x7fb24c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 --2- 172.21.15.81:0/2263819394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c102e70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb248009900 tx=0x7fb24802a410 comp rx=0 tx=0).stop 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 -- 172.21.15.81:0/2263819394 shutdown_connections 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 --2- 172.21.15.81:0/2263819394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb24c1083a0 0x7fb24c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 --2- 172.21.15.81:0/2263819394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb24c108cf0 0x7fb24c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 --2- 172.21.15.81:0/2263819394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c102e70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 -- 172.21.15.81:0/2263819394 >> 172.21.15.81:0/2263819394 conn(0x7fb24c079730 msgr2=0x7fb24c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 -- 172.21.15.81:0/2263819394 shutdown_connections 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 -- 172.21.15.81:0/2263819394 wait complete. 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.960+0000 7fb25444f640 1 Processor -- start 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb25444f640 1 -- start start 2024-09-21T02:58:43.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb25444f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb25444f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb24c1083a0 0x7fb24c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb25444f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb24c108cf0 0x7fb24c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb25444f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c112870 con 0x7fb24c102a60 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb25444f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1126f0 con 0x7fb24c1083a0 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb25444f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1129f0 con 0x7fb24c108cf0 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43198/0 (socket says 172.21.15.81:43198) 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 -- 172.21.15.81:0/2230551865 learned_addr learned my addr 172.21.15.81:0/2230551865 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2519ea640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb24c1083a0 0x7fb24c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2529ec640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb24c108cf0 0x7fb24c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 -- 172.21.15.81:0/2230551865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb24c108cf0 msgr2=0x7fb24c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb24c108cf0 0x7fb24c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 -- 172.21.15.81:0/2230551865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb24c1083a0 msgr2=0x7fb24c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb24c1083a0 0x7fb24c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 -- 172.21.15.81:0/2230551865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24c1a0340 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2519ea640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb24c1083a0 0x7fb24c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2529ec640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb24c108cf0 0x7fb24c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.961+0000 7fb2521eb640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c19a3d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb248009230 tx=0x7fb248004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.962+0000 7fb2437fe640 1 -- 172.21.15.81:0/2230551865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24803f030 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.962+0000 7fb2437fe640 1 -- 172.21.15.81:0/2230551865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb248003a80 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.962+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24c1a05d0 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.962+0000 7fb2437fe640 1 -- 172.21.15.81:0/2230551865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248035070 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.962+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24c1a6d90 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.963+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24c102e70 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.964+0000 7fb2437fe640 1 -- 172.21.15.81:0/2230551865 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb248042030 con 0x7fb24c102a60 2024-09-21T02:58:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.965+0000 7fb2437fe640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2380b6510 0x7fb2380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.965+0000 7fb2519ea640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2380b6510 0x7fb2380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.965+0000 7fb2437fe640 1 -- 172.21.15.81:0/2230551865 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fb248108170 con 0x7fb24c102a60 2024-09-21T02:58:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.966+0000 7fb2519ea640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2380b6510 0x7fb2380b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb23c006fd0 tx=0x7fb23c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:43.968+0000 7fb2437fe640 1 -- 172.21.15.81:0/2230551865 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2480ce7c0 con 0x7fb24c102a60 2024-09-21T02:58:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.147+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb24c1a7030 con 0x7fb24c102a60 2024-09-21T02:58:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.148+0000 7fb2437fe640 1 -- 172.21.15.81:0/2230551865 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24257 (secure 0 0 0) 0x7fb2480d2ba0 con 0x7fb24c102a60 2024-09-21T02:58:44.150 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:44.150 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:24.807006+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:58:44.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.151+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2380b6510 msgr2=0x7fb2380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:44.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.151+0000 7fb25444f640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2380b6510 0x7fb2380b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb23c006fd0 tx=0x7fb23c008040 comp rx=0 tx=0).stop 2024-09-21T02:58:44.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.151+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 msgr2=0x7fb24c19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c19a3d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb248009230 tx=0x7fb248004270 comp rx=0 tx=0).stop 2024-09-21T02:58:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 shutdown_connections 2024-09-21T02:58:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2380b6510 0x7fb2380b8a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb24c108cf0 0x7fb24c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:44.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb24c1083a0 0x7fb24c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 --2- 172.21.15.81:0/2230551865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb24c102a60 0x7fb24c19a3d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 >> 172.21.15.81:0/2230551865 conn(0x7fb24c079730 msgr2=0x7fb24c101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 shutdown_connections 2024-09-21T02:58:44.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:44.152+0000 7fb25444f640 1 -- 172.21.15.81:0/2230551865 wait complete. 2024-09-21T02:58:44.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:44 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2230551865' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:44.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:44 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2230551865' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:44.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:44 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2230551865' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:45.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:58:45.296 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:45.304 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:45 smithi081 ceph-mon[30991]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:58:45.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:45 smithi181 ceph-mon[34096]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:58:45.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:45 smithi164 ceph-mon[34236]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 -- 172.21.15.81:0/2532240313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e4109df0 msgr2=0x7fd9e4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2532240313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e4109df0 0x7fd9e4110620 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009ca0 tx=0x7fd9dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 -- 172.21.15.81:0/2532240313 shutdown_connections 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2532240313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e4109df0 0x7fd9e4110620 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2532240313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e41094a0 0x7fd9e41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2532240313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9e4103b60 0x7fd9e4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 -- 172.21.15.81:0/2532240313 >> 172.21.15.81:0/2532240313 conn(0x7fd9e407b850 msgr2=0x7fd9e407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 -- 172.21.15.81:0/2532240313 shutdown_connections 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.826+0000 7fd9eb484640 1 -- 172.21.15.81:0/2532240313 wait complete. 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 Processor -- start 2024-09-21T02:58:45.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 -- start start 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9e4103b60 0x7fd9e419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e41094a0 0x7fd9e419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e4109df0 0x7fd9e419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41139b0 con 0x7fd9e41094a0 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4113830 con 0x7fd9e4109df0 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9eb484640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4113b30 con 0x7fd9e4103b60 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9e8a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e41094a0 0x7fd9e419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9e8a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e41094a0 0x7fd9e419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43224/0 (socket says 172.21.15.81:43224) 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9e8a1f640 1 -- 172.21.15.81:0/2722919605 learned_addr learned my addr 172.21.15.81:0/2722919605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9e9220640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9e4103b60 0x7fd9e419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.827+0000 7fd9e9a21640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e4109df0 0x7fd9e419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e8a1f640 1 -- 172.21.15.81:0/2722919605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9e4103b60 msgr2=0x7fd9e419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:45.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e8a1f640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9e4103b60 0x7fd9e419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e8a1f640 1 -- 172.21.15.81:0/2722919605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e4109df0 msgr2=0x7fd9e419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e8a1f640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e4109df0 0x7fd9e419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e8a1f640 1 -- 172.21.15.81:0/2722919605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e41a0430 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e9a21640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e4109df0 0x7fd9e419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e8a1f640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e41094a0 0x7fd9e419aa60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800d950 tx=0x7fd9d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e27fc640 1 -- 172.21.15.81:0/2722919605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8017070 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e27fc640 1 -- 172.21.15.81:0/2722919605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9d8009c30 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e41a0720 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9e27fc640 1 -- 172.21.15.81:0/2722919605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80047a0 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.828+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e41a6e80 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.829+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e4103f70 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.831+0000 7fd9e27fc640 1 -- 172.21.15.81:0/2722919605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd9d8004020 con 0x7fd9e41094a0 2024-09-21T02:58:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.831+0000 7fd9e27fc640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd9cc0b6510 0x7fd9cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:45.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.831+0000 7fd9e9220640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd9cc0b6510 0x7fd9cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:45.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.831+0000 7fd9e27fc640 1 -- 172.21.15.81:0/2722919605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7fd9d80e75e0 con 0x7fd9e41094a0 2024-09-21T02:58:45.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.832+0000 7fd9e9220640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd9cc0b6510 0x7fd9cc0b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40058c0 tx=0x7fd9d400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:45.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:45.835+0000 7fd9e27fc640 1 -- 172.21.15.81:0/2722919605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9d8020020 con 0x7fd9e41094a0 2024-09-21T02:58:46.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.013+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9e419b5f0 con 0x7fd9e41094a0 2024-09-21T02:58:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.015+0000 7fd9e27fc640 1 -- 172.21.15.81:0/2722919605 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24257 (secure 0 0 0) 0x7fd9e419b5f0 con 0x7fd9e41094a0 2024-09-21T02:58:46.016 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:58:46.016 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:24.807006+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:58:46.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd9cc0b6510 msgr2=0x7fd9cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:46.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd9cc0b6510 0x7fd9cc0b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40058c0 tx=0x7fd9d400a250 comp rx=0 tx=0).stop 2024-09-21T02:58:46.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e41094a0 msgr2=0x7fd9e419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e41094a0 0x7fd9e419aa60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800d950 tx=0x7fd9d800de10 comp rx=0 tx=0).stop 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 shutdown_connections 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd9cc0b6510 0x7fd9cc0b8a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e4109df0 0x7fd9e419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e41094a0 0x7fd9e419aa60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 --2- 172.21.15.81:0/2722919605 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd9e4103b60 0x7fd9e419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 >> 172.21.15.81:0/2722919605 conn(0x7fd9e407b850 msgr2=0x7fd9e4105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 shutdown_connections 2024-09-21T02:58:46.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:46.018+0000 7fd9eb484640 1 -- 172.21.15.81:0/2722919605 wait complete. 2024-09-21T02:58:46.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:46 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2722919605' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:46.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:46 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2722919605' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:46.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:46 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2722919605' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:58:46.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T02:58:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:47.435 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:47 smithi081 ceph-mon[30991]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:58:47.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:47 smithi181 ceph-mon[34096]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:58:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:47 smithi164 ceph-mon[34236]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:58:47.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.603+0000 7f9930c32640 1 -- 172.21.15.81:0/4147507438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c103b80 msgr2=0x7f992c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.603+0000 7f9930c32640 1 --2- 172.21.15.81:0/4147507438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c103b80 0x7f992c103f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f991c009900 tx=0x7f991c02a410 comp rx=0 tx=0).stop 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 -- 172.21.15.81:0/4147507438 shutdown_connections 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 --2- 172.21.15.81:0/4147507438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f992c109e10 0x7f992c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 --2- 172.21.15.81:0/4147507438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f992c1094c0 0x7f992c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 --2- 172.21.15.81:0/4147507438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c103b80 0x7f992c103f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 -- 172.21.15.81:0/4147507438 >> 172.21.15.81:0/4147507438 conn(0x7f992c0ff610 msgr2=0x7f992c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 -- 172.21.15.81:0/4147507438 shutdown_connections 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 -- 172.21.15.81:0/4147507438 wait complete. 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 Processor -- start 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.604+0000 7f9930c32640 1 -- start start 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9930c32640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f992c103b80 0x7f992c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9930c32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1094c0 0x7f992c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9930c32640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f992c109e10 0x7f992c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9930c32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f992c1139e0 con 0x7f992c1094c0 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9930c32640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f992c113860 con 0x7f992c109e10 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9930c32640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f992c113b60 con 0x7f992c103b80 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1094c0 0x7f992c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1094c0 0x7f992c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43242/0 (socket says 172.21.15.81:43242) 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 -- 172.21.15.81:0/220978680 learned_addr learned my addr 172.21.15.81:0/220978680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f992ad9d640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f992c109e10 0x7f992c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f992a59c640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f992c103b80 0x7f992c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 -- 172.21.15.81:0/220978680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f992c103b80 msgr2=0x7f992c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f992c103b80 0x7f992c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 -- 172.21.15.81:0/220978680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f992c109e10 msgr2=0x7f992c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f992c109e10 0x7f992c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 -- 172.21.15.81:0/220978680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c1a03e0 con 0x7f992c1094c0 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f992ad9d640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f992c109e10 0x7f992c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:47.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.605+0000 7f9929d9b640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1094c0 0x7f992c19aa10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f992000d740 tx=0x7f992000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.606+0000 7f991b7fe640 1 -- 172.21.15.81:0/220978680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920017070 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.606+0000 7f991b7fe640 1 -- 172.21.15.81:0/220978680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f992000de50 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.606+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992c1a06d0 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.606+0000 7f991b7fe640 1 -- 172.21.15.81:0/220978680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992000f620 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.606+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992c1a6eb0 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.607+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992c103f90 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.609+0000 7f991b7fe640 1 -- 172.21.15.81:0/220978680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f992001a070 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.610+0000 7f991b7fe640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f99140b6590 0x7f99140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.610+0000 7f992a59c640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f99140b6590 0x7f99140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.610+0000 7f991b7fe640 1 -- 172.21.15.81:0/220978680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8802+0+0 (secure 0 0 0) 0x7f99200e6f10 con 0x7f992c1094c0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.611+0000 7f992a59c640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f99140b6590 0x7f99140b8aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f991c000c00 tx=0x7f991c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.613+0000 7f991b7fe640 1 -- 172.21.15.81:0/220978680 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99200ad5e0 con 0x7f992c1094c0 2024-09-21T02:58:47.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:47.833+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f992c19b5a0 con 0x7f992c1094c0 2024-09-21T02:58:48.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.218+0000 7f991b7fe640 1 -- 172.21.15.81:0/220978680 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f992c19b5a0 con 0x7f992c1094c0 2024-09-21T02:58:48.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f99140b6590 msgr2=0x7f99140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:48.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f99140b6590 0x7f99140b8aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f991c000c00 tx=0x7f991c009680 comp rx=0 tx=0).stop 2024-09-21T02:58:48.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1094c0 msgr2=0x7f992c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1094c0 0x7f992c19aa10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f992000d740 tx=0x7f992000dc00 comp rx=0 tx=0).stop 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 shutdown_connections 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f99140b6590 0x7f99140b8aa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f992c109e10 0x7f992c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992c1094c0 0x7f992c19aa10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 --2- 172.21.15.81:0/220978680 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f992c103b80 0x7f992c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 >> 172.21.15.81:0/220978680 conn(0x7f992c0ff610 msgr2=0x7f992c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 shutdown_connections 2024-09-21T02:58:48.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:48.221+0000 7f9930c32640 1 -- 172.21.15.81:0/220978680 wait complete. 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T02:58:48.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:48 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/220978680' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-09-21T02:58:48.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T02:58:48.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:48 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/220978680' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:58:48.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T02:58:48.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-09-21T02:58:48.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T02:58:48.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-09-21T02:58:48.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T02:58:48.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]} : dispatch 2024-09-21T02:58:48.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]} : dispatch 2024-09-21T02:58:48.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-09-21T02:58:48.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-09-21T02:58:48.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:48 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/220978680' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:58:49.062 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T02:58:49.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/220978680' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T02:58:49.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-21T02:58:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-21T02:58:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-21T02:58:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T02:58:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:58:49.306 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:49 smithi081 ceph-mon[30991]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:49.318 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/220978680' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:58:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:49 smithi181 ceph-mon[34096]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:58:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/220978680' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:58:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 10]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:58:49.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:49 smithi164 ceph-mon[34236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:58:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 -- 172.21.15.81:0/469865743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b8108d30 msgr2=0x7fb0b810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 --2- 172.21.15.81:0/469865743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b8108d30 0x7fb0b810f560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009ca0 tx=0x7fb0a802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 -- 172.21.15.81:0/469865743 shutdown_connections 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 --2- 172.21.15.81:0/469865743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b8108d30 0x7fb0b810f560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 --2- 172.21.15.81:0/469865743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0b81083e0 0x7fb0b81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 --2- 172.21.15.81:0/469865743 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0b8102aa0 0x7fb0b8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 -- 172.21.15.81:0/469865743 >> 172.21.15.81:0/469865743 conn(0x7fb0b80797e0 msgr2=0x7fb0b8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 -- 172.21.15.81:0/469865743 shutdown_connections 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.859+0000 7fb0c0127640 1 -- 172.21.15.81:0/469865743 wait complete. 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 Processor -- start 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 -- start start 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0b8102aa0 0x7fb0b819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:49.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b81083e0 0x7fb0b819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0b8108d30 0x7fb0b819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81139a0 con 0x7fb0b81083e0 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b8113820 con 0x7fb0b8108d30 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0c0127640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b8113b20 con 0x7fb0b8102aa0 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bd6c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b81083e0 0x7fb0b819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bd6c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b81083e0 0x7fb0b819a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43254/0 (socket says 172.21.15.81:43254) 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bd6c2640 1 -- 172.21.15.81:0/3423715465 learned_addr learned my addr 172.21.15.81:0/3423715465 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bdec3640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0b8102aa0 0x7fb0b819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0be6c4640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0b8108d30 0x7fb0b819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bd6c2640 1 -- 172.21.15.81:0/3423715465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0b8102aa0 msgr2=0x7fb0b819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bd6c2640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0b8102aa0 0x7fb0b819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bd6c2640 1 -- 172.21.15.81:0/3423715465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0b8108d30 msgr2=0x7fb0b819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.860+0000 7fb0bd6c2640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0b8108d30 0x7fb0b819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0bd6c2640 1 -- 172.21.15.81:0/3423715465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b81a0260 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0be6c4640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0b8108d30 0x7fb0b819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0bd6c2640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b81083e0 0x7fb0b819a950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00d770 tx=0x7fb0ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0b6ffd640 1 -- 172.21.15.81:0/3423715465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac017070 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0b6ffd640 1 -- 172.21.15.81:0/3423715465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0ac009c30 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b81a0550 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0b6ffd640 1 -- 172.21.15.81:0/3423715465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00f620 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.861+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b81a6d70 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.862+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b8102eb0 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.864+0000 7fb0b6ffd640 1 -- 172.21.15.81:0/3423715465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb0ac01a070 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.865+0000 7fb0b6ffd640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb0a00b6540 0x7fb0a00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.865+0000 7fb0bdec3640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb0a00b6540 0x7fb0a00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.865+0000 7fb0b6ffd640 1 -- 172.21.15.81:0/3423715465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb0ac0e7120 con 0x7fb0b81083e0 2024-09-21T02:58:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.866+0000 7fb0bdec3640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb0a00b6540 0x7fb0a00b8a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005e10 tx=0x7fb0b0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:49.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:49.868+0000 7fb0b6ffd640 1 -- 172.21.15.81:0/3423715465 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0ac0ad670 con 0x7fb0b81083e0 2024-09-21T02:58:50.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.090+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fb0b810ab80 con 0x7fb0b81083e0 2024-09-21T02:58:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.131+0000 7fb0b6ffd640 1 -- 172.21.15.81:0/3423715465 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fb0ac0b1a50 con 0x7fb0b81083e0 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb0a00b6540 msgr2=0x7fb0a00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb0a00b6540 0x7fb0a00b8a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005e10 tx=0x7fb0b0005da0 comp rx=0 tx=0).stop 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b81083e0 msgr2=0x7fb0b819a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b81083e0 0x7fb0b819a950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00d770 tx=0x7fb0ac00dc30 comp rx=0 tx=0).stop 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 shutdown_connections 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb0a00b6540 0x7fb0a00b8a50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0b8108d30 0x7fb0b819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b81083e0 0x7fb0b819a950 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 --2- 172.21.15.81:0/3423715465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb0b8102aa0 0x7fb0b819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 >> 172.21.15.81:0/3423715465 conn(0x7fb0b80797e0 msgr2=0x7fb0b81044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 shutdown_connections 2024-09-21T02:58:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:50.133+0000 7fb0c0127640 1 -- 172.21.15.81:0/3423715465 wait complete. 2024-09-21T02:58:50.483 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:50 smithi081 ceph-mon[30991]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:58:50.483 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:50 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3423715465' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:58:50.483 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:50 smithi081 ceph-mon[30991]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T02:58:50.483 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:50 smithi081 ceph-mon[30991]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T02:58:50.483 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:50 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3423715465' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T02:58:50.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:50 smithi081 ceph-mon[30991]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T02:58:50.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:50 smithi081 ceph-mon[30991]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T02:58:50.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:50 smithi181 ceph-mon[34096]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:58:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:50 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3423715465' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:58:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:50 smithi181 ceph-mon[34096]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T02:58:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:50 smithi181 ceph-mon[34096]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T02:58:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:50 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3423715465' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T02:58:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:50 smithi181 ceph-mon[34096]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T02:58:50.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:50 smithi181 ceph-mon[34096]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T02:58:50.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:50 smithi164 ceph-mon[34236]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:58:50.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:50 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3423715465' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:58:50.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:50 smithi164 ceph-mon[34236]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T02:58:50.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:50 smithi164 ceph-mon[34236]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T02:58:50.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:50 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3423715465' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T02:58:50.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:50 smithi164 ceph-mon[34236]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T02:58:50.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:50 smithi164 ceph-mon[34236]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T02:58:50.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T02:58:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:51.494 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T02:58:51.494 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] up:active 2024-09-21T02:58:51.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T02:58:51.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T02:58:51.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: Cluster is now healthy 2024-09-21T02:58:51.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T02:58:51.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T02:58:51.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:51 smithi081 ceph-mon[30991]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] up:active 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: Cluster is now healthy 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T02:58:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:51 smithi181 ceph-mon[34096]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] up:active 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: Cluster is now healthy 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T02:58:51.583 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:51 smithi164 ceph-mon[34236]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T02:58:51.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 -- 172.21.15.81:0/4233271078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe01083d0 msgr2=0x7f8fe01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 --2- 172.21.15.81:0/4233271078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe01083d0 0x7f8fe01087e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009900 tx=0x7f8fd402a410 comp rx=0 tx=0).stop 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 -- 172.21.15.81:0/4233271078 shutdown_connections 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 --2- 172.21.15.81:0/4233271078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fe0108d20 0x7f8fe010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 --2- 172.21.15.81:0/4233271078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe01083d0 0x7f8fe01087e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 --2- 172.21.15.81:0/4233271078 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe0102ae0 0x7f8fe0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 -- 172.21.15.81:0/4233271078 >> 172.21.15.81:0/4233271078 conn(0x7f8fe0079760 msgr2=0x7f8fe0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 -- 172.21.15.81:0/4233271078 shutdown_connections 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 -- 172.21.15.81:0/4233271078 wait complete. 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.735+0000 7f8fe6364640 1 Processor -- start 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe6364640 1 -- start start 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe6364640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe0102ae0 0x7f8fe010ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe6364640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe01083d0 0x7f8fe0110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe6364640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fe0108d20 0x7f8fe0110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:51.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe6364640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0113960 con 0x7f8fe0102ae0 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe6364640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01137e0 con 0x7f8fe0108d20 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe6364640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0113ae0 con 0x7f8fe01083d0 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe0102ae0 0x7f8fe010ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe0102ae0 0x7f8fe010ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54064/0 (socket says 172.21.15.81:54064) 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 -- 172.21.15.81:0/1592188360 learned_addr learned my addr 172.21.15.81:0/1592188360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fe4901640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fe0108d20 0x7f8fe0110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdf7fe640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe01083d0 0x7f8fe0110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 -- 172.21.15.81:0/1592188360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe01083d0 msgr2=0x7f8fe0110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe01083d0 0x7f8fe0110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 -- 172.21.15.81:0/1592188360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fe0108d20 msgr2=0x7f8fe0110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fe0108d20 0x7f8fe0110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:51.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.736+0000 7f8fdffff640 1 -- 172.21.15.81:0/1592188360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe01a8690 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.737+0000 7f8fdffff640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe0102ae0 0x7f8fe010ffe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000e9f0 tx=0x7f8fd000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.737+0000 7f8fdd7fa640 1 -- 172.21.15.81:0/1592188360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000cd80 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.737+0000 7f8fdd7fa640 1 -- 172.21.15.81:0/1592188360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fd00054b0 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.737+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe01a8980 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.737+0000 7f8fdd7fa640 1 -- 172.21.15.81:0/1592188360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0010430 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.737+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe01a8e40 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.738+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe0103d10 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.739+0000 7f8fdd7fa640 1 -- 172.21.15.81:0/1592188360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8fd00046c0 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.740+0000 7f8fdd7fa640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8fc80b6510 0x7f8fc80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.740+0000 7f8fdf7fe640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8fc80b6510 0x7f8fc80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.740+0000 7f8fdd7fa640 1 -- 172.21.15.81:0/1592188360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f8fd00e7b70 con 0x7f8fe0102ae0 2024-09-21T02:58:51.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.741+0000 7f8fdf7fe640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8fc80b6510 0x7f8fc80b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4004770 tx=0x7f8fd40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:51.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.744+0000 7f8fdd7fa640 1 -- 172.21.15.81:0/1592188360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fd00ae0c0 con 0x7f8fe0102ae0 2024-09-21T02:58:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:51.957+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f8fe01112e0 con 0x7f8fe0102ae0 2024-09-21T02:58:52.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.140+0000 7f8fdd7fa640 1 -- 172.21.15.81:0/1592188360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f8fd00b24a0 con 0x7f8fe0102ae0 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8fc80b6510 msgr2=0x7f8fc80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8fc80b6510 0x7f8fc80b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4004770 tx=0x7f8fd40058d0 comp rx=0 tx=0).stop 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe0102ae0 msgr2=0x7f8fe010ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe0102ae0 0x7f8fe010ffe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000e9f0 tx=0x7f8fd000edf0 comp rx=0 tx=0).stop 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 shutdown_connections 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8fc80b6510 0x7f8fc80b8a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8fe01083d0 0x7f8fe0110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fe0108d20 0x7f8fe0110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:52.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 --2- 172.21.15.81:0/1592188360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fe0102ae0 0x7f8fe010ffe0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:52.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 >> 172.21.15.81:0/1592188360 conn(0x7f8fe0079760 msgr2=0x7f8fe01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:52.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 shutdown_connections 2024-09-21T02:58:52.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:52.143+0000 7f8fe6364640 1 -- 172.21.15.81:0/1592188360 wait complete. 2024-09-21T02:58:52.466 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:52 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1592188360' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:58:52.466 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:52 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1592188360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:58:52.466 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:52 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] up:active 2024-09-21T02:58:52.466 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:52 smithi081 ceph-mon[30991]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T02:58:52.466 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:52 smithi081 ceph-mon[30991]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:58:52.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:52 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1592188360' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:58:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:52 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1592188360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:58:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:52 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] up:active 2024-09-21T02:58:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:52 smithi181 ceph-mon[34096]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T02:58:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:52 smithi181 ceph-mon[34096]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:58:52.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:52 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1592188360' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:58:52.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:52 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1592188360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:58:52.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:52 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] up:active 2024-09-21T02:58:52.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:52 smithi164 ceph-mon[34236]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T02:58:52.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:52 smithi164 ceph-mon[34236]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:58:52.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T02:58:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:53 smithi181 ceph-mon[34096]: pgmap v314: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:53.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:53 smithi081 ceph-mon[30991]: pgmap v314: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:53.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 -- 172.21.15.81:0/42451352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 msgr2=0x7fc588110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:53.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 --2- 172.21.15.81:0/42451352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc588110710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc580009ca0 tx=0x7fc58002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:58:53.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 -- 172.21.15.81:0/42451352 shutdown_connections 2024-09-21T02:58:53.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 --2- 172.21.15.81:0/42451352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc588106330 0x7fc588106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:53.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 --2- 172.21.15.81:0/42451352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc588110710 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 --2- 172.21.15.81:0/42451352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5881020e0 0x7fc5881024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 -- 172.21.15.81:0/42451352 >> 172.21.15.81:0/42451352 conn(0x7fc588079ec0 msgr2=0x7fc58807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 -- 172.21.15.81:0/42451352 shutdown_connections 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 -- 172.21.15.81:0/42451352 wait complete. 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 Processor -- start 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.674+0000 7fc58f97f640 1 -- start start 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58f97f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5881020e0 0x7fc58819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58f97f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc588106330 0x7fc58819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58f97f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc58819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58f97f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc588113a00 con 0x7fc588106c80 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58f97f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc588113880 con 0x7fc5881020e0 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58f97f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc588113b80 con 0x7fc588106330 2024-09-21T02:58:53.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc58819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58d71b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5881020e0 0x7fc58819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc58819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54070/0 (socket says 172.21.15.81:54070) 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 -- 172.21.15.81:0/4186565652 learned_addr learned my addr 172.21.15.81:0/4186565652 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58cf1a640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc588106330 0x7fc58819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 -- 172.21.15.81:0/4186565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc588106330 msgr2=0x7fc58819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc588106330 0x7fc58819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 -- 172.21.15.81:0/4186565652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5881020e0 msgr2=0x7fc58819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5881020e0 0x7fc58819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 -- 172.21.15.81:0/4186565652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5881a0360 con 0x7fc588106c80 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58cf1a640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc588106330 0x7fc58819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58d71b640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5881020e0 0x7fc58819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc58df1c640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc58819fc30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc580031f60 tx=0x7fc5800305c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.675+0000 7fc5867fc640 1 -- 172.21.15.81:0/4186565652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580003c30 con 0x7fc588106c80 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.676+0000 7fc5867fc640 1 -- 172.21.15.81:0/4186565652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc580003dd0 con 0x7fc588106c80 2024-09-21T02:58:53.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.676+0000 7fc5867fc640 1 -- 172.21.15.81:0/4186565652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580004810 con 0x7fc588106c80 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.676+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5881a05f0 con 0x7fc588106c80 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.676+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5881a6db0 con 0x7fc588106c80 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.677+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5881024f0 con 0x7fc588106c80 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.678+0000 7fc5867fc640 1 -- 172.21.15.81:0/4186565652 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc580004050 con 0x7fc588106c80 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.679+0000 7fc5867fc640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc5700b6590 0x7fc5700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.679+0000 7fc5867fc640 1 -- 172.21.15.81:0/4186565652 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fc5801085e0 con 0x7fc588106c80 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.679+0000 7fc58d71b640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc5700b6590 0x7fc5700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:53.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.679+0000 7fc58d71b640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc5700b6590 0x7fc5700b8aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc58806bb30 tx=0x7fc57800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:53.684 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:53 smithi164 ceph-mon[34236]: pgmap v314: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:53.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.683+0000 7fc5867fc640 1 -- 172.21.15.81:0/4186565652 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5800098b0 con 0x7fc588106c80 2024-09-21T02:58:53.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:53.897+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc58810bd70 con 0x7fc588106c80 2024-09-21T02:58:54.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.249+0000 7fc5867fc640 1 -- 172.21.15.81:0/4186565652 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fc5800ceb30 con 0x7fc588106c80 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc5700b6590 msgr2=0x7fc5700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc5700b6590 0x7fc5700b8aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc58806bb30 tx=0x7fc57800b390 comp rx=0 tx=0).stop 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 msgr2=0x7fc58819fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc58819fc30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc580031f60 tx=0x7fc5800305c0 comp rx=0 tx=0).stop 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 shutdown_connections 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc5700b6590 0x7fc5700b8aa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc588106330 0x7fc58819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc588106c80 0x7fc58819fc30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 --2- 172.21.15.81:0/4186565652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5881020e0 0x7fc58819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 >> 172.21.15.81:0/4186565652 conn(0x7fc588079ec0 msgr2=0x7fc588107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 shutdown_connections 2024-09-21T02:58:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:54.252+0000 7fc58f97f640 1 -- 172.21.15.81:0/4186565652 wait complete. 2024-09-21T02:58:54.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:54 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4186565652' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:58:54.539 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:54 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4186565652' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:58:54.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:54 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4186565652' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:58:54.958 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T02:58:54.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T02:58:55.215 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:55.502 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-mon[30991]: pgmap v315: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.7 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:55.502 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4186565652' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:58:55.502 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-mon[30991]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:58:55.636 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:55 smithi164 ceph-mon[34236]: pgmap v315: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.7 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:55.636 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:55 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4186565652' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:58:55.636 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:55 smithi164 ceph-mon[34236]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 -- 172.21.15.81:0/2977186655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a8102a70 msgr2=0x7fe8a8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 --2- 172.21.15.81:0/2977186655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a8102a70 0x7fe8a8102e80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe898009900 tx=0x7fe89802a410 comp rx=0 tx=0).stop 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 -- 172.21.15.81:0/2977186655 shutdown_connections 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 --2- 172.21.15.81:0/2977186655 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a81083b0 0x7fe8a81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 --2- 172.21.15.81:0/2977186655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a8108d00 0x7fe8a810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 --2- 172.21.15.81:0/2977186655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a8102a70 0x7fe8a8102e80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 -- 172.21.15.81:0/2977186655 >> 172.21.15.81:0/2977186655 conn(0x7fe8a8079710 msgr2=0x7fe8a8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 -- 172.21.15.81:0/2977186655 shutdown_connections 2024-09-21T02:58:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.716+0000 7fe8aea69640 1 -- 172.21.15.81:0/2977186655 wait complete. 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 Processor -- start 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 -- start start 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a8102a70 0x7fe8a819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a81083b0 0x7fe8a819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a8108d00 0x7fe8a819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8112870 con 0x7fe8a81083b0 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81126f0 con 0x7fe8a8102a70 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8aea69640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81129f0 con 0x7fe8a8108d00 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.717+0000 7fe8a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a81083b0 0x7fe8a819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a81083b0 0x7fe8a819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54100/0 (socket says 172.21.15.81:54100) 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 -- 172.21.15.81:0/900251490 learned_addr learned my addr 172.21.15.81:0/900251490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8ad006640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a8108d00 0x7fe8a819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8ac805640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a8102a70 0x7fe8a819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 -- 172.21.15.81:0/900251490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a8108d00 msgr2=0x7fe8a819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a8108d00 0x7fe8a819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 -- 172.21.15.81:0/900251490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a8102a70 msgr2=0x7fe8a819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a8102a70 0x7fe8a819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 -- 172.21.15.81:0/900251490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a81a0360 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8ac805640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a8102a70 0x7fe8a819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a7fff640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a81083b0 0x7fe8a819a990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00d740 tx=0x7fe89c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a5ffb640 1 -- 172.21.15.81:0/900251490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c017070 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a81a0650 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a5ffb640 1 -- 172.21.15.81:0/900251490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe89c00de50 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8a5ffb640 1 -- 172.21.15.81:0/900251490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00f620 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.718+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a81a6db0 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.720+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a8103cf0 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.721+0000 7fe8a5ffb640 1 -- 172.21.15.81:0/900251490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe89c01a070 con 0x7fe8a81083b0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.722+0000 7fe8a5ffb640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8900b6510 0x7fe8900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.722+0000 7fe8ac805640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8900b6510 0x7fe8900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.722+0000 7fe8a5ffb640 1 -- 172.21.15.81:0/900251490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe89c0e7070 con 0x7fe8a81083b0 2024-09-21T02:58:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.722+0000 7fe8ac805640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8900b6510 0x7fe8900b8a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe898000c00 tx=0x7fe898005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:55.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.726+0000 7fe8a5ffb640 1 -- 172.21.15.81:0/900251490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe89c0ad5c0 con 0x7fe8a81083b0 2024-09-21T02:58:55.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:55 smithi181 ceph-mon[34096]: pgmap v315: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.7 KiB/s wr, 4 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:55.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:55 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4186565652' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:58:55.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:55 smithi181 ceph-mon[34096]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:58:55.931 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 02:58:55 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b[62742]: 2024-09-21T02:58:55.634+0000 7fa9f839d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T02:58:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.932+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe8a8063800 con 0x7fe8900b6510 2024-09-21T02:58:55.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.960+0000 7fe8a5ffb640 1 -- 172.21.15.81:0/900251490 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe8a8063800 con 0x7fe8900b6510 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8900b6510 msgr2=0x7fe8900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8900b6510 0x7fe8900b8a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe898000c00 tx=0x7fe898005a20 comp rx=0 tx=0).stop 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a81083b0 msgr2=0x7fe8a819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a81083b0 0x7fe8a819a990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00d740 tx=0x7fe89c00dc00 comp rx=0 tx=0).stop 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 shutdown_connections 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8900b6510 0x7fe8900b8a20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8a8108d00 0x7fe8a819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8a81083b0 0x7fe8a819a990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 --2- 172.21.15.81:0/900251490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a8102a70 0x7fe8a819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 >> 172.21.15.81:0/900251490 conn(0x7fe8a8079710 msgr2=0x7fe8a8101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:55.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 shutdown_connections 2024-09-21T02:58:55.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:55.962+0000 7fe8aea69640 1 -- 172.21.15.81:0/900251490 wait complete. 2024-09-21T02:58:56.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:58:55.937+0000 7fe85964b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:58:56.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:58:55.937+0000 7fe85964b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:58:56.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:58:55.937+0000 7fe85964b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:58:56.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:58:55.937+0000 7fe85964b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:58:56.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 02:58:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x[31217]: 2024-09-21T02:58:55.937+0000 7fe85964b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:58:56.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T02:58:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:57.443 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:57 smithi081 ceph-mon[30991]: pgmap v316: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3.0 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:57.443 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:57 smithi081 ceph-mon[30991]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 -- 172.21.15.81:0/1342702416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe974104a60 msgr2=0x7fe974104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/1342702416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe974104a60 0x7fe974104e70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe964009900 tx=0x7fe96402a410 comp rx=0 tx=0).stop 2024-09-21T02:58:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 -- 172.21.15.81:0/1342702416 shutdown_connections 2024-09-21T02:58:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/1342702416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9741053b0 0x7fe97410d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/1342702416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe97410dec0 0x7fe9741103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/1342702416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe974104a60 0x7fe974104e70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 -- 172.21.15.81:0/1342702416 >> 172.21.15.81:0/1342702416 conn(0x7fe9740796d0 msgr2=0x7fe974079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 -- 172.21.15.81:0/1342702416 shutdown_connections 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.536+0000 7fe97a3fd640 1 -- 172.21.15.81:0/1342702416 wait complete. 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 Processor -- start 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 -- start start 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe974104a60 0x7fe97419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9741053b0 0x7fe97419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97410dec0 0x7fe97419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9741139f0 con 0x7fe97410dec0 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe974113870 con 0x7fe9741053b0 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97a3fd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe974113b70 con 0x7fe974104a60 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97899a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97410dec0 0x7fe97419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97899a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97410dec0 0x7fe97419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54124/0 (socket says 172.21.15.81:54124) 2024-09-21T02:58:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.537+0000 7fe97899a640 1 -- 172.21.15.81:0/161608945 learned_addr learned my addr 172.21.15.81:0/161608945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe973fff640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe974104a60 0x7fe97419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe9737fe640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9741053b0 0x7fe97419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe97899a640 1 -- 172.21.15.81:0/161608945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe974104a60 msgr2=0x7fe97419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe97899a640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe974104a60 0x7fe97419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe97899a640 1 -- 172.21.15.81:0/161608945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9741053b0 msgr2=0x7fe97419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe97899a640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9741053b0 0x7fe97419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe97899a640 1 -- 172.21.15.81:0/161608945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9741a0430 con 0x7fe97410dec0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe9737fe640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9741053b0 0x7fe97419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe97899a640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97410dec0 0x7fe97419fd00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00eb10 tx=0x7fe96c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe9717fa640 1 -- 172.21.15.81:0/161608945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c004b20 con 0x7fe97410dec0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9741a0720 con 0x7fe97410dec0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe9717fa640 1 -- 172.21.15.81:0/161608945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe96c004cc0 con 0x7fe97410dec0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.538+0000 7fe9717fa640 1 -- 172.21.15.81:0/161608945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c010690 con 0x7fe97410dec0 2024-09-21T02:58:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.539+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9741a6e80 con 0x7fe97410dec0 2024-09-21T02:58:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.540+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe974104e70 con 0x7fe97410dec0 2024-09-21T02:58:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.541+0000 7fe9717fa640 1 -- 172.21.15.81:0/161608945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe96c005020 con 0x7fe97410dec0 2024-09-21T02:58:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.542+0000 7fe9717fa640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe95c0b6510 0x7fe95c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.542+0000 7fe973fff640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe95c0b6510 0x7fe95c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.542+0000 7fe9717fa640 1 -- 172.21.15.81:0/161608945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe96c0e7c20 con 0x7fe97410dec0 2024-09-21T02:58:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.542+0000 7fe973fff640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe95c0b6510 0x7fe95c0b8a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe9640057c0 tx=0x7fe9640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.546+0000 7fe9717fa640 1 -- 172.21.15.81:0/161608945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe96c0ae170 con 0x7fe97410dec0 2024-09-21T02:58:57.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:57 smithi164 ceph-mon[34236]: pgmap v316: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3.0 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:57.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:57 smithi164 ceph-mon[34236]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:57.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:57 smithi181 ceph-mon[34096]: pgmap v316: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3.0 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:57.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:57 smithi181 ceph-mon[34096]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:57.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.749+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe97419b5f0 con 0x7fe95c0b6510 2024-09-21T02:58:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.778+0000 7fe9717fa640 1 -- 172.21.15.81:0/161608945 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe97419b5f0 con 0x7fe95c0b6510 2024-09-21T02:58:57.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.780+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe95c0b6510 msgr2=0x7fe95c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:57.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.780+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe95c0b6510 0x7fe95c0b8a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe9640057c0 tx=0x7fe9640058d0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97410dec0 msgr2=0x7fe97419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:57.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97410dec0 0x7fe97419fd00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00eb10 tx=0x7fe96c00c2d0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 shutdown_connections 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe95c0b6510 0x7fe95c0b8a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97410dec0 0x7fe97419fd00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9741053b0 0x7fe97419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 --2- 172.21.15.81:0/161608945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe974104a60 0x7fe97419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 >> 172.21.15.81:0/161608945 conn(0x7fe9740796d0 msgr2=0x7fe974106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 shutdown_connections 2024-09-21T02:58:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:57.781+0000 7fe97a3fd640 1 -- 172.21.15.81:0/161608945 wait complete. 2024-09-21T02:58:58.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T02:58:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 -- 172.21.15.81:0/1043046066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 msgr2=0x7f77981087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 --2- 172.21.15.81:0/1043046066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f77981087b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f778c009900 tx=0x7f778c02a410 comp rx=0 tx=0).stop 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 -- 172.21.15.81:0/1043046066 shutdown_connections 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 --2- 172.21.15.81:0/1043046066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7798108cf0 0x7f779810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 --2- 172.21.15.81:0/1043046066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f77981087b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 --2- 172.21.15.81:0/1043046066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7798102a60 0x7f7798102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 -- 172.21.15.81:0/1043046066 >> 172.21.15.81:0/1043046066 conn(0x7f7798079720 msgr2=0x7f7798079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:59.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 -- 172.21.15.81:0/1043046066 shutdown_connections 2024-09-21T02:58:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.350+0000 7f779cfc0640 1 -- 172.21.15.81:0/1043046066 wait complete. 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 Processor -- start 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 -- start start 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7798102a60 0x7f779819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f779819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7798108cf0 0x7f779819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7798112810 con 0x7f77981083a0 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7798112690 con 0x7f7798102a60 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779cfc0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7798112990 con 0x7f7798108cf0 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f779819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f779819b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54132/0 (socket says 172.21.15.81:54132) 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 -- 172.21.15.81:0/398825045 learned_addr learned my addr 172.21.15.81:0/398825045 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7796d9d640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7798108cf0 0x7f779819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f779659c640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7798102a60 0x7f779819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 -- 172.21.15.81:0/398825045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7798108cf0 msgr2=0x7f779819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7798108cf0 0x7f779819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 -- 172.21.15.81:0/398825045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7798102a60 msgr2=0x7f779819b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7798102a60 0x7f779819b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.351+0000 7f7795d9b640 1 -- 172.21.15.81:0/398825045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77981a6430 con 0x7f77981083a0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.352+0000 7f7795d9b640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f779819b6e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f778c005940 tx=0x7f778c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.352+0000 7f77877fe640 1 -- 172.21.15.81:0/398825045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c03f030 con 0x7f77981083a0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.352+0000 7f77877fe640 1 -- 172.21.15.81:0/398825045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f778c004440 con 0x7f77981083a0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.352+0000 7f77877fe640 1 -- 172.21.15.81:0/398825045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c035070 con 0x7f77981083a0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.352+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77981a66c0 con 0x7f77981083a0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.352+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77981a6b50 con 0x7f77981083a0 2024-09-21T02:58:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.353+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7798103ce0 con 0x7f77981083a0 2024-09-21T02:58:59.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.355+0000 7f77877fe640 1 -- 172.21.15.81:0/398825045 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f778c042030 con 0x7f77981083a0 2024-09-21T02:58:59.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.356+0000 7f77877fe640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77800b6650 0x7f77800b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:58:59.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.356+0000 7f779659c640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77800b6650 0x7f77800b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:58:59.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.356+0000 7f77877fe640 1 -- 172.21.15.81:0/398825045 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f778c108060 con 0x7f77981083a0 2024-09-21T02:58:59.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.356+0000 7f779659c640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77800b6650 0x7f77800b8b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f779806c6e0 tx=0x7f7788005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:58:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.359+0000 7f77877fe640 1 -- 172.21.15.81:0/398825045 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f778c0ce450 con 0x7f77981083a0 2024-09-21T02:58:59.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:59 smithi081 ceph-mon[30991]: pgmap v317: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.6 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:59.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:59 smithi081 ceph-mon[30991]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:59.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:58:59 smithi081 ceph-mon[30991]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T02:58:59.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.564+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f7798063890 con 0x7f77800b6650 2024-09-21T02:58:59.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.570+0000 7f77877fe640 1 -- 172.21.15.81:0/398825045 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7798063890 con 0x7f77800b6650 2024-09-21T02:58:59.572 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_0/da0e12b5-0d29-42f4-b43a-b13398ac7e0f 2024-09-21T02:58:59.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77800b6650 msgr2=0x7f77800b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77800b6650 0x7f77800b8b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f779806c6e0 tx=0x7f7788005f90 comp rx=0 tx=0).stop 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 msgr2=0x7f779819b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f779819b6e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f778c005940 tx=0x7f778c004040 comp rx=0 tx=0).stop 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 shutdown_connections 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f77800b6650 0x7f77800b8b60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7798108cf0 0x7f779819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77981083a0 0x7f779819b6e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 --2- 172.21.15.81:0/398825045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7798102a60 0x7f779819b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 >> 172.21.15.81:0/398825045 conn(0x7f7798079720 msgr2=0x7f77981044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 shutdown_connections 2024-09-21T02:58:59.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:58:59.573+0000 7f779cfc0640 1 -- 172.21.15.81:0/398825045 wait complete. 2024-09-21T02:58:59.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:59 smithi164 ceph-mon[34236]: pgmap v317: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.6 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:59.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:59 smithi164 ceph-mon[34236]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:59.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:58:59 smithi164 ceph-mon[34236]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T02:58:59.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:59 smithi181 ceph-mon[34096]: pgmap v317: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.6 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:58:59.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:59 smithi181 ceph-mon[34096]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:58:59.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:58:59 smithi181 ceph-mon[34096]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-21T02:59:00.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T02:59:00.461 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:00.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:00 smithi081 ceph-mon[30991]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:00.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:00 smithi164 ceph-mon[34236]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:00.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:00 smithi181 ceph-mon[34096]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 -- 172.21.15.81:0/3675645115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c103240 msgr2=0x7fdb0c103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 --2- 172.21.15.81:0/3675645115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c103240 0x7fdb0c103650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009900 tx=0x7fdb0802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 -- 172.21.15.81:0/3675645115 shutdown_connections 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 --2- 172.21.15.81:0/3675645115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0c1083e0 0x7fdb0c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 --2- 172.21.15.81:0/3675645115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0c108d30 0x7fdb0c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 --2- 172.21.15.81:0/3675645115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c103240 0x7fdb0c103650 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 -- 172.21.15.81:0/3675645115 >> 172.21.15.81:0/3675645115 conn(0x7fdb0c077cc0 msgr2=0x7fdb0c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 -- 172.21.15.81:0/3675645115 shutdown_connections 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.963+0000 7fdb138e1640 1 -- 172.21.15.81:0/3675645115 wait complete. 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 Processor -- start 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 -- start start 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0c103240 0x7fdb0c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0c1083e0 0x7fdb0c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c108d30 0x7fdb0c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c1128a0 con 0x7fdb0c108d30 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c112720 con 0x7fdb0c1083e0 2024-09-21T02:59:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb138e1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c112a20 con 0x7fdb0c103240 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c108d30 0x7fdb0c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c108d30 0x7fdb0c19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54150/0 (socket says 172.21.15.81:54150) 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 -- 172.21.15.81:0/129053305 learned_addr learned my addr 172.21.15.81:0/129053305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb1167d640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0c103240 0x7fdb0c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb10e7c640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0c1083e0 0x7fdb0c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 -- 172.21.15.81:0/129053305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0c103240 msgr2=0x7fdb0c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0c103240 0x7fdb0c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 -- 172.21.15.81:0/129053305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0c1083e0 msgr2=0x7fdb0c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0c1083e0 0x7fdb0c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.964+0000 7fdb11e7e640 1 -- 172.21.15.81:0/129053305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c19f1c0 con 0x7fdb0c108d30 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.965+0000 7fdb11e7e640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c108d30 0x7fdb0c19eb50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400cce0 tx=0x7fdb0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.965+0000 7fdb027fc640 1 -- 172.21.15.81:0/129053305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400f450 con 0x7fdb0c108d30 2024-09-21T02:59:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.965+0000 7fdb027fc640 1 -- 172.21.15.81:0/129053305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb0400fa80 con 0x7fdb0c108d30 2024-09-21T02:59:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.965+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c19f4b0 con 0x7fdb0c108d30 2024-09-21T02:59:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.965+0000 7fdb027fc640 1 -- 172.21.15.81:0/129053305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04018ad0 con 0x7fdb0c108d30 2024-09-21T02:59:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.965+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c1a5cd0 con 0x7fdb0c108d30 2024-09-21T02:59:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.966+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c103650 con 0x7fdb0c108d30 2024-09-21T02:59:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.967+0000 7fdb027fc640 1 -- 172.21.15.81:0/129053305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdb0400f5f0 con 0x7fdb0c108d30 2024-09-21T02:59:00.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.968+0000 7fdb027fc640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdaf80b6650 0x7fdaf80b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:00.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.968+0000 7fdb1167d640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdaf80b6650 0x7fdaf80b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:00.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.968+0000 7fdb027fc640 1 -- 172.21.15.81:0/129053305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fdb040e7f00 con 0x7fdb0c108d30 2024-09-21T02:59:00.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.969+0000 7fdb1167d640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdaf80b6650 0x7fdaf80b8b60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb080057c0 tx=0x7fdb080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:00.971+0000 7fdb027fc640 1 -- 172.21.15.81:0/129053305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb04014030 con 0x7fdb0c108d30 2024-09-21T02:59:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.177+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdb0c063800 con 0x7fdaf80b6650 2024-09-21T02:59:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.207+0000 7fdb027fc640 1 -- 172.21.15.81:0/129053305 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdb0c063800 con 0x7fdaf80b6650 2024-09-21T02:59:01.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdaf80b6650 msgr2=0x7fdaf80b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdaf80b6650 0x7fdaf80b8b60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb080057c0 tx=0x7fdb080058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c108d30 msgr2=0x7fdb0c19eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c108d30 0x7fdb0c19eb50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400cce0 tx=0x7fdb0400a620 comp rx=0 tx=0).stop 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 shutdown_connections 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdaf80b6650 0x7fdaf80b8b60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0c108d30 0x7fdb0c19eb50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb0c1083e0 0x7fdb0c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 --2- 172.21.15.81:0/129053305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb0c103240 0x7fdb0c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 >> 172.21.15.81:0/129053305 conn(0x7fdb0c077cc0 msgr2=0x7fdb0c106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 shutdown_connections 2024-09-21T02:59:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:01.209+0000 7fdb138e1640 1 -- 172.21.15.81:0/129053305 wait complete. 2024-09-21T02:59:01.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:01 smithi081 ceph-mon[30991]: pgmap v318: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:59:01.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:01 smithi164 ceph-mon[34236]: pgmap v318: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:59:01.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:01 smithi181 ceph-mon[34096]: pgmap v318: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:59:01.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T02:59:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:02.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:02 smithi081 ceph-mon[30991]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:02.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:02 smithi164 ceph-mon[34236]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.691+0000 7f33fae39640 1 -- 172.21.15.81:0/2456092286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4102a60 msgr2=0x7f33f4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.691+0000 7f33fae39640 1 --2- 172.21.15.81:0/2456092286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4102a60 0x7f33f4102e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009ca0 tx=0x7f33ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 -- 172.21.15.81:0/2456092286 shutdown_connections 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 --2- 172.21.15.81:0/2456092286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33f41083a0 0x7f33f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 --2- 172.21.15.81:0/2456092286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33f4108cf0 0x7f33f410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 --2- 172.21.15.81:0/2456092286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4102a60 0x7f33f4102e70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 -- 172.21.15.81:0/2456092286 >> 172.21.15.81:0/2456092286 conn(0x7f33f4079730 msgr2=0x7f33f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 -- 172.21.15.81:0/2456092286 shutdown_connections 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 -- 172.21.15.81:0/2456092286 wait complete. 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 Processor -- start 2024-09-21T02:59:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.692+0000 7f33fae39640 1 -- start start 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33fae39640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33f4102a60 0x7f33f419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33fae39640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33f41083a0 0x7f33f419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33fae39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33fae39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4113960 con 0x7f33f4108cf0 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33fae39640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f33f41137e0 con 0x7f33f41083a0 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33fae39640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4113ae0 con 0x7f33f4102a60 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57214/0 (socket says 172.21.15.81:57214) 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 -- 172.21.15.81:0/1251592347 learned_addr learned my addr 172.21.15.81:0/1251592347 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f8bd5640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33f4102a60 0x7f33f419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f3fff640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33f41083a0 0x7f33f419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 -- 172.21.15.81:0/1251592347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33f4102a60 msgr2=0x7f33f419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33f4102a60 0x7f33f419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 -- 172.21.15.81:0/1251592347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33f41083a0 msgr2=0x7f33f419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33f41083a0 0x7f33f419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 -- 172.21.15.81:0/1251592347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f41a0240 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f93d6640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419fbd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f33e400d750 tx=0x7f33e400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1251592347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4017070 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1251592347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33e40054b0 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f41a0530 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.693+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1251592347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4004b90 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.694+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f41a6d50 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.695+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4102e70 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.696+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1251592347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f33e4004d30 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.697+0000 7f33f1ffb640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f33dc0b6650 0x7f33dc0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.697+0000 7f33f8bd5640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f33dc0b6650 0x7f33dc0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.697+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1251592347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f33e40e7280 con 0x7f33f4108cf0 2024-09-21T02:59:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.697+0000 7f33f8bd5640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f33dc0b6650 0x7f33dc0b8b60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000f80 tx=0x7f33ec0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.701+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1251592347 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33e40ad670 con 0x7f33f4108cf0 2024-09-21T02:59:02.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:02 smithi181 ceph-mon[34096]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:02.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.908+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f33f4063800 con 0x7f33dc0b6650 2024-09-21T02:59:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.914+0000 7f33f1ffb640 1 -- 172.21.15.81:0/1251592347 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f33f4063800 con 0x7f33dc0b6650 2024-09-21T02:59:02.916 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_1/6d7b80e1-8ed2-47e5-baff-f122baf14349 2024-09-21T02:59:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f33dc0b6650 msgr2=0x7f33dc0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f33dc0b6650 0x7f33dc0b8b60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000f80 tx=0x7f33ec0093f0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 msgr2=0x7f33f419fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419fbd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f33e400d750 tx=0x7f33e400dc10 comp rx=0 tx=0).stop 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 shutdown_connections 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f33dc0b6650 0x7f33dc0b8b60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33f4108cf0 0x7f33f419fbd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33f41083a0 0x7f33f419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 --2- 172.21.15.81:0/1251592347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f33f4102a60 0x7f33f419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 >> 172.21.15.81:0/1251592347 conn(0x7f33f4079730 msgr2=0x7f33f4101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 shutdown_connections 2024-09-21T02:59:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:02.917+0000 7f33fae39640 1 -- 172.21.15.81:0/1251592347 wait complete. 2024-09-21T02:59:03.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:03 smithi081 ceph-mon[30991]: pgmap v319: 129 pgs: 129 active+clean; 611 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:59:03.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:59:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:03 smithi164 ceph-mon[34236]: pgmap v319: 129 pgs: 129 active+clean; 611 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:59:03.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:03 smithi181 ceph-mon[34096]: pgmap v319: 129 pgs: 129 active+clean; 611 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:59:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:04.300 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:04 smithi081 ceph-mon[30991]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:04.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 -- 172.21.15.81:0/579023707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768102ac0 msgr2=0x7f9768102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 --2- 172.21.15.81:0/579023707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768102ac0 0x7f9768102ed0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9764009900 tx=0x7f976402a410 comp rx=0 tx=0).stop 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 -- 172.21.15.81:0/579023707 shutdown_connections 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 --2- 172.21.15.81:0/579023707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97681083b0 0x7f97681087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 --2- 172.21.15.81:0/579023707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768108d00 0x7f976810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 --2- 172.21.15.81:0/579023707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768102ac0 0x7f9768102ed0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 -- 172.21.15.81:0/579023707 >> 172.21.15.81:0/579023707 conn(0x7f9768079790 msgr2=0x7f9768079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 -- 172.21.15.81:0/579023707 shutdown_connections 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 -- 172.21.15.81:0/579023707 wait complete. 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 Processor -- start 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.389+0000 7f97705ac640 1 -- start start 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f97705ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768102ac0 0x7f976819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:04.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f97705ac640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97681083b0 0x7f976819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f97705ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768108d00 0x7f976819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f97705ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97681128b0 con 0x7f9768108d00 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f97705ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9768112730 con 0x7f9768102ac0 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f97705ac640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9768112a30 con 0x7f97681083b0 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768108d00 0x7f976819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768108d00 0x7f976819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57226/0 (socket says 172.21.15.81:57226) 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 -- 172.21.15.81:0/1950496923 learned_addr learned my addr 172.21.15.81:0/1950496923 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976e348640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768102ac0 0x7f976819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976db47640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97681083b0 0x7f976819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 -- 172.21.15.81:0/1950496923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97681083b0 msgr2=0x7f976819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97681083b0 0x7f976819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 -- 172.21.15.81:0/1950496923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768102ac0 msgr2=0x7f976819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:04.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768102ac0 0x7f976819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 -- 172.21.15.81:0/1950496923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97681a65a0 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f976eb49640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768108d00 0x7f976819bd60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f976000eaa0 tx=0x7f976000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f975f7fe640 1 -- 172.21.15.81:0/1950496923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9760004d20 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f975f7fe640 1 -- 172.21.15.81:0/1950496923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9760005020 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.390+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97681a6890 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.391+0000 7f975f7fe640 1 -- 172.21.15.81:0/1950496923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600116d0 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.391+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97681a6dd0 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.391+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9768102ed0 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.393+0000 7f975f7fe640 1 -- 172.21.15.81:0/1950496923 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f97600051d0 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.394+0000 7f975f7fe640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f97540b6620 0x7f97540b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.394+0000 7f976e348640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f97540b6620 0x7f97540b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.394+0000 7f975f7fe640 1 -- 172.21.15.81:0/1950496923 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f97600e7ca0 con 0x7f9768108d00 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.394+0000 7f976e348640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f97540b6620 0x7f97540b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f976806c3a0 tx=0x7f97640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:04.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.397+0000 7f975f7fe640 1 -- 172.21.15.81:0/1950496923 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9760016030 con 0x7f9768108d00 2024-09-21T02:59:04.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.611+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f976806bc50 con 0x7f9768108d00 2024-09-21T02:59:04.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.612+0000 7f975f7fe640 1 -- 172.21.15.81:0/1950496923 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7f97600ae110 con 0x7f9768108d00 2024-09-21T02:59:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:04.614 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-21T02:58:54:243506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:53.899125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T02:59:04.614 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f97540b6620 msgr2=0x7f97540b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f97540b6620 0x7f97540b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f976806c3a0 tx=0x7f97640058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768108d00 msgr2=0x7f976819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768108d00 0x7f976819bd60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f976000eaa0 tx=0x7f976000eea0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 shutdown_connections 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f97540b6620 0x7f97540b8b30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97681083b0 0x7f976819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768108d00 0x7f976819bd60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 --2- 172.21.15.81:0/1950496923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9768102ac0 0x7f976819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 >> 172.21.15.81:0/1950496923 conn(0x7f9768079790 msgr2=0x7f97681065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:04.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 shutdown_connections 2024-09-21T02:59:04.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:04.614+0000 7f97705ac640 1 -- 172.21.15.81:0/1950496923 wait complete. 2024-09-21T02:59:04.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:04 smithi164 ceph-mon[34236]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:04.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:04 smithi181 ceph-mon[34096]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:59:05.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:59:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:05 smithi081 ceph-mon[30991]: pgmap v320: 129 pgs: 129 active+clean; 611 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T02:59:05.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:05 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1950496923' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:05.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:05 smithi181 ceph-mon[34096]: pgmap v320: 129 pgs: 129 active+clean; 611 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T02:59:05.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:05 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1950496923' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:05.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:05 smithi164 ceph-mon[34236]: pgmap v320: 129 pgs: 129 active+clean; 611 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T02:59:05.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:05 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1950496923' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:06.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 -- 172.21.15.81:0/623086642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8109c70 msgr2=0x7f11a81104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:06.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 --2- 172.21.15.81:0/623086642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8109c70 0x7f11a81104a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f11a0009ca0 tx=0x7f11a002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 -- 172.21.15.81:0/623086642 shutdown_connections 2024-09-21T02:59:06.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 --2- 172.21.15.81:0/623086642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8109c70 0x7f11a81104a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 --2- 172.21.15.81:0/623086642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a8109320 0x7f11a8109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 --2- 172.21.15.81:0/623086642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a81039e0 0x7f11a8103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 -- 172.21.15.81:0/623086642 >> 172.21.15.81:0/623086642 conn(0x7f11a80ff430 msgr2=0x7f11a8101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 -- 172.21.15.81:0/623086642 shutdown_connections 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.116+0000 7f11adf9f640 1 -- 172.21.15.81:0/623086642 wait complete. 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 Processor -- start 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 -- start start 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a81039e0 0x7f11a819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a8109320 0x7f11a819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a8109c70 0x7f11a819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8113830 con 0x7f11a81039e0 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f11a81136b0 con 0x7f11a8109320 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11adf9f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11a81139b0 con 0x7f11a8109c70 2024-09-21T02:59:06.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a81039e0 0x7f11a819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a81039e0 0x7f11a819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57238/0 (socket says 172.21.15.81:57238) 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 -- 172.21.15.81:0/179064539 learned_addr learned my addr 172.21.15.81:0/179064539 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f119ffff640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a8109320 0x7f11a819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 -- 172.21.15.81:0/179064539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a8109c70 msgr2=0x7f11a819f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a8109c70 0x7f11a819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 -- 172.21.15.81:0/179064539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a8109320 msgr2=0x7f11a819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a8109320 0x7f11a819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 -- 172.21.15.81:0/179064539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a81a0110 con 0x7f11a81039e0 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.117+0000 7f11acf9d640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a81039e0 0x7f11a819a1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f11a400e9f0 tx=0x7f11a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.118+0000 7f119dffb640 1 -- 172.21.15.81:0/179064539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a400cd80 con 0x7f11a81039e0 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.118+0000 7f119dffb640 1 -- 172.21.15.81:0/179064539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a40054b0 con 0x7f11a81039e0 2024-09-21T02:59:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.118+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a81a0400 con 0x7f11a81039e0 2024-09-21T02:59:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.118+0000 7f119dffb640 1 -- 172.21.15.81:0/179064539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4010430 con 0x7f11a81039e0 2024-09-21T02:59:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.118+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a81a6b60 con 0x7f11a81039e0 2024-09-21T02:59:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.119+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a8103df0 con 0x7f11a81039e0 2024-09-21T02:59:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.120+0000 7f119dffb640 1 -- 172.21.15.81:0/179064539 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f11a40046c0 con 0x7f11a81039e0 2024-09-21T02:59:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.121+0000 7f119dffb640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11900b65a0 0x7f11900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.121+0000 7f119ffff640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11900b65a0 0x7f11900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.121+0000 7f119dffb640 1 -- 172.21.15.81:0/179064539 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f11a40e7e80 con 0x7f11a81039e0 2024-09-21T02:59:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.122+0000 7f119ffff640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11900b65a0 0x7f11900b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1198005fd0 tx=0x7f1198009470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.124+0000 7f119dffb640 1 -- 172.21.15.81:0/179064539 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11a4056710 con 0x7f11a81039e0 2024-09-21T02:59:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.303+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11a819b2d0 con 0x7f11a81039e0 2024-09-21T02:59:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.305+0000 7f119dffb640 1 -- 172.21.15.81:0/179064539 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7f11a40ae270 con 0x7f11a81039e0 2024-09-21T02:59:06.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:06.307 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11900b65a0 msgr2=0x7f11900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11900b65a0 0x7f11900b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1198005fd0 tx=0x7f1198009470 comp rx=0 tx=0).stop 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a81039e0 msgr2=0x7f11a819a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a81039e0 0x7f11a819a1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f11a400e9f0 tx=0x7f11a400edf0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 shutdown_connections 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11900b65a0 0x7f11900b8ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a8109c70 0x7f11a819f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11a8109320 0x7f11a819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 --2- 172.21.15.81:0/179064539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a81039e0 0x7f11a819a1a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 >> 172.21.15.81:0/179064539 conn(0x7f11a80ff430 msgr2=0x7f11a8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 shutdown_connections 2024-09-21T02:59:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:06.307+0000 7f11adf9f640 1 -- 172.21.15.81:0/179064539 wait complete. 2024-09-21T02:59:06.995 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:59:06.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:59:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:07.541 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:07 smithi081 ceph-mon[30991]: pgmap v321: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2024-09-21T02:59:07.541 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:07 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/179064539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:07 smithi164 ceph-mon[34236]: pgmap v321: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2024-09-21T02:59:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:07 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/179064539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:07.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:07 smithi181 ceph-mon[34096]: pgmap v321: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2024-09-21T02:59:07.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:07 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/179064539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 -- 172.21.15.81:0/4241657853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa81094f0 msgr2=0x7f1aa8109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 --2- 172.21.15.81:0/4241657853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa81094f0 0x7f1aa8109900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009900 tx=0x7f1a9c02a410 comp rx=0 tx=0).stop 2024-09-21T02:59:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 -- 172.21.15.81:0/4241657853 shutdown_connections 2024-09-21T02:59:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 --2- 172.21.15.81:0/4241657853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8109e40 0x7f1aa8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 --2- 172.21.15.81:0/4241657853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa81094f0 0x7f1aa8109900 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 --2- 172.21.15.81:0/4241657853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa8103bb0 0x7f1aa8103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 -- 172.21.15.81:0/4241657853 >> 172.21.15.81:0/4241657853 conn(0x7f1aa80ff600 msgr2=0x7f1aa8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 -- 172.21.15.81:0/4241657853 shutdown_connections 2024-09-21T02:59:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.761+0000 7f1aafb31640 1 -- 172.21.15.81:0/4241657853 wait complete. 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 Processor -- start 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 -- start start 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8103bb0 0x7f1aa819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa81094f0 0x7f1aa819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa8109e40 0x7f1aa819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8113a00 con 0x7f1aa8109e40 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8113880 con 0x7f1aa8103bb0 2024-09-21T02:59:07.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aafb31640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8113b80 con 0x7f1aa81094f0 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aae0ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa8109e40 0x7f1aa819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aae0ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa8109e40 0x7f1aa819fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57250/0 (socket says 172.21.15.81:57250) 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aae0ce640 1 -- 172.21.15.81:0/2985736541 learned_addr learned my addr 172.21.15.81:0/2985736541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aad8cd640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8103bb0 0x7f1aa819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.762+0000 7f1aad0cc640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa81094f0 0x7f1aa819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aae0ce640 1 -- 172.21.15.81:0/2985736541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa81094f0 msgr2=0x7f1aa819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aae0ce640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa81094f0 0x7f1aa819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aae0ce640 1 -- 172.21.15.81:0/2985736541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8103bb0 msgr2=0x7f1aa819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aae0ce640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8103bb0 0x7f1aa819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aae0ce640 1 -- 172.21.15.81:0/2985736541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa81a03a0 con 0x7f1aa8109e40 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aae0ce640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa8109e40 0x7f1aa819fc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000d950 tx=0x7f1aa000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aa6ffd640 1 -- 172.21.15.81:0/2985736541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0017030 con 0x7f1aa8109e40 2024-09-21T02:59:07.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aa6ffd640 1 -- 172.21.15.81:0/2985736541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1aa0004020 con 0x7f1aa8109e40 2024-09-21T02:59:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa81a0690 con 0x7f1aa8109e40 2024-09-21T02:59:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aa6ffd640 1 -- 172.21.15.81:0/2985736541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0003ab0 con 0x7f1aa8109e40 2024-09-21T02:59:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.763+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa81a6df0 con 0x7f1aa8109e40 2024-09-21T02:59:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.764+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa8103fc0 con 0x7f1aa8109e40 2024-09-21T02:59:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.766+0000 7f1aa6ffd640 1 -- 172.21.15.81:0/2985736541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1aa001a070 con 0x7f1aa8109e40 2024-09-21T02:59:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.766+0000 7f1aa6ffd640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a900b65a0 0x7f1a900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.767+0000 7f1aad8cd640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a900b65a0 0x7f1a900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.767+0000 7f1aa6ffd640 1 -- 172.21.15.81:0/2985736541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1aa00e7230 con 0x7f1aa8109e40 2024-09-21T02:59:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.767+0000 7f1aad8cd640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a900b65a0 0x7f1a900b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a98005fd0 tx=0x7f1a98009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.770+0000 7f1aa6ffd640 1 -- 172.21.15.81:0/2985736541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1aa0021070 con 0x7f1aa8109e40 2024-09-21T02:59:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.944+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1aa8063800 con 0x7f1a900b65a0 2024-09-21T02:59:07.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.950+0000 7f1aa6ffd640 1 -- 172.21.15.81:0/2985736541 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340609 (secure 0 0 0) 0x7f1aa8063800 con 0x7f1a900b65a0 2024-09-21T02:59:07.955 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:07.956 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a900b65a0 msgr2=0x7f1a900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a900b65a0 0x7f1a900b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a98005fd0 tx=0x7f1a98009500 comp rx=0 tx=0).stop 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa8109e40 msgr2=0x7f1aa819fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa8109e40 0x7f1aa819fc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000d950 tx=0x7f1aa000de10 comp rx=0 tx=0).stop 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 shutdown_connections 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a900b65a0 0x7f1a900b8ab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1aa81094f0 0x7f1aa819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aa8109e40 0x7f1aa819fc70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 --2- 172.21.15.81:0/2985736541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8103bb0 0x7f1aa819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:07.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 >> 172.21.15.81:0/2985736541 conn(0x7f1aa80ff600 msgr2=0x7f1aa8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:07.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 shutdown_connections 2024-09-21T02:59:07.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:07.953+0000 7f1aafb31640 1 -- 172.21.15.81:0/2985736541 wait complete. 2024-09-21T02:59:08.717 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-21T02:59:07.712382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655412,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":185,"num_read_kb":172,"num_write":282,"num_write_kb":2263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376884,"kb_used_data":10988,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564940,"statfs":{"total":1151940427776,"available":1151554498560,"internally_reserved":0,"allocated":11251712,"data_stored":7476318,"data_compressed":389853,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57592,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003344"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153188+0000","last_change":"2024-09-21T02:58:13.017321+0000","last_active":"2024-09-21T02:58:51.153188+0000","last_peered":"2024-09-21T02:58:51.153188+0000","last_clean":"2024-09-21T02:58:51.153188+0000","last_became_active":"2024-09-21T02:58:13.017017+0000","last_became_peered":"2024-09-21T02:58:13.017017+0000","last_unstale":"2024-09-21T02:58:51.153188+0000","last_undegraded":"2024-09-21T02:58:51.153188+0000","last_fullsized":"2024-09-21T02:58:51.153188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:11.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228749+0000","last_change":"2024-09-21T02:58:15.043883+0000","last_active":"2024-09-21T02:58:49.228749+0000","last_peered":"2024-09-21T02:58:49.228749+0000","last_clean":"2024-09-21T02:58:49.228749+0000","last_became_active":"2024-09-21T02:58:15.043551+0000","last_became_peered":"2024-09-21T02:58:15.043551+0000","last_unstale":"2024-09-21T02:58:49.228749+0000","last_undegraded":"2024-09-21T02:58:49.228749+0000","last_fullsized":"2024-09-21T02:58:49.228749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:40.867181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224252+0000","last_change":"2024-09-21T02:58:22.084562+0000","last_active":"2024-09-21T02:58:49.224252+0000","last_peered":"2024-09-21T02:58:49.224252+0000","last_clean":"2024-09-21T02:58:49.224252+0000","last_became_active":"2024-09-21T02:58:22.084145+0000","last_became_peered":"2024-09-21T02:58:22.084145+0000","last_unstale":"2024-09-21T02:58:49.224252+0000","last_undegraded":"2024-09-21T02:58:49.224252+0000","last_fullsized":"2024-09-21T02:58:49.224252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:56.402375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229202+0000","last_change":"2024-09-21T02:58:13.553479+0000","last_active":"2024-09-21T02:58:49.229202+0000","last_peered":"2024-09-21T02:58:49.229202+0000","last_clean":"2024-09-21T02:58:49.229202+0000","last_became_active":"2024-09-21T02:58:13.553117+0000","last_became_peered":"2024-09-21T02:58:13.553117+0000","last_unstale":"2024-09-21T02:58:49.229202+0000","last_undegraded":"2024-09-21T02:58:49.229202+0000","last_fullsized":"2024-09-21T02:58:49.229202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:34.301361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980234+0000","last_change":"2024-09-21T02:58:15.041724+0000","last_active":"2024-09-21T02:58:49.980234+0000","last_peered":"2024-09-21T02:58:49.980234+0000","last_clean":"2024-09-21T02:58:49.980234+0000","last_became_active":"2024-09-21T02:58:15.041355+0000","last_became_peered":"2024-09-21T02:58:15.041355+0000","last_unstale":"2024-09-21T02:58:49.980234+0000","last_undegraded":"2024-09-21T02:58:49.980234+0000","last_fullsized":"2024-09-21T02:58:49.980234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:19.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226270+0000","last_change":"2024-09-21T02:58:22.085004+0000","last_active":"2024-09-21T02:58:49.226270+0000","last_peered":"2024-09-21T02:58:49.226270+0000","last_clean":"2024-09-21T02:58:49.226270+0000","last_became_active":"2024-09-21T02:58:22.084622+0000","last_became_peered":"2024-09-21T02:58:22.084622+0000","last_unstale":"2024-09-21T02:58:49.226270+0000","last_undegraded":"2024-09-21T02:58:49.226270+0000","last_fullsized":"2024-09-21T02:58:49.226270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.303286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152223+0000","last_change":"2024-09-21T02:58:49.237002+0000","last_active":"2024-09-21T02:58:51.152223+0000","last_peered":"2024-09-21T02:58:51.152223+0000","last_clean":"2024-09-21T02:58:51.152223+0000","last_became_active":"2024-09-21T02:58:49.233219+0000","last_became_peered":"2024-09-21T02:58:49.233219+0000","last_unstale":"2024-09-21T02:58:51.152223+0000","last_undegraded":"2024-09-21T02:58:51.152223+0000","last_fullsized":"2024-09-21T02:58:51.152223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:38.409153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228358+0000","last_change":"2024-09-21T02:58:15.051658+0000","last_active":"2024-09-21T02:58:49.228358+0000","last_peered":"2024-09-21T02:58:49.228358+0000","last_clean":"2024-09-21T02:58:49.228358+0000","last_became_active":"2024-09-21T02:58:15.048345+0000","last_became_peered":"2024-09-21T02:58:15.048345+0000","last_unstale":"2024-09-21T02:58:49.228358+0000","last_undegraded":"2024-09-21T02:58:49.228358+0000","last_fullsized":"2024-09-21T02:58:49.228358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:36.069051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.750150+0000","last_change":"2024-09-21T02:58:49.750028+0000","last_active":"2024-09-21T02:58:49.750150+0000","last_peered":"2024-09-21T02:58:49.750150+0000","last_clean":"2024-09-21T02:58:49.750150+0000","last_became_active":"2024-09-21T02:58:49.749587+0000","last_became_peered":"2024-09-21T02:58:49.749587+0000","last_unstale":"2024-09-21T02:58:49.750150+0000","last_undegraded":"2024-09-21T02:58:49.750150+0000","last_fullsized":"2024-09-21T02:58:49.750150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:33.018490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230873+0000","last_change":"2024-09-21T02:58:13.020762+0000","last_active":"2024-09-21T02:58:49.230873+0000","last_peered":"2024-09-21T02:58:49.230873+0000","last_clean":"2024-09-21T02:58:49.230873+0000","last_became_active":"2024-09-21T02:58:13.020263+0000","last_became_peered":"2024-09-21T02:58:13.020263+0000","last_unstale":"2024-09-21T02:58:49.230873+0000","last_undegraded":"2024-09-21T02:58:49.230873+0000","last_fullsized":"2024-09-21T02:58:49.230873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:14.490179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748543+0000","last_change":"2024-09-21T02:58:15.048732+0000","last_active":"2024-09-21T02:58:49.748543+0000","last_peered":"2024-09-21T02:58:49.748543+0000","last_clean":"2024-09-21T02:58:49.748543+0000","last_became_active":"2024-09-21T02:58:15.048393+0000","last_became_peered":"2024-09-21T02:58:15.048393+0000","last_unstale":"2024-09-21T02:58:49.748543+0000","last_undegraded":"2024-09-21T02:58:49.748543+0000","last_fullsized":"2024-09-21T02:58:49.748543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:07.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225897+0000","last_change":"2024-09-21T02:58:22.087072+0000","last_active":"2024-09-21T02:58:49.225897+0000","last_peered":"2024-09-21T02:58:49.225897+0000","last_clean":"2024-09-21T02:58:49.225897+0000","last_became_active":"2024-09-21T02:58:22.086695+0000","last_became_peered":"2024-09-21T02:58:22.086695+0000","last_unstale":"2024-09-21T02:58:49.225897+0000","last_undegraded":"2024-09-21T02:58:49.225897+0000","last_fullsized":"2024-09-21T02:58:49.225897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:18.592656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230870+0000","last_change":"2024-09-21T02:58:15.043756+0000","last_active":"2024-09-21T02:58:49.230870+0000","last_peered":"2024-09-21T02:58:49.230870+0000","last_clean":"2024-09-21T02:58:49.230870+0000","last_became_active":"2024-09-21T02:58:15.043415+0000","last_became_peered":"2024-09-21T02:58:15.043415+0000","last_unstale":"2024-09-21T02:58:49.230870+0000","last_undegraded":"2024-09-21T02:58:49.230870+0000","last_fullsized":"2024-09-21T02:58:49.230870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:53.655906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147581+0000","last_change":"2024-09-21T02:58:13.017054+0000","last_active":"2024-09-21T02:58:50.147581+0000","last_peered":"2024-09-21T02:58:50.147581+0000","last_clean":"2024-09-21T02:58:50.147581+0000","last_became_active":"2024-09-21T02:58:13.016636+0000","last_became_peered":"2024-09-21T02:58:13.016636+0000","last_unstale":"2024-09-21T02:58:50.147581+0000","last_undegraded":"2024-09-21T02:58:50.147581+0000","last_fullsized":"2024-09-21T02:58:50.147581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:27.941501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226537+0000","last_change":"2024-09-21T02:58:22.229949+0000","last_active":"2024-09-21T02:58:49.226537+0000","last_peered":"2024-09-21T02:58:49.226537+0000","last_clean":"2024-09-21T02:58:49.226537+0000","last_became_active":"2024-09-21T02:58:22.229490+0000","last_became_peered":"2024-09-21T02:58:22.229490+0000","last_unstale":"2024-09-21T02:58:49.226537+0000","last_undegraded":"2024-09-21T02:58:49.226537+0000","last_fullsized":"2024-09-21T02:58:49.226537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:25.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228272+0000","last_change":"2024-09-21T02:58:15.040559+0000","last_active":"2024-09-21T02:58:49.228272+0000","last_peered":"2024-09-21T02:58:49.228272+0000","last_clean":"2024-09-21T02:58:49.228272+0000","last_became_active":"2024-09-21T02:58:15.040220+0000","last_became_peered":"2024-09-21T02:58:15.040220+0000","last_unstale":"2024-09-21T02:58:49.228272+0000","last_undegraded":"2024-09-21T02:58:49.228272+0000","last_fullsized":"2024-09-21T02:58:49.228272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:55.853966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224522+0000","last_change":"2024-09-21T02:58:13.017985+0000","last_active":"2024-09-21T02:58:49.224522+0000","last_peered":"2024-09-21T02:58:49.224522+0000","last_clean":"2024-09-21T02:58:49.224522+0000","last_became_active":"2024-09-21T02:58:13.017583+0000","last_became_peered":"2024-09-21T02:58:13.017583+0000","last_unstale":"2024-09-21T02:58:49.224522+0000","last_undegraded":"2024-09-21T02:58:49.224522+0000","last_fullsized":"2024-09-21T02:58:49.224522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.917960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226338+0000","last_change":"2024-09-21T02:58:22.077294+0000","last_active":"2024-09-21T02:58:49.226338+0000","last_peered":"2024-09-21T02:58:49.226338+0000","last_clean":"2024-09-21T02:58:49.226338+0000","last_became_active":"2024-09-21T02:58:22.076884+0000","last_became_peered":"2024-09-21T02:58:22.076884+0000","last_unstale":"2024-09-21T02:58:49.226338+0000","last_undegraded":"2024-09-21T02:58:49.226338+0000","last_fullsized":"2024-09-21T02:58:49.226338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:00.045383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226825+0000","last_change":"2024-09-21T02:58:15.045160+0000","last_active":"2024-09-21T02:58:49.226825+0000","last_peered":"2024-09-21T02:58:49.226825+0000","last_clean":"2024-09-21T02:58:49.226825+0000","last_became_active":"2024-09-21T02:58:15.044814+0000","last_became_peered":"2024-09-21T02:58:15.044814+0000","last_unstale":"2024-09-21T02:58:49.226825+0000","last_undegraded":"2024-09-21T02:58:49.226825+0000","last_fullsized":"2024-09-21T02:58:49.226825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:13.325320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146734+0000","last_change":"2024-09-21T02:58:13.011081+0000","last_active":"2024-09-21T02:58:50.146734+0000","last_peered":"2024-09-21T02:58:50.146734+0000","last_clean":"2024-09-21T02:58:50.146734+0000","last_became_active":"2024-09-21T02:58:13.010682+0000","last_became_peered":"2024-09-21T02:58:13.010682+0000","last_unstale":"2024-09-21T02:58:50.146734+0000","last_undegraded":"2024-09-21T02:58:50.146734+0000","last_fullsized":"2024-09-21T02:58:50.146734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224126+0000","last_change":"2024-09-21T02:58:22.083449+0000","last_active":"2024-09-21T02:58:49.224126+0000","last_peered":"2024-09-21T02:58:49.224126+0000","last_clean":"2024-09-21T02:58:49.224126+0000","last_became_active":"2024-09-21T02:58:22.082996+0000","last_became_peered":"2024-09-21T02:58:22.082996+0000","last_unstale":"2024-09-21T02:58:49.224126+0000","last_undegraded":"2024-09-21T02:58:49.224126+0000","last_fullsized":"2024-09-21T02:58:49.224126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:21.667824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230242+0000","last_change":"2024-09-21T02:58:15.039458+0000","last_active":"2024-09-21T02:58:49.230242+0000","last_peered":"2024-09-21T02:58:49.230242+0000","last_clean":"2024-09-21T02:58:49.230242+0000","last_became_active":"2024-09-21T02:58:15.039082+0000","last_became_peered":"2024-09-21T02:58:15.039082+0000","last_unstale":"2024-09-21T02:58:49.230242+0000","last_undegraded":"2024-09-21T02:58:49.230242+0000","last_fullsized":"2024-09-21T02:58:49.230242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:37.102212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147255+0000","last_change":"2024-09-21T02:58:49.982108+0000","last_active":"2024-09-21T02:58:50.147255+0000","last_peered":"2024-09-21T02:58:50.147255+0000","last_clean":"2024-09-21T02:58:50.147255+0000","last_became_active":"2024-09-21T02:58:49.981462+0000","last_became_peered":"2024-09-21T02:58:49.981462+0000","last_unstale":"2024-09-21T02:58:50.147255+0000","last_undegraded":"2024-09-21T02:58:50.147255+0000","last_fullsized":"2024-09-21T02:58:50.147255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:17.624627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226847+0000","last_change":"2024-09-21T02:58:22.231082+0000","last_active":"2024-09-21T02:58:49.226847+0000","last_peered":"2024-09-21T02:58:49.226847+0000","last_clean":"2024-09-21T02:58:49.226847+0000","last_became_active":"2024-09-21T02:58:22.229781+0000","last_became_peered":"2024-09-21T02:58:22.229781+0000","last_unstale":"2024-09-21T02:58:49.226847+0000","last_undegraded":"2024-09-21T02:58:49.226847+0000","last_fullsized":"2024-09-21T02:58:49.226847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:14.964809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980043+0000","last_change":"2024-09-21T02:58:15.033111+0000","last_active":"2024-09-21T02:58:49.980043+0000","last_peered":"2024-09-21T02:58:49.980043+0000","last_clean":"2024-09-21T02:58:49.980043+0000","last_became_active":"2024-09-21T02:58:15.032738+0000","last_became_peered":"2024-09-21T02:58:15.032738+0000","last_unstale":"2024-09-21T02:58:49.980043+0000","last_undegraded":"2024-09-21T02:58:49.980043+0000","last_fullsized":"2024-09-21T02:58:49.980043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:31.209451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147323+0000","last_change":"2024-09-21T02:58:13.229717+0000","last_active":"2024-09-21T02:58:50.147323+0000","last_peered":"2024-09-21T02:58:50.147323+0000","last_clean":"2024-09-21T02:58:50.147323+0000","last_became_active":"2024-09-21T02:58:13.229376+0000","last_became_peered":"2024-09-21T02:58:13.229376+0000","last_unstale":"2024-09-21T02:58:50.147323+0000","last_undegraded":"2024-09-21T02:58:50.147323+0000","last_fullsized":"2024-09-21T02:58:50.147323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:05.436044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224447+0000","last_change":"2024-09-21T02:58:22.081140+0000","last_active":"2024-09-21T02:58:49.224447+0000","last_peered":"2024-09-21T02:58:49.224447+0000","last_clean":"2024-09-21T02:58:49.224447+0000","last_became_active":"2024-09-21T02:58:22.080670+0000","last_became_peered":"2024-09-21T02:58:22.080670+0000","last_unstale":"2024-09-21T02:58:49.224447+0000","last_undegraded":"2024-09-21T02:58:49.224447+0000","last_fullsized":"2024-09-21T02:58:49.224447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:43.078241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228985+0000","last_change":"2024-09-21T02:58:15.035927+0000","last_active":"2024-09-21T02:58:49.228985+0000","last_peered":"2024-09-21T02:58:49.228985+0000","last_clean":"2024-09-21T02:58:49.228985+0000","last_became_active":"2024-09-21T02:58:15.035529+0000","last_became_peered":"2024-09-21T02:58:15.035529+0000","last_unstale":"2024-09-21T02:58:49.228985+0000","last_undegraded":"2024-09-21T02:58:49.228985+0000","last_fullsized":"2024-09-21T02:58:49.228985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:02.045723+0000","last_change":"2024-09-21T02:58:13.016489+0000","last_active":"2024-09-21T02:59:02.045723+0000","last_peered":"2024-09-21T02:59:02.045723+0000","last_clean":"2024-09-21T02:59:02.045723+0000","last_became_active":"2024-09-21T02:58:13.016176+0000","last_became_peered":"2024-09-21T02:58:13.016176+0000","last_unstale":"2024-09-21T02:59:02.045723+0000","last_undegraded":"2024-09-21T02:59:02.045723+0000","last_fullsized":"2024-09-21T02:59:02.045723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:54.908933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227852+0000","last_change":"2024-09-21T02:58:22.229868+0000","last_active":"2024-09-21T02:58:49.227852+0000","last_peered":"2024-09-21T02:58:49.227852+0000","last_clean":"2024-09-21T02:58:49.227852+0000","last_became_active":"2024-09-21T02:58:22.229318+0000","last_became_peered":"2024-09-21T02:58:22.229318+0000","last_unstale":"2024-09-21T02:58:49.227852+0000","last_undegraded":"2024-09-21T02:58:49.227852+0000","last_fullsized":"2024-09-21T02:58:49.227852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:06.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435282+0000","last_change":"2024-09-21T02:58:15.037953+0000","last_active":"2024-09-21T02:58:49.435282+0000","last_peered":"2024-09-21T02:58:49.435282+0000","last_clean":"2024-09-21T02:58:49.435282+0000","last_became_active":"2024-09-21T02:58:15.036934+0000","last_became_peered":"2024-09-21T02:58:15.036934+0000","last_unstale":"2024-09-21T02:58:49.435282+0000","last_undegraded":"2024-09-21T02:58:49.435282+0000","last_fullsized":"2024-09-21T02:58:49.435282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:35.118295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146197+0000","last_change":"2024-09-21T02:58:13.553861+0000","last_active":"2024-09-21T02:58:50.146197+0000","last_peered":"2024-09-21T02:58:50.146197+0000","last_clean":"2024-09-21T02:58:50.146197+0000","last_became_active":"2024-09-21T02:58:13.553016+0000","last_became_peered":"2024-09-21T02:58:13.553016+0000","last_unstale":"2024-09-21T02:58:50.146197+0000","last_undegraded":"2024-09-21T02:58:50.146197+0000","last_fullsized":"2024-09-21T02:58:50.146197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227008+0000","last_change":"2024-09-21T02:58:22.087306+0000","last_active":"2024-09-21T02:58:49.227008+0000","last_peered":"2024-09-21T02:58:49.227008+0000","last_clean":"2024-09-21T02:58:49.227008+0000","last_became_active":"2024-09-21T02:58:22.086800+0000","last_became_peered":"2024-09-21T02:58:22.086800+0000","last_unstale":"2024-09-21T02:58:49.227008+0000","last_undegraded":"2024-09-21T02:58:49.227008+0000","last_fullsized":"2024-09-21T02:58:49.227008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:28.652990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224469+0000","last_change":"2024-09-21T02:58:15.038383+0000","last_active":"2024-09-21T02:58:49.224469+0000","last_peered":"2024-09-21T02:58:49.224469+0000","last_clean":"2024-09-21T02:58:49.224469+0000","last_became_active":"2024-09-21T02:58:15.037878+0000","last_became_peered":"2024-09-21T02:58:15.037878+0000","last_unstale":"2024-09-21T02:58:49.224469+0000","last_undegraded":"2024-09-21T02:58:49.224469+0000","last_fullsized":"2024-09-21T02:58:49.224469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:14.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223874+0000","last_change":"2024-09-21T02:58:13.555218+0000","last_active":"2024-09-21T02:58:49.223874+0000","last_peered":"2024-09-21T02:58:49.223874+0000","last_clean":"2024-09-21T02:58:49.223874+0000","last_became_active":"2024-09-21T02:58:13.554831+0000","last_became_peered":"2024-09-21T02:58:13.554831+0000","last_unstale":"2024-09-21T02:58:49.223874+0000","last_undegraded":"2024-09-21T02:58:49.223874+0000","last_fullsized":"2024-09-21T02:58:49.223874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:32.659118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230124+0000","last_change":"2024-09-21T02:58:22.229673+0000","last_active":"2024-09-21T02:58:49.230124+0000","last_peered":"2024-09-21T02:58:49.230124+0000","last_clean":"2024-09-21T02:58:49.230124+0000","last_became_active":"2024-09-21T02:58:22.229034+0000","last_became_peered":"2024-09-21T02:58:22.229034+0000","last_unstale":"2024-09-21T02:58:49.230124+0000","last_undegraded":"2024-09-21T02:58:49.230124+0000","last_fullsized":"2024-09-21T02:58:49.230124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:26.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.981818+0000","last_change":"2024-09-21T02:58:49.981660+0000","last_active":"2024-09-21T02:58:49.981818+0000","last_peered":"2024-09-21T02:58:49.981818+0000","last_clean":"2024-09-21T02:58:49.981818+0000","last_became_active":"2024-09-21T02:58:49.980972+0000","last_became_peered":"2024-09-21T02:58:49.980972+0000","last_unstale":"2024-09-21T02:58:49.981818+0000","last_undegraded":"2024-09-21T02:58:49.981818+0000","last_fullsized":"2024-09-21T02:58:49.981818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:26.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231087+0000","last_change":"2024-09-21T02:58:13.012751+0000","last_active":"2024-09-21T02:58:49.231087+0000","last_peered":"2024-09-21T02:58:49.231087+0000","last_clean":"2024-09-21T02:58:49.231087+0000","last_became_active":"2024-09-21T02:58:13.012341+0000","last_became_peered":"2024-09-21T02:58:13.012341+0000","last_unstale":"2024-09-21T02:58:49.231087+0000","last_undegraded":"2024-09-21T02:58:49.231087+0000","last_fullsized":"2024-09-21T02:58:49.231087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435050+0000","last_change":"2024-09-21T02:58:22.084620+0000","last_active":"2024-09-21T02:58:49.435050+0000","last_peered":"2024-09-21T02:58:49.435050+0000","last_clean":"2024-09-21T02:58:49.435050+0000","last_became_active":"2024-09-21T02:58:22.083935+0000","last_became_peered":"2024-09-21T02:58:22.083935+0000","last_unstale":"2024-09-21T02:58:49.435050+0000","last_undegraded":"2024-09-21T02:58:49.435050+0000","last_fullsized":"2024-09-21T02:58:49.435050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:37.033928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748547+0000","last_change":"2024-09-21T02:58:15.046935+0000","last_active":"2024-09-21T02:58:49.748547+0000","last_peered":"2024-09-21T02:58:49.748547+0000","last_clean":"2024-09-21T02:58:49.748547+0000","last_became_active":"2024-09-21T02:58:15.046572+0000","last_became_peered":"2024-09-21T02:58:15.046572+0000","last_unstale":"2024-09-21T02:58:49.748547+0000","last_undegraded":"2024-09-21T02:58:49.748547+0000","last_fullsized":"2024-09-21T02:58:49.748547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.942643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:02.176753+0000","last_change":"2024-09-21T02:58:13.553337+0000","last_active":"2024-09-21T02:59:02.176753+0000","last_peered":"2024-09-21T02:59:02.176753+0000","last_clean":"2024-09-21T02:59:02.176753+0000","last_became_active":"2024-09-21T02:58:13.552873+0000","last_became_peered":"2024-09-21T02:58:13.552873+0000","last_unstale":"2024-09-21T02:59:02.176753+0000","last_undegraded":"2024-09-21T02:59:02.176753+0000","last_fullsized":"2024-09-21T02:59:02.176753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:42.800873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435228+0000","last_change":"2024-09-21T02:58:22.230102+0000","last_active":"2024-09-21T02:58:49.435228+0000","last_peered":"2024-09-21T02:58:49.435228+0000","last_clean":"2024-09-21T02:58:49.435228+0000","last_became_active":"2024-09-21T02:58:22.229643+0000","last_became_peered":"2024-09-21T02:58:22.229643+0000","last_unstale":"2024-09-21T02:58:49.435228+0000","last_undegraded":"2024-09-21T02:58:49.435228+0000","last_fullsized":"2024-09-21T02:58:49.435228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.396292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434776+0000","last_change":"2024-09-21T02:58:15.043484+0000","last_active":"2024-09-21T02:58:49.434776+0000","last_peered":"2024-09-21T02:58:49.434776+0000","last_clean":"2024-09-21T02:58:49.434776+0000","last_became_active":"2024-09-21T02:58:15.042663+0000","last_became_peered":"2024-09-21T02:58:15.042663+0000","last_unstale":"2024-09-21T02:58:49.434776+0000","last_undegraded":"2024-09-21T02:58:49.434776+0000","last_fullsized":"2024-09-21T02:58:49.434776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:42.937814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.151290+0000","last_change":"2024-09-21T02:58:13.018109+0000","last_active":"2024-09-21T02:58:51.151290+0000","last_peered":"2024-09-21T02:58:51.151290+0000","last_clean":"2024-09-21T02:58:51.151290+0000","last_became_active":"2024-09-21T02:58:13.017761+0000","last_became_peered":"2024-09-21T02:58:13.017761+0000","last_unstale":"2024-09-21T02:58:51.151290+0000","last_undegraded":"2024-09-21T02:58:51.151290+0000","last_fullsized":"2024-09-21T02:58:51.151290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:12.613051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748710+0000","last_change":"2024-09-21T02:58:22.230520+0000","last_active":"2024-09-21T02:58:49.748710+0000","last_peered":"2024-09-21T02:58:49.748710+0000","last_clean":"2024-09-21T02:58:49.748710+0000","last_became_active":"2024-09-21T02:58:22.229999+0000","last_became_peered":"2024-09-21T02:58:22.229999+0000","last_unstale":"2024-09-21T02:58:49.748710+0000","last_undegraded":"2024-09-21T02:58:49.748710+0000","last_fullsized":"2024-09-21T02:58:49.748710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:12.899892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228426+0000","last_change":"2024-09-21T02:58:15.040357+0000","last_active":"2024-09-21T02:58:49.228426+0000","last_peered":"2024-09-21T02:58:49.228426+0000","last_clean":"2024-09-21T02:58:49.228426+0000","last_became_active":"2024-09-21T02:58:15.040026+0000","last_became_peered":"2024-09-21T02:58:15.040026+0000","last_unstale":"2024-09-21T02:58:49.228426+0000","last_undegraded":"2024-09-21T02:58:49.228426+0000","last_fullsized":"2024-09-21T02:58:49.228426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.216541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.151538+0000","last_change":"2024-09-21T02:58:13.014816+0000","last_active":"2024-09-21T02:58:52.151538+0000","last_peered":"2024-09-21T02:58:52.151538+0000","last_clean":"2024-09-21T02:58:52.151538+0000","last_became_active":"2024-09-21T02:58:13.013918+0000","last_became_peered":"2024-09-21T02:58:13.013918+0000","last_unstale":"2024-09-21T02:58:52.151538+0000","last_undegraded":"2024-09-21T02:58:52.151538+0000","last_fullsized":"2024-09-21T02:58:52.151538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:20.892671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230715+0000","last_change":"2024-09-21T02:57:01.191389+0000","last_active":"2024-09-21T02:58:49.230715+0000","last_peered":"2024-09-21T02:58:49.230715+0000","last_clean":"2024-09-21T02:58:49.230715+0000","last_became_active":"2024-09-21T02:57:01.185686+0000","last_became_peered":"2024-09-21T02:57:01.185686+0000","last_unstale":"2024-09-21T02:58:49.230715+0000","last_undegraded":"2024-09-21T02:58:49.230715+0000","last_fullsized":"2024-09-21T02:58:49.230715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_clean_scrub_stamp":"2024-09-21T02:53:36.647024+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.275496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231134+0000","last_change":"2024-09-21T02:58:22.081891+0000","last_active":"2024-09-21T02:58:49.231134+0000","last_peered":"2024-09-21T02:58:49.231134+0000","last_clean":"2024-09-21T02:58:49.231134+0000","last_became_active":"2024-09-21T02:58:22.081435+0000","last_became_peered":"2024-09-21T02:58:22.081435+0000","last_unstale":"2024-09-21T02:58:49.231134+0000","last_undegraded":"2024-09-21T02:58:49.231134+0000","last_fullsized":"2024-09-21T02:58:49.231134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:51.161690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231223+0000","last_change":"2024-09-21T02:58:15.045013+0000","last_active":"2024-09-21T02:58:49.231223+0000","last_peered":"2024-09-21T02:58:49.231223+0000","last_clean":"2024-09-21T02:58:49.231223+0000","last_became_active":"2024-09-21T02:58:15.044650+0000","last_became_peered":"2024-09-21T02:58:15.044650+0000","last_unstale":"2024-09-21T02:58:49.231223+0000","last_undegraded":"2024-09-21T02:58:49.231223+0000","last_fullsized":"2024-09-21T02:58:49.231223+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:39.087982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153469+0000","last_change":"2024-09-21T02:58:13.553468+0000","last_active":"2024-09-21T02:58:51.153469+0000","last_peered":"2024-09-21T02:58:51.153469+0000","last_clean":"2024-09-21T02:58:51.153469+0000","last_became_active":"2024-09-21T02:58:13.552965+0000","last_became_peered":"2024-09-21T02:58:13.552965+0000","last_unstale":"2024-09-21T02:58:51.153469+0000","last_undegraded":"2024-09-21T02:58:51.153469+0000","last_fullsized":"2024-09-21T02:58:51.153469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:35.224581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227364+0000","last_change":"2024-09-21T02:58:22.086994+0000","last_active":"2024-09-21T02:58:49.227364+0000","last_peered":"2024-09-21T02:58:49.227364+0000","last_clean":"2024-09-21T02:58:49.227364+0000","last_became_active":"2024-09-21T02:58:22.086506+0000","last_became_peered":"2024-09-21T02:58:22.086506+0000","last_unstale":"2024-09-21T02:58:49.227364+0000","last_undegraded":"2024-09-21T02:58:49.227364+0000","last_fullsized":"2024-09-21T02:58:49.227364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:09.102495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230976+0000","last_change":"2024-09-21T02:58:15.040224+0000","last_active":"2024-09-21T02:58:49.230976+0000","last_peered":"2024-09-21T02:58:49.230976+0000","last_clean":"2024-09-21T02:58:49.230976+0000","last_became_active":"2024-09-21T02:58:15.039115+0000","last_became_peered":"2024-09-21T02:58:15.039115+0000","last_unstale":"2024-09-21T02:58:49.230976+0000","last_undegraded":"2024-09-21T02:58:49.230976+0000","last_fullsized":"2024-09-21T02:58:49.230976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:35.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748956+0000","last_change":"2024-09-21T02:58:13.021526+0000","last_active":"2024-09-21T02:58:49.748956+0000","last_peered":"2024-09-21T02:58:49.748956+0000","last_clean":"2024-09-21T02:58:49.748956+0000","last_became_active":"2024-09-21T02:58:13.020521+0000","last_became_peered":"2024-09-21T02:58:13.020521+0000","last_unstale":"2024-09-21T02:58:49.748956+0000","last_undegraded":"2024-09-21T02:58:49.748956+0000","last_fullsized":"2024-09-21T02:58:49.748956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:08.645141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980132+0000","last_change":"2024-09-21T02:58:22.077862+0000","last_active":"2024-09-21T02:58:49.980132+0000","last_peered":"2024-09-21T02:58:49.980132+0000","last_clean":"2024-09-21T02:58:49.980132+0000","last_became_active":"2024-09-21T02:58:22.077410+0000","last_became_peered":"2024-09-21T02:58:22.077410+0000","last_unstale":"2024-09-21T02:58:49.980132+0000","last_undegraded":"2024-09-21T02:58:49.980132+0000","last_fullsized":"2024-09-21T02:58:49.980132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:06.549842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231212+0000","last_change":"2024-09-21T02:58:15.037775+0000","last_active":"2024-09-21T02:58:49.231212+0000","last_peered":"2024-09-21T02:58:49.231212+0000","last_clean":"2024-09-21T02:58:49.231212+0000","last_became_active":"2024-09-21T02:58:15.037036+0000","last_became_peered":"2024-09-21T02:58:15.037036+0000","last_unstale":"2024-09-21T02:58:49.231212+0000","last_undegraded":"2024-09-21T02:58:49.231212+0000","last_fullsized":"2024-09-21T02:58:49.231212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:58.289785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435249+0000","last_change":"2024-09-21T02:58:13.015046+0000","last_active":"2024-09-21T02:58:49.435249+0000","last_peered":"2024-09-21T02:58:49.435249+0000","last_clean":"2024-09-21T02:58:49.435249+0000","last_became_active":"2024-09-21T02:58:13.014643+0000","last_became_peered":"2024-09-21T02:58:13.014643+0000","last_unstale":"2024-09-21T02:58:49.435249+0000","last_undegraded":"2024-09-21T02:58:49.435249+0000","last_fullsized":"2024-09-21T02:58:49.435249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:54.913187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.747869+0000","last_change":"2024-09-21T02:58:22.085805+0000","last_active":"2024-09-21T02:58:49.747869+0000","last_peered":"2024-09-21T02:58:49.747869+0000","last_clean":"2024-09-21T02:58:49.747869+0000","last_became_active":"2024-09-21T02:58:22.084752+0000","last_became_peered":"2024-09-21T02:58:22.084752+0000","last_unstale":"2024-09-21T02:58:49.747869+0000","last_undegraded":"2024-09-21T02:58:49.747869+0000","last_fullsized":"2024-09-21T02:58:49.747869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:39.357089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227424+0000","last_change":"2024-09-21T02:58:15.046643+0000","last_active":"2024-09-21T02:58:49.227424+0000","last_peered":"2024-09-21T02:58:49.227424+0000","last_clean":"2024-09-21T02:58:49.227424+0000","last_became_active":"2024-09-21T02:58:15.046278+0000","last_became_peered":"2024-09-21T02:58:15.046278+0000","last_unstale":"2024-09-21T02:58:49.227424+0000","last_undegraded":"2024-09-21T02:58:49.227424+0000","last_fullsized":"2024-09-21T02:58:49.227424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.648084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.147510+0000","last_change":"2024-09-21T02:58:13.022176+0000","last_active":"2024-09-21T02:58:52.147510+0000","last_peered":"2024-09-21T02:58:52.147510+0000","last_clean":"2024-09-21T02:58:52.147510+0000","last_became_active":"2024-09-21T02:58:13.020122+0000","last_became_peered":"2024-09-21T02:58:13.020122+0000","last_unstale":"2024-09-21T02:58:52.147510+0000","last_undegraded":"2024-09-21T02:58:52.147510+0000","last_fullsized":"2024-09-21T02:58:52.147510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:12.346056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748354+0000","last_change":"2024-09-21T02:58:22.084221+0000","last_active":"2024-09-21T02:58:49.748354+0000","last_peered":"2024-09-21T02:58:49.748354+0000","last_clean":"2024-09-21T02:58:49.748354+0000","last_became_active":"2024-09-21T02:58:22.083793+0000","last_became_peered":"2024-09-21T02:58:22.083793+0000","last_unstale":"2024-09-21T02:58:49.748354+0000","last_undegraded":"2024-09-21T02:58:49.748354+0000","last_fullsized":"2024-09-21T02:58:49.748354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:13.043641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233959+0000","last_change":"2024-09-21T02:58:49.233440+0000","last_active":"2024-09-21T02:58:49.233959+0000","last_peered":"2024-09-21T02:58:49.233959+0000","last_clean":"2024-09-21T02:58:49.233959+0000","last_became_active":"2024-09-21T02:58:49.232996+0000","last_became_peered":"2024-09-21T02:58:49.232996+0000","last_unstale":"2024-09-21T02:58:49.233959+0000","last_undegraded":"2024-09-21T02:58:49.233959+0000","last_fullsized":"2024-09-21T02:58:49.233959+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:13.181861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.154616+0000","last_change":"2024-09-21T02:58:13.553866+0000","last_active":"2024-09-21T02:58:51.154616+0000","last_peered":"2024-09-21T02:58:51.154616+0000","last_clean":"2024-09-21T02:58:51.154616+0000","last_became_active":"2024-09-21T02:58:13.553001+0000","last_became_peered":"2024-09-21T02:58:13.553001+0000","last_unstale":"2024-09-21T02:58:51.154616+0000","last_undegraded":"2024-09-21T02:58:51.154616+0000","last_fullsized":"2024-09-21T02:58:51.154616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:43.995773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435231+0000","last_change":"2024-09-21T02:58:22.090253+0000","last_active":"2024-09-21T02:58:49.435231+0000","last_peered":"2024-09-21T02:58:49.435231+0000","last_clean":"2024-09-21T02:58:49.435231+0000","last_became_active":"2024-09-21T02:58:22.089818+0000","last_became_peered":"2024-09-21T02:58:22.089818+0000","last_unstale":"2024-09-21T02:58:49.435231+0000","last_undegraded":"2024-09-21T02:58:49.435231+0000","last_fullsized":"2024-09-21T02:58:49.435231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:09.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230280+0000","last_change":"2024-09-21T02:58:15.042479+0000","last_active":"2024-09-21T02:58:49.230280+0000","last_peered":"2024-09-21T02:58:49.230280+0000","last_clean":"2024-09-21T02:58:49.230280+0000","last_became_active":"2024-09-21T02:58:15.042087+0000","last_became_peered":"2024-09-21T02:58:15.042087+0000","last_unstale":"2024-09-21T02:58:49.230280+0000","last_undegraded":"2024-09-21T02:58:49.230280+0000","last_fullsized":"2024-09-21T02:58:49.230280+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.427736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:05.200653+0000","last_change":"2024-09-21T02:58:13.012559+0000","last_active":"2024-09-21T02:59:05.200653+0000","last_peered":"2024-09-21T02:59:05.200653+0000","last_clean":"2024-09-21T02:59:05.200653+0000","last_became_active":"2024-09-21T02:58:13.011062+0000","last_became_peered":"2024-09-21T02:58:13.011062+0000","last_unstale":"2024-09-21T02:59:05.200653+0000","last_undegraded":"2024-09-21T02:59:05.200653+0000","last_fullsized":"2024-09-21T02:59:05.200653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:17.839898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224241+0000","last_change":"2024-09-21T02:58:22.081196+0000","last_active":"2024-09-21T02:58:49.224241+0000","last_peered":"2024-09-21T02:58:49.224241+0000","last_clean":"2024-09-21T02:58:49.224241+0000","last_became_active":"2024-09-21T02:58:22.080787+0000","last_became_peered":"2024-09-21T02:58:22.080787+0000","last_unstale":"2024-09-21T02:58:49.224241+0000","last_undegraded":"2024-09-21T02:58:49.224241+0000","last_fullsized":"2024-09-21T02:58:49.224241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.283112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230702+0000","last_change":"2024-09-21T02:58:15.046322+0000","last_active":"2024-09-21T02:58:49.230702+0000","last_peered":"2024-09-21T02:58:49.230702+0000","last_clean":"2024-09-21T02:58:49.230702+0000","last_became_active":"2024-09-21T02:58:15.045936+0000","last_became_peered":"2024-09-21T02:58:15.045936+0000","last_unstale":"2024-09-21T02:58:49.230702+0000","last_undegraded":"2024-09-21T02:58:49.230702+0000","last_fullsized":"2024-09-21T02:58:49.230702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:08.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145891+0000","last_change":"2024-09-21T02:58:13.022277+0000","last_active":"2024-09-21T02:58:50.145891+0000","last_peered":"2024-09-21T02:58:50.145891+0000","last_clean":"2024-09-21T02:58:50.145891+0000","last_became_active":"2024-09-21T02:58:13.021901+0000","last_became_peered":"2024-09-21T02:58:13.021901+0000","last_unstale":"2024-09-21T02:58:50.145891+0000","last_undegraded":"2024-09-21T02:58:50.145891+0000","last_fullsized":"2024-09-21T02:58:50.145891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:01.029435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226991+0000","last_change":"2024-09-21T02:58:22.088951+0000","last_active":"2024-09-21T02:58:49.226991+0000","last_peered":"2024-09-21T02:58:49.226991+0000","last_clean":"2024-09-21T02:58:49.226991+0000","last_became_active":"2024-09-21T02:58:22.088427+0000","last_became_peered":"2024-09-21T02:58:22.088427+0000","last_unstale":"2024-09-21T02:58:49.226991+0000","last_undegraded":"2024-09-21T02:58:49.226991+0000","last_fullsized":"2024-09-21T02:58:49.226991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:52.700517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434868+0000","last_change":"2024-09-21T02:58:15.038390+0000","last_active":"2024-09-21T02:58:49.434868+0000","last_peered":"2024-09-21T02:58:49.434868+0000","last_clean":"2024-09-21T02:58:49.434868+0000","last_became_active":"2024-09-21T02:58:15.037368+0000","last_became_peered":"2024-09-21T02:58:15.037368+0000","last_unstale":"2024-09-21T02:58:49.434868+0000","last_undegraded":"2024-09-21T02:58:49.434868+0000","last_fullsized":"2024-09-21T02:58:49.434868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:54.736444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152969+0000","last_change":"2024-09-21T02:58:13.013246+0000","last_active":"2024-09-21T02:58:51.152969+0000","last_peered":"2024-09-21T02:58:51.152969+0000","last_clean":"2024-09-21T02:58:51.152969+0000","last_became_active":"2024-09-21T02:58:13.012830+0000","last_became_peered":"2024-09-21T02:58:13.012830+0000","last_unstale":"2024-09-21T02:58:51.152969+0000","last_undegraded":"2024-09-21T02:58:51.152969+0000","last_fullsized":"2024-09-21T02:58:51.152969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:31.406565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748517+0000","last_change":"2024-09-21T02:58:22.086799+0000","last_active":"2024-09-21T02:58:49.748517+0000","last_peered":"2024-09-21T02:58:49.748517+0000","last_clean":"2024-09-21T02:58:49.748517+0000","last_became_active":"2024-09-21T02:58:22.086395+0000","last_became_peered":"2024-09-21T02:58:22.086395+0000","last_unstale":"2024-09-21T02:58:49.748517+0000","last_undegraded":"2024-09-21T02:58:49.748517+0000","last_fullsized":"2024-09-21T02:58:49.748517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:38.985072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230971+0000","last_change":"2024-09-21T02:58:15.037346+0000","last_active":"2024-09-21T02:58:49.230971+0000","last_peered":"2024-09-21T02:58:49.230971+0000","last_clean":"2024-09-21T02:58:49.230971+0000","last_became_active":"2024-09-21T02:58:15.036984+0000","last_became_peered":"2024-09-21T02:58:15.036984+0000","last_unstale":"2024-09-21T02:58:49.230971+0000","last_undegraded":"2024-09-21T02:58:49.230971+0000","last_fullsized":"2024-09-21T02:58:49.230971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:43.856844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":98,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:05.242896+0000","last_change":"2024-09-21T02:58:13.018287+0000","last_active":"2024-09-21T02:59:05.242896+0000","last_peered":"2024-09-21T02:59:05.242896+0000","last_clean":"2024-09-21T02:59:05.242896+0000","last_became_active":"2024-09-21T02:58:13.017908+0000","last_became_peered":"2024-09-21T02:58:13.017908+0000","last_unstale":"2024-09-21T02:59:05.242896+0000","last_undegraded":"2024-09-21T02:59:05.242896+0000","last_fullsized":"2024-09-21T02:59:05.242896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:30.422946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60809,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":63,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223420+0000","last_change":"2024-09-21T02:58:22.078106+0000","last_active":"2024-09-21T02:58:49.223420+0000","last_peered":"2024-09-21T02:58:49.223420+0000","last_clean":"2024-09-21T02:58:49.223420+0000","last_became_active":"2024-09-21T02:58:22.077675+0000","last_became_peered":"2024-09-21T02:58:22.077675+0000","last_unstale":"2024-09-21T02:58:49.223420+0000","last_undegraded":"2024-09-21T02:58:49.223420+0000","last_fullsized":"2024-09-21T02:58:49.223420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:08.965865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228496+0000","last_change":"2024-09-21T02:58:15.045911+0000","last_active":"2024-09-21T02:58:49.228496+0000","last_peered":"2024-09-21T02:58:49.228496+0000","last_clean":"2024-09-21T02:58:49.228496+0000","last_became_active":"2024-09-21T02:58:15.045506+0000","last_became_peered":"2024-09-21T02:58:15.045506+0000","last_unstale":"2024-09-21T02:58:49.228496+0000","last_undegraded":"2024-09-21T02:58:49.228496+0000","last_fullsized":"2024-09-21T02:58:49.228496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.982730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.144087+0000","last_change":"2024-09-21T02:58:13.555132+0000","last_active":"2024-09-21T02:58:50.144087+0000","last_peered":"2024-09-21T02:58:50.144087+0000","last_clean":"2024-09-21T02:58:50.144087+0000","last_became_active":"2024-09-21T02:58:13.554582+0000","last_became_peered":"2024-09-21T02:58:13.554582+0000","last_unstale":"2024-09-21T02:58:50.144087+0000","last_undegraded":"2024-09-21T02:58:50.144087+0000","last_fullsized":"2024-09-21T02:58:50.144087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:56.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.234599+0000","last_change":"2024-09-21T02:58:49.234443+0000","last_active":"2024-09-21T02:58:49.234599+0000","last_peered":"2024-09-21T02:58:49.234599+0000","last_clean":"2024-09-21T02:58:49.234599+0000","last_became_active":"2024-09-21T02:58:49.233758+0000","last_became_peered":"2024-09-21T02:58:49.233758+0000","last_unstale":"2024-09-21T02:58:49.234599+0000","last_undegraded":"2024-09-21T02:58:49.234599+0000","last_fullsized":"2024-09-21T02:58:49.234599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:06.821726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980321+0000","last_change":"2024-09-21T02:58:15.033598+0000","last_active":"2024-09-21T02:58:49.980321+0000","last_peered":"2024-09-21T02:58:49.980321+0000","last_clean":"2024-09-21T02:58:49.980321+0000","last_became_active":"2024-09-21T02:58:15.033268+0000","last_became_peered":"2024-09-21T02:58:15.033268+0000","last_unstale":"2024-09-21T02:58:49.980321+0000","last_undegraded":"2024-09-21T02:58:49.980321+0000","last_fullsized":"2024-09-21T02:58:49.980321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:25.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145942+0000","last_change":"2024-09-21T02:58:13.018159+0000","last_active":"2024-09-21T02:58:50.145942+0000","last_peered":"2024-09-21T02:58:50.145942+0000","last_clean":"2024-09-21T02:58:50.145942+0000","last_became_active":"2024-09-21T02:58:13.017263+0000","last_became_peered":"2024-09-21T02:58:13.017263+0000","last_unstale":"2024-09-21T02:58:50.145942+0000","last_undegraded":"2024-09-21T02:58:50.145942+0000","last_fullsized":"2024-09-21T02:58:50.145942+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:47.981435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.982319+0000","last_change":"2024-09-21T02:58:49.981593+0000","last_active":"2024-09-21T02:58:49.982319+0000","last_peered":"2024-09-21T02:58:49.982319+0000","last_clean":"2024-09-21T02:58:49.982319+0000","last_became_active":"2024-09-21T02:58:49.980890+0000","last_became_peered":"2024-09-21T02:58:49.980890+0000","last_unstale":"2024-09-21T02:58:49.982319+0000","last_undegraded":"2024-09-21T02:58:49.982319+0000","last_fullsized":"2024-09-21T02:58:49.982319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:59.251327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229390+0000","last_change":"2024-09-21T02:58:15.049561+0000","last_active":"2024-09-21T02:58:49.229390+0000","last_peered":"2024-09-21T02:58:49.229390+0000","last_clean":"2024-09-21T02:58:49.229390+0000","last_became_active":"2024-09-21T02:58:15.049205+0000","last_became_peered":"2024-09-21T02:58:15.049205+0000","last_unstale":"2024-09-21T02:58:49.229390+0000","last_undegraded":"2024-09-21T02:58:49.229390+0000","last_fullsized":"2024-09-21T02:58:49.229390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:56.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:04.173759+0000","last_change":"2024-09-21T02:58:13.018964+0000","last_active":"2024-09-21T02:59:04.173759+0000","last_peered":"2024-09-21T02:59:04.173759+0000","last_clean":"2024-09-21T02:59:04.173759+0000","last_became_active":"2024-09-21T02:58:13.017420+0000","last_became_peered":"2024-09-21T02:58:13.017420+0000","last_unstale":"2024-09-21T02:59:04.173759+0000","last_undegraded":"2024-09-21T02:59:04.173759+0000","last_fullsized":"2024-09-21T02:59:04.173759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233600+0000","last_change":"2024-09-21T02:58:49.233486+0000","last_active":"2024-09-21T02:58:49.233600+0000","last_peered":"2024-09-21T02:58:49.233600+0000","last_clean":"2024-09-21T02:58:49.233600+0000","last_became_active":"2024-09-21T02:58:49.232940+0000","last_became_peered":"2024-09-21T02:58:49.232940+0000","last_unstale":"2024-09-21T02:58:49.233600+0000","last_undegraded":"2024-09-21T02:58:49.233600+0000","last_fullsized":"2024-09-21T02:58:49.233600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:19.283141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979738+0000","last_change":"2024-09-21T02:58:22.085163+0000","last_active":"2024-09-21T02:58:49.979738+0000","last_peered":"2024-09-21T02:58:49.979738+0000","last_clean":"2024-09-21T02:58:49.979738+0000","last_became_active":"2024-09-21T02:58:22.084768+0000","last_became_peered":"2024-09-21T02:58:22.084768+0000","last_unstale":"2024-09-21T02:58:49.979738+0000","last_undegraded":"2024-09-21T02:58:49.979738+0000","last_fullsized":"2024-09-21T02:58:49.979738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:46.892421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223405+0000","last_change":"2024-09-21T02:58:15.035051+0000","last_active":"2024-09-21T02:58:49.223405+0000","last_peered":"2024-09-21T02:58:49.223405+0000","last_clean":"2024-09-21T02:58:49.223405+0000","last_became_active":"2024-09-21T02:58:15.034692+0000","last_became_peered":"2024-09-21T02:58:15.034692+0000","last_unstale":"2024-09-21T02:58:49.223405+0000","last_undegraded":"2024-09-21T02:58:49.223405+0000","last_fullsized":"2024-09-21T02:58:49.223405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:14.605154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748786+0000","last_change":"2024-09-21T02:58:13.018102+0000","last_active":"2024-09-21T02:58:49.748786+0000","last_peered":"2024-09-21T02:58:49.748786+0000","last_clean":"2024-09-21T02:58:49.748786+0000","last_became_active":"2024-09-21T02:58:13.017537+0000","last_became_peered":"2024-09-21T02:58:13.017537+0000","last_unstale":"2024-09-21T02:58:49.748786+0000","last_undegraded":"2024-09-21T02:58:49.748786+0000","last_fullsized":"2024-09-21T02:58:49.748786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:40.096326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227422+0000","last_change":"2024-09-21T02:58:22.084362+0000","last_active":"2024-09-21T02:58:49.227422+0000","last_peered":"2024-09-21T02:58:49.227422+0000","last_clean":"2024-09-21T02:58:49.227422+0000","last_became_active":"2024-09-21T02:58:22.083895+0000","last_became_peered":"2024-09-21T02:58:22.083895+0000","last_unstale":"2024-09-21T02:58:49.227422+0000","last_undegraded":"2024-09-21T02:58:49.227422+0000","last_fullsized":"2024-09-21T02:58:49.227422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:54.101588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227989+0000","last_change":"2024-09-21T02:58:15.034768+0000","last_active":"2024-09-21T02:58:49.227989+0000","last_peered":"2024-09-21T02:58:49.227989+0000","last_clean":"2024-09-21T02:58:49.227989+0000","last_became_active":"2024-09-21T02:58:15.034420+0000","last_became_peered":"2024-09-21T02:58:15.034420+0000","last_unstale":"2024-09-21T02:58:49.227989+0000","last_undegraded":"2024-09-21T02:58:49.227989+0000","last_fullsized":"2024-09-21T02:58:49.227989+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:25.750158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152269+0000","last_change":"2024-09-21T02:58:13.015026+0000","last_active":"2024-09-21T02:58:51.152269+0000","last_peered":"2024-09-21T02:58:51.152269+0000","last_clean":"2024-09-21T02:58:51.152269+0000","last_became_active":"2024-09-21T02:58:13.014668+0000","last_became_peered":"2024-09-21T02:58:13.014668+0000","last_unstale":"2024-09-21T02:58:51.152269+0000","last_undegraded":"2024-09-21T02:58:51.152269+0000","last_fullsized":"2024-09-21T02:58:51.152269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:20.117518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153234+0000","last_change":"2024-09-21T02:58:13.018044+0000","last_active":"2024-09-21T02:58:51.153234+0000","last_peered":"2024-09-21T02:58:51.153234+0000","last_clean":"2024-09-21T02:58:51.153234+0000","last_became_active":"2024-09-21T02:58:13.017628+0000","last_became_peered":"2024-09-21T02:58:13.017628+0000","last_unstale":"2024-09-21T02:58:51.153234+0000","last_undegraded":"2024-09-21T02:58:51.153234+0000","last_fullsized":"2024-09-21T02:58:51.153234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:38.749379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748507+0000","last_change":"2024-09-21T02:58:15.048160+0000","last_active":"2024-09-21T02:58:49.748507+0000","last_peered":"2024-09-21T02:58:49.748507+0000","last_clean":"2024-09-21T02:58:49.748507+0000","last_became_active":"2024-09-21T02:58:15.046371+0000","last_became_peered":"2024-09-21T02:58:15.046371+0000","last_unstale":"2024-09-21T02:58:49.748507+0000","last_undegraded":"2024-09-21T02:58:49.748507+0000","last_fullsized":"2024-09-21T02:58:49.748507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:49.386799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224497+0000","last_change":"2024-09-21T02:58:22.089918+0000","last_active":"2024-09-21T02:58:49.224497+0000","last_peered":"2024-09-21T02:58:49.224497+0000","last_clean":"2024-09-21T02:58:49.224497+0000","last_became_active":"2024-09-21T02:58:22.089457+0000","last_became_peered":"2024-09-21T02:58:22.089457+0000","last_unstale":"2024-09-21T02:58:49.224497+0000","last_undegraded":"2024-09-21T02:58:49.224497+0000","last_fullsized":"2024-09-21T02:58:49.224497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:28.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:05.176631+0000","last_change":"2024-09-21T02:58:13.021192+0000","last_active":"2024-09-21T02:59:05.176631+0000","last_peered":"2024-09-21T02:59:05.176631+0000","last_clean":"2024-09-21T02:59:05.176631+0000","last_became_active":"2024-09-21T02:58:13.020746+0000","last_became_peered":"2024-09-21T02:58:13.020746+0000","last_unstale":"2024-09-21T02:59:05.176631+0000","last_undegraded":"2024-09-21T02:59:05.176631+0000","last_fullsized":"2024-09-21T02:59:05.176631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:13.260225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230350+0000","last_change":"2024-09-21T02:58:15.038375+0000","last_active":"2024-09-21T02:58:49.230350+0000","last_peered":"2024-09-21T02:58:49.230350+0000","last_clean":"2024-09-21T02:58:49.230350+0000","last_became_active":"2024-09-21T02:58:15.038011+0000","last_became_peered":"2024-09-21T02:58:15.038011+0000","last_unstale":"2024-09-21T02:58:49.230350+0000","last_undegraded":"2024-09-21T02:58:49.230350+0000","last_fullsized":"2024-09-21T02:58:49.230350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:50.820554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224842+0000","last_change":"2024-09-21T02:58:22.088436+0000","last_active":"2024-09-21T02:58:49.224842+0000","last_peered":"2024-09-21T02:58:49.224842+0000","last_clean":"2024-09-21T02:58:49.224842+0000","last_became_active":"2024-09-21T02:58:22.087857+0000","last_became_peered":"2024-09-21T02:58:22.087857+0000","last_unstale":"2024-09-21T02:58:49.224842+0000","last_undegraded":"2024-09-21T02:58:49.224842+0000","last_fullsized":"2024-09-21T02:58:49.224842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:40.314833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226720+0000","last_change":"2024-09-21T02:58:15.041490+0000","last_active":"2024-09-21T02:58:49.226720+0000","last_peered":"2024-09-21T02:58:49.226720+0000","last_clean":"2024-09-21T02:58:49.226720+0000","last_became_active":"2024-09-21T02:58:15.041106+0000","last_became_peered":"2024-09-21T02:58:15.041106+0000","last_unstale":"2024-09-21T02:58:49.226720+0000","last_undegraded":"2024-09-21T02:58:49.226720+0000","last_fullsized":"2024-09-21T02:58:49.226720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:57.228254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224682+0000","last_change":"2024-09-21T02:58:15.041375+0000","last_active":"2024-09-21T02:58:49.224682+0000","last_peered":"2024-09-21T02:58:49.224682+0000","last_clean":"2024-09-21T02:58:49.224682+0000","last_became_active":"2024-09-21T02:58:15.041041+0000","last_became_peered":"2024-09-21T02:58:15.041041+0000","last_unstale":"2024-09-21T02:58:49.224682+0000","last_undegraded":"2024-09-21T02:58:49.224682+0000","last_fullsized":"2024-09-21T02:58:49.224682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:49.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224406+0000","last_change":"2024-09-21T02:58:15.036772+0000","last_active":"2024-09-21T02:58:49.224406+0000","last_peered":"2024-09-21T02:58:49.224406+0000","last_clean":"2024-09-21T02:58:49.224406+0000","last_became_active":"2024-09-21T02:58:15.036390+0000","last_became_peered":"2024-09-21T02:58:15.036390+0000","last_unstale":"2024-09-21T02:58:49.224406+0000","last_undegraded":"2024-09-21T02:58:49.224406+0000","last_fullsized":"2024-09-21T02:58:49.224406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:49.169184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980239+0000","last_change":"2024-09-21T02:58:15.035375+0000","last_active":"2024-09-21T02:58:49.980239+0000","last_peered":"2024-09-21T02:58:49.980239+0000","last_clean":"2024-09-21T02:58:49.980239+0000","last_became_active":"2024-09-21T02:58:15.035015+0000","last_became_peered":"2024-09-21T02:58:15.035015+0000","last_unstale":"2024-09-21T02:58:49.980239+0000","last_undegraded":"2024-09-21T02:58:49.980239+0000","last_fullsized":"2024-09-21T02:58:49.980239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:32.980690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435193+0000","last_change":"2024-09-21T02:58:15.046431+0000","last_active":"2024-09-21T02:58:49.435193+0000","last_peered":"2024-09-21T02:58:49.435193+0000","last_clean":"2024-09-21T02:58:49.435193+0000","last_became_active":"2024-09-21T02:58:15.046048+0000","last_became_peered":"2024-09-21T02:58:15.046048+0000","last_unstale":"2024-09-21T02:58:49.435193+0000","last_undegraded":"2024-09-21T02:58:49.435193+0000","last_fullsized":"2024-09-21T02:58:49.435193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:42.079020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227633+0000","last_change":"2024-09-21T02:58:15.043192+0000","last_active":"2024-09-21T02:58:49.227633+0000","last_peered":"2024-09-21T02:58:49.227633+0000","last_clean":"2024-09-21T02:58:49.227633+0000","last_became_active":"2024-09-21T02:58:15.042413+0000","last_became_peered":"2024-09-21T02:58:15.042413+0000","last_unstale":"2024-09-21T02:58:49.227633+0000","last_undegraded":"2024-09-21T02:58:49.227633+0000","last_fullsized":"2024-09-21T02:58:49.227633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:31.491311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225245+0000","last_change":"2024-09-21T02:58:15.040194+0000","last_active":"2024-09-21T02:58:49.225245+0000","last_peered":"2024-09-21T02:58:49.225245+0000","last_clean":"2024-09-21T02:58:49.225245+0000","last_became_active":"2024-09-21T02:58:15.039803+0000","last_became_peered":"2024-09-21T02:58:15.039803+0000","last_unstale":"2024-09-21T02:58:49.225245+0000","last_undegraded":"2024-09-21T02:58:49.225245+0000","last_fullsized":"2024-09-21T02:58:49.225245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:21.357004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228974+0000","last_change":"2024-09-21T02:58:15.043038+0000","last_active":"2024-09-21T02:58:49.228974+0000","last_peered":"2024-09-21T02:58:49.228974+0000","last_clean":"2024-09-21T02:58:49.228974+0000","last_became_active":"2024-09-21T02:58:15.042643+0000","last_became_peered":"2024-09-21T02:58:15.042643+0000","last_unstale":"2024-09-21T02:58:49.228974+0000","last_undegraded":"2024-09-21T02:58:49.228974+0000","last_fullsized":"2024-09-21T02:58:49.228974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:14.639995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748116+0000","last_change":"2024-09-21T02:58:15.037015+0000","last_active":"2024-09-21T02:58:49.748116+0000","last_peered":"2024-09-21T02:58:49.748116+0000","last_clean":"2024-09-21T02:58:49.748116+0000","last_became_active":"2024-09-21T02:58:15.036628+0000","last_became_peered":"2024-09-21T02:58:15.036628+0000","last_unstale":"2024-09-21T02:58:49.748116+0000","last_undegraded":"2024-09-21T02:58:49.748116+0000","last_fullsized":"2024-09-21T02:58:49.748116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:07.823178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228334+0000","last_change":"2024-09-21T02:58:15.041768+0000","last_active":"2024-09-21T02:58:49.228334+0000","last_peered":"2024-09-21T02:58:49.228334+0000","last_clean":"2024-09-21T02:58:49.228334+0000","last_became_active":"2024-09-21T02:58:15.041374+0000","last_became_peered":"2024-09-21T02:58:15.041374+0000","last_unstale":"2024-09-21T02:58:49.228334+0000","last_undegraded":"2024-09-21T02:58:49.228334+0000","last_fullsized":"2024-09-21T02:58:49.228334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:25.145949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227754+0000","last_change":"2024-09-21T02:58:15.047263+0000","last_active":"2024-09-21T02:58:49.227754+0000","last_peered":"2024-09-21T02:58:49.227754+0000","last_clean":"2024-09-21T02:58:49.227754+0000","last_became_active":"2024-09-21T02:58:15.046490+0000","last_became_peered":"2024-09-21T02:58:15.046490+0000","last_unstale":"2024-09-21T02:58:49.227754+0000","last_undegraded":"2024-09-21T02:58:49.227754+0000","last_fullsized":"2024-09-21T02:58:49.227754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:45.413510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435084+0000","last_change":"2024-09-21T02:58:15.034115+0000","last_active":"2024-09-21T02:58:49.435084+0000","last_peered":"2024-09-21T02:58:49.435084+0000","last_clean":"2024-09-21T02:58:49.435084+0000","last_became_active":"2024-09-21T02:58:15.033709+0000","last_became_peered":"2024-09-21T02:58:15.033709+0000","last_unstale":"2024-09-21T02:58:49.435084+0000","last_undegraded":"2024-09-21T02:58:49.435084+0000","last_fullsized":"2024-09-21T02:58:49.435084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:54.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227143+0000","last_change":"2024-09-21T02:58:15.047154+0000","last_active":"2024-09-21T02:58:49.227143+0000","last_peered":"2024-09-21T02:58:49.227143+0000","last_clean":"2024-09-21T02:58:49.227143+0000","last_became_active":"2024-09-21T02:58:15.046777+0000","last_became_peered":"2024-09-21T02:58:15.046777+0000","last_unstale":"2024-09-21T02:58:49.227143+0000","last_undegraded":"2024-09-21T02:58:49.227143+0000","last_fullsized":"2024-09-21T02:58:49.227143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:56.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225136+0000","last_change":"2024-09-21T02:58:15.036867+0000","last_active":"2024-09-21T02:58:49.225136+0000","last_peered":"2024-09-21T02:58:49.225136+0000","last_clean":"2024-09-21T02:58:49.225136+0000","last_became_active":"2024-09-21T02:58:15.036228+0000","last_became_peered":"2024-09-21T02:58:15.036228+0000","last_unstale":"2024-09-21T02:58:49.225136+0000","last_undegraded":"2024-09-21T02:58:49.225136+0000","last_fullsized":"2024-09-21T02:58:49.225136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:11.245917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224017+0000","last_change":"2024-09-21T02:58:15.037311+0000","last_active":"2024-09-21T02:58:49.224017+0000","last_peered":"2024-09-21T02:58:49.224017+0000","last_clean":"2024-09-21T02:58:49.224017+0000","last_became_active":"2024-09-21T02:58:15.036909+0000","last_became_peered":"2024-09-21T02:58:15.036909+0000","last_unstale":"2024-09-21T02:58:49.224017+0000","last_undegraded":"2024-09-21T02:58:49.224017+0000","last_fullsized":"2024-09-21T02:58:49.224017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:35.250000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227739+0000","last_change":"2024-09-21T02:58:15.042678+0000","last_active":"2024-09-21T02:58:49.227739+0000","last_peered":"2024-09-21T02:58:49.227739+0000","last_clean":"2024-09-21T02:58:49.227739+0000","last_became_active":"2024-09-21T02:58:15.042334+0000","last_became_peered":"2024-09-21T02:58:15.042334+0000","last_unstale":"2024-09-21T02:58:49.227739+0000","last_undegraded":"2024-09-21T02:58:49.227739+0000","last_fullsized":"2024-09-21T02:58:49.227739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:09.302354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227472+0000","last_change":"2024-09-21T02:58:15.040741+0000","last_active":"2024-09-21T02:58:49.227472+0000","last_peered":"2024-09-21T02:58:49.227472+0000","last_clean":"2024-09-21T02:58:49.227472+0000","last_became_active":"2024-09-21T02:58:15.040357+0000","last_became_peered":"2024-09-21T02:58:15.040357+0000","last_unstale":"2024-09-21T02:58:49.227472+0000","last_undegraded":"2024-09-21T02:58:49.227472+0000","last_fullsized":"2024-09-21T02:58:49.227472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979623+0000","last_change":"2024-09-21T02:58:15.029780+0000","last_active":"2024-09-21T02:58:49.979623+0000","last_peered":"2024-09-21T02:58:49.979623+0000","last_clean":"2024-09-21T02:58:49.979623+0000","last_became_active":"2024-09-21T02:58:15.029259+0000","last_became_peered":"2024-09-21T02:58:15.029259+0000","last_unstale":"2024-09-21T02:58:49.979623+0000","last_undegraded":"2024-09-21T02:58:49.979623+0000","last_fullsized":"2024-09-21T02:58:49.979623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:35.683337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979618+0000","last_change":"2024-09-21T02:58:15.040557+0000","last_active":"2024-09-21T02:58:49.979618+0000","last_peered":"2024-09-21T02:58:49.979618+0000","last_clean":"2024-09-21T02:58:49.979618+0000","last_became_active":"2024-09-21T02:58:15.040178+0000","last_became_peered":"2024-09-21T02:58:15.040178+0000","last_unstale":"2024-09-21T02:58:49.979618+0000","last_undegraded":"2024-09-21T02:58:49.979618+0000","last_fullsized":"2024-09-21T02:58:49.979618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:50.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435020+0000","last_change":"2024-09-21T02:58:15.041717+0000","last_active":"2024-09-21T02:58:49.435020+0000","last_peered":"2024-09-21T02:58:49.435020+0000","last_clean":"2024-09-21T02:58:49.435020+0000","last_became_active":"2024-09-21T02:58:15.041375+0000","last_became_peered":"2024-09-21T02:58:15.041375+0000","last_unstale":"2024-09-21T02:58:49.435020+0000","last_undegraded":"2024-09-21T02:58:49.435020+0000","last_fullsized":"2024-09-21T02:58:49.435020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:22.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226572+0000","last_change":"2024-09-21T02:58:15.042001+0000","last_active":"2024-09-21T02:58:49.226572+0000","last_peered":"2024-09-21T02:58:49.226572+0000","last_clean":"2024-09-21T02:58:49.226572+0000","last_became_active":"2024-09-21T02:58:15.038585+0000","last_became_peered":"2024-09-21T02:58:15.038585+0000","last_unstale":"2024-09-21T02:58:49.226572+0000","last_undegraded":"2024-09-21T02:58:49.226572+0000","last_fullsized":"2024-09-21T02:58:49.226572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231199+0000","last_change":"2024-09-21T02:58:15.046636+0000","last_active":"2024-09-21T02:58:49.231199+0000","last_peered":"2024-09-21T02:58:49.231199+0000","last_clean":"2024-09-21T02:58:49.231199+0000","last_became_active":"2024-09-21T02:58:15.046103+0000","last_became_peered":"2024-09-21T02:58:15.046103+0000","last_unstale":"2024-09-21T02:58:49.231199+0000","last_undegraded":"2024-09-21T02:58:49.231199+0000","last_fullsized":"2024-09-21T02:58:49.231199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.579641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225214+0000","last_change":"2024-09-21T02:58:15.045461+0000","last_active":"2024-09-21T02:58:49.225214+0000","last_peered":"2024-09-21T02:58:49.225214+0000","last_clean":"2024-09-21T02:58:49.225214+0000","last_became_active":"2024-09-21T02:58:15.045091+0000","last_became_peered":"2024-09-21T02:58:15.045091+0000","last_unstale":"2024-09-21T02:58:49.225214+0000","last_undegraded":"2024-09-21T02:58:49.225214+0000","last_fullsized":"2024-09-21T02:58:49.225214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:33.078860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229199+0000","last_change":"2024-09-21T02:58:15.042454+0000","last_active":"2024-09-21T02:58:49.229199+0000","last_peered":"2024-09-21T02:58:49.229199+0000","last_clean":"2024-09-21T02:58:49.229199+0000","last_became_active":"2024-09-21T02:58:15.042071+0000","last_became_peered":"2024-09-21T02:58:15.042071+0000","last_unstale":"2024-09-21T02:58:49.229199+0000","last_undegraded":"2024-09-21T02:58:49.229199+0000","last_fullsized":"2024-09-21T02:58:49.229199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:09.798110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227985+0000","last_change":"2024-09-21T02:58:15.039238+0000","last_active":"2024-09-21T02:58:49.227985+0000","last_peered":"2024-09-21T02:58:49.227985+0000","last_clean":"2024-09-21T02:58:49.227985+0000","last_became_active":"2024-09-21T02:58:15.037883+0000","last_became_peered":"2024-09-21T02:58:15.037883+0000","last_unstale":"2024-09-21T02:58:49.227985+0000","last_undegraded":"2024-09-21T02:58:49.227985+0000","last_fullsized":"2024-09-21T02:58:49.227985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:13.418696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230871+0000","last_change":"2024-09-21T02:58:15.040236+0000","last_active":"2024-09-21T02:58:49.230871+0000","last_peered":"2024-09-21T02:58:49.230871+0000","last_clean":"2024-09-21T02:58:49.230871+0000","last_became_active":"2024-09-21T02:58:15.039895+0000","last_became_peered":"2024-09-21T02:58:15.039895+0000","last_unstale":"2024-09-21T02:58:49.230871+0000","last_undegraded":"2024-09-21T02:58:49.230871+0000","last_fullsized":"2024-09-21T02:58:49.230871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:48.099127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224435+0000","last_change":"2024-09-21T02:58:15.044804+0000","last_active":"2024-09-21T02:58:49.224435+0000","last_peered":"2024-09-21T02:58:49.224435+0000","last_clean":"2024-09-21T02:58:49.224435+0000","last_became_active":"2024-09-21T02:58:15.044446+0000","last_became_peered":"2024-09-21T02:58:15.044446+0000","last_unstale":"2024-09-21T02:58:49.224435+0000","last_undegraded":"2024-09-21T02:58:49.224435+0000","last_fullsized":"2024-09-21T02:58:49.224435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:37.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230509+0000","last_change":"2024-09-21T02:58:15.034219+0000","last_active":"2024-09-21T02:58:49.230509+0000","last_peered":"2024-09-21T02:58:49.230509+0000","last_clean":"2024-09-21T02:58:49.230509+0000","last_became_active":"2024-09-21T02:58:15.033775+0000","last_became_peered":"2024-09-21T02:58:15.033775+0000","last_unstale":"2024-09-21T02:58:49.230509+0000","last_undegraded":"2024-09-21T02:58:49.230509+0000","last_fullsized":"2024-09-21T02:58:49.230509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:12.534737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231688+0000","last_change":"2024-09-21T02:58:49.231259+0000","last_active":"2024-09-21T02:58:49.231688+0000","last_peered":"2024-09-21T02:58:49.231688+0000","last_clean":"2024-09-21T02:58:49.231688+0000","last_became_active":"2024-09-21T02:58:49.230867+0000","last_became_peered":"2024-09-21T02:58:49.230867+0000","last_unstale":"2024-09-21T02:58:49.231688+0000","last_undegraded":"2024-09-21T02:58:49.231688+0000","last_fullsized":"2024-09-21T02:58:49.231688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:11.163458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979870+0000","last_change":"2024-09-21T02:58:15.037273+0000","last_active":"2024-09-21T02:58:49.979870+0000","last_peered":"2024-09-21T02:58:49.979870+0000","last_clean":"2024-09-21T02:58:49.979870+0000","last_became_active":"2024-09-21T02:58:15.036879+0000","last_became_peered":"2024-09-21T02:58:15.036879+0000","last_unstale":"2024-09-21T02:58:49.979870+0000","last_undegraded":"2024-09-21T02:58:49.979870+0000","last_fullsized":"2024-09-21T02:58:49.979870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:50.721998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980003+0000","last_change":"2024-09-21T02:58:15.035716+0000","last_active":"2024-09-21T02:58:49.980003+0000","last_peered":"2024-09-21T02:58:49.980003+0000","last_clean":"2024-09-21T02:58:49.980003+0000","last_became_active":"2024-09-21T02:58:15.035356+0000","last_became_peered":"2024-09-21T02:58:15.035356+0000","last_unstale":"2024-09-21T02:58:49.980003+0000","last_undegraded":"2024-09-21T02:58:49.980003+0000","last_fullsized":"2024-09-21T02:58:49.980003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227675+0000","last_change":"2024-09-21T02:58:15.041737+0000","last_active":"2024-09-21T02:58:49.227675+0000","last_peered":"2024-09-21T02:58:49.227675+0000","last_clean":"2024-09-21T02:58:49.227675+0000","last_became_active":"2024-09-21T02:58:15.041387+0000","last_became_peered":"2024-09-21T02:58:15.041387+0000","last_unstale":"2024-09-21T02:58:49.227675+0000","last_undegraded":"2024-09-21T02:58:49.227675+0000","last_fullsized":"2024-09-21T02:58:49.227675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.893510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64810,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":157,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281500,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":462290,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972380,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":1110758,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":466622,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332134,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":462446,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495659,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1058355,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":457702,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855413,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":1053552,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":462743,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215167,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":457896,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":506443,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":518421,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":459090,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:59:08.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:59:08.968 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:09.327 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:09 smithi081 ceph-mon[30991]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 KiB/s wr, 9 op/s 2024-09-21T02:59:09.327 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:09 smithi081 ceph-mon[30991]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 -- 172.21.15.81:0/1699955327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc10de70 msgr2=0x7fe8fc110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 --2- 172.21.15.81:0/1699955327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc10de70 0x7fe8fc110340 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009ca0 tx=0x7fe8f402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 -- 172.21.15.81:0/1699955327 shutdown_connections 2024-09-21T02:59:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 --2- 172.21.15.81:0/1699955327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc10de70 0x7fe8fc110340 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 --2- 172.21.15.81:0/1699955327 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8fc1052a0 0x7fe8fc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 --2- 172.21.15.81:0/1699955327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc1048c0 0x7fe8fc104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 -- 172.21.15.81:0/1699955327 >> 172.21.15.81:0/1699955327 conn(0x7fe8fc079760 msgr2=0x7fe8fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.468+0000 7fe900e4f640 1 -- 172.21.15.81:0/1699955327 shutdown_connections 2024-09-21T02:59:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.469+0000 7fe900e4f640 1 -- 172.21.15.81:0/1699955327 wait complete. 2024-09-21T02:59:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.469+0000 7fe900e4f640 1 Processor -- start 2024-09-21T02:59:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.469+0000 7fe900e4f640 1 -- start start 2024-09-21T02:59:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe900e4f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8fc1048c0 0x7fe8fc19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe900e4f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc1052a0 0x7fe8fc19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe900e4f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc10de70 0x7fe8fc19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe900e4f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc1139d0 con 0x7fe8fc1052a0 2024-09-21T02:59:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe900e4f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc113850 con 0x7fe8fc1048c0 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe900e4f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc113b50 con 0x7fe8fc10de70 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc1052a0 0x7fe8fc19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc1052a0 0x7fe8fc19a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57256/0 (socket says 172.21.15.81:57256) 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 -- 172.21.15.81:0/517367979 learned_addr learned my addr 172.21.15.81:0/517367979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8fa59c640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8fc1048c0 0x7fe8fc19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8fad9d640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc10de70 0x7fe8fc19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 -- 172.21.15.81:0/517367979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc10de70 msgr2=0x7fe8fc19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc10de70 0x7fe8fc19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 -- 172.21.15.81:0/517367979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8fc1048c0 msgr2=0x7fe8fc19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8fc1048c0 0x7fe8fc19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8f9d9b640 1 -- 172.21.15.81:0/517367979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc1a02d0 con 0x7fe8fc1052a0 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.470+0000 7fe8fad9d640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc10de70 0x7fe8fc19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.471+0000 7fe8f9d9b640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc1052a0 0x7fe8fc19a900 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400d740 tx=0x7fe8e400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.471+0000 7fe8f37fe640 1 -- 172.21.15.81:0/517367979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4017070 con 0x7fe8fc1052a0 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.471+0000 7fe8f37fe640 1 -- 172.21.15.81:0/517367979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8e400de50 con 0x7fe8fc1052a0 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.471+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc1a05c0 con 0x7fe8fc1052a0 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.471+0000 7fe8f37fe640 1 -- 172.21.15.81:0/517367979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400f620 con 0x7fe8fc1052a0 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.471+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc1a6d20 con 0x7fe8fc1052a0 2024-09-21T02:59:09.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.472+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc104cd0 con 0x7fe8fc1052a0 2024-09-21T02:59:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.474+0000 7fe8f37fe640 1 -- 172.21.15.81:0/517367979 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe8e401a070 con 0x7fe8fc1052a0 2024-09-21T02:59:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.476+0000 7fe8f37fe640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8e80b65a0 0x7fe8e80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.476+0000 7fe8fa59c640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8e80b65a0 0x7fe8e80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.476+0000 7fe8f37fe640 1 -- 172.21.15.81:0/517367979 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe8e40e7200 con 0x7fe8fc1052a0 2024-09-21T02:59:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.476+0000 7fe8fa59c640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8e80b65a0 0x7fe8e80b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec005fd0 tx=0x7fe8ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:09.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.480+0000 7fe8f37fe640 1 -- 172.21.15.81:0/517367979 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8e40ad5f0 con 0x7fe8fc1052a0 2024-09-21T02:59:09.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.669+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8fc063800 con 0x7fe8e80b65a0 2024-09-21T02:59:09.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.675+0000 7fe8f37fe640 1 -- 172.21.15.81:0/517367979 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340609 (secure 0 0 0) 0x7fe8fc063800 con 0x7fe8e80b65a0 2024-09-21T02:59:09.680 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:09.681 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T02:59:09.683 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:09 smithi164 ceph-mon[34236]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 KiB/s wr, 9 op/s 2024-09-21T02:59:09.684 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:09 smithi164 ceph-mon[34236]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8e80b65a0 msgr2=0x7fe8e80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8e80b65a0 0x7fe8e80b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec005fd0 tx=0x7fe8ec00b390 comp rx=0 tx=0).stop 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc1052a0 msgr2=0x7fe8fc19a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc1052a0 0x7fe8fc19a900 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400d740 tx=0x7fe8e400dc00 comp rx=0 tx=0).stop 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 shutdown_connections 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe8e80b65a0 0x7fe8e80b8ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe8fc10de70 0x7fe8fc19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8fc1052a0 0x7fe8fc19a900 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 --2- 172.21.15.81:0/517367979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8fc1048c0 0x7fe8fc19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 >> 172.21.15.81:0/517367979 conn(0x7fe8fc079760 msgr2=0x7fe8fc100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:09.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 shutdown_connections 2024-09-21T02:59:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:09.679+0000 7fe900e4f640 1 -- 172.21.15.81:0/517367979 wait complete. 2024-09-21T02:59:09.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:09 smithi181 ceph-mon[34096]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 KiB/s wr, 9 op/s 2024-09-21T02:59:09.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:09 smithi181 ceph-mon[34096]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:10.313 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:10 smithi081 ceph-mon[30991]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:10.420 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-21T02:59:07.712382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655412,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":185,"num_read_kb":172,"num_write":282,"num_write_kb":2263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376884,"kb_used_data":10988,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564940,"statfs":{"total":1151940427776,"available":1151554498560,"internally_reserved":0,"allocated":11251712,"data_stored":7476318,"data_compressed":389853,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57592,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003344"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153188+0000","last_change":"2024-09-21T02:58:13.017321+0000","last_active":"2024-09-21T02:58:51.153188+0000","last_peered":"2024-09-21T02:58:51.153188+0000","last_clean":"2024-09-21T02:58:51.153188+0000","last_became_active":"2024-09-21T02:58:13.017017+0000","last_became_peered":"2024-09-21T02:58:13.017017+0000","last_unstale":"2024-09-21T02:58:51.153188+0000","last_undegraded":"2024-09-21T02:58:51.153188+0000","last_fullsized":"2024-09-21T02:58:51.153188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:11.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228749+0000","last_change":"2024-09-21T02:58:15.043883+0000","last_active":"2024-09-21T02:58:49.228749+0000","last_peered":"2024-09-21T02:58:49.228749+0000","last_clean":"2024-09-21T02:58:49.228749+0000","last_became_active":"2024-09-21T02:58:15.043551+0000","last_became_peered":"2024-09-21T02:58:15.043551+0000","last_unstale":"2024-09-21T02:58:49.228749+0000","last_undegraded":"2024-09-21T02:58:49.228749+0000","last_fullsized":"2024-09-21T02:58:49.228749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:40.867181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224252+0000","last_change":"2024-09-21T02:58:22.084562+0000","last_active":"2024-09-21T02:58:49.224252+0000","last_peered":"2024-09-21T02:58:49.224252+0000","last_clean":"2024-09-21T02:58:49.224252+0000","last_became_active":"2024-09-21T02:58:22.084145+0000","last_became_peered":"2024-09-21T02:58:22.084145+0000","last_unstale":"2024-09-21T02:58:49.224252+0000","last_undegraded":"2024-09-21T02:58:49.224252+0000","last_fullsized":"2024-09-21T02:58:49.224252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:56.402375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229202+0000","last_change":"2024-09-21T02:58:13.553479+0000","last_active":"2024-09-21T02:58:49.229202+0000","last_peered":"2024-09-21T02:58:49.229202+0000","last_clean":"2024-09-21T02:58:49.229202+0000","last_became_active":"2024-09-21T02:58:13.553117+0000","last_became_peered":"2024-09-21T02:58:13.553117+0000","last_unstale":"2024-09-21T02:58:49.229202+0000","last_undegraded":"2024-09-21T02:58:49.229202+0000","last_fullsized":"2024-09-21T02:58:49.229202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:34.301361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980234+0000","last_change":"2024-09-21T02:58:15.041724+0000","last_active":"2024-09-21T02:58:49.980234+0000","last_peered":"2024-09-21T02:58:49.980234+0000","last_clean":"2024-09-21T02:58:49.980234+0000","last_became_active":"2024-09-21T02:58:15.041355+0000","last_became_peered":"2024-09-21T02:58:15.041355+0000","last_unstale":"2024-09-21T02:58:49.980234+0000","last_undegraded":"2024-09-21T02:58:49.980234+0000","last_fullsized":"2024-09-21T02:58:49.980234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:19.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226270+0000","last_change":"2024-09-21T02:58:22.085004+0000","last_active":"2024-09-21T02:58:49.226270+0000","last_peered":"2024-09-21T02:58:49.226270+0000","last_clean":"2024-09-21T02:58:49.226270+0000","last_became_active":"2024-09-21T02:58:22.084622+0000","last_became_peered":"2024-09-21T02:58:22.084622+0000","last_unstale":"2024-09-21T02:58:49.226270+0000","last_undegraded":"2024-09-21T02:58:49.226270+0000","last_fullsized":"2024-09-21T02:58:49.226270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.303286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152223+0000","last_change":"2024-09-21T02:58:49.237002+0000","last_active":"2024-09-21T02:58:51.152223+0000","last_peered":"2024-09-21T02:58:51.152223+0000","last_clean":"2024-09-21T02:58:51.152223+0000","last_became_active":"2024-09-21T02:58:49.233219+0000","last_became_peered":"2024-09-21T02:58:49.233219+0000","last_unstale":"2024-09-21T02:58:51.152223+0000","last_undegraded":"2024-09-21T02:58:51.152223+0000","last_fullsized":"2024-09-21T02:58:51.152223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:38.409153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228358+0000","last_change":"2024-09-21T02:58:15.051658+0000","last_active":"2024-09-21T02:58:49.228358+0000","last_peered":"2024-09-21T02:58:49.228358+0000","last_clean":"2024-09-21T02:58:49.228358+0000","last_became_active":"2024-09-21T02:58:15.048345+0000","last_became_peered":"2024-09-21T02:58:15.048345+0000","last_unstale":"2024-09-21T02:58:49.228358+0000","last_undegraded":"2024-09-21T02:58:49.228358+0000","last_fullsized":"2024-09-21T02:58:49.228358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:36.069051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.750150+0000","last_change":"2024-09-21T02:58:49.750028+0000","last_active":"2024-09-21T02:58:49.750150+0000","last_peered":"2024-09-21T02:58:49.750150+0000","last_clean":"2024-09-21T02:58:49.750150+0000","last_became_active":"2024-09-21T02:58:49.749587+0000","last_became_peered":"2024-09-21T02:58:49.749587+0000","last_unstale":"2024-09-21T02:58:49.750150+0000","last_undegraded":"2024-09-21T02:58:49.750150+0000","last_fullsized":"2024-09-21T02:58:49.750150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:33.018490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230873+0000","last_change":"2024-09-21T02:58:13.020762+0000","last_active":"2024-09-21T02:58:49.230873+0000","last_peered":"2024-09-21T02:58:49.230873+0000","last_clean":"2024-09-21T02:58:49.230873+0000","last_became_active":"2024-09-21T02:58:13.020263+0000","last_became_peered":"2024-09-21T02:58:13.020263+0000","last_unstale":"2024-09-21T02:58:49.230873+0000","last_undegraded":"2024-09-21T02:58:49.230873+0000","last_fullsized":"2024-09-21T02:58:49.230873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:14.490179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748543+0000","last_change":"2024-09-21T02:58:15.048732+0000","last_active":"2024-09-21T02:58:49.748543+0000","last_peered":"2024-09-21T02:58:49.748543+0000","last_clean":"2024-09-21T02:58:49.748543+0000","last_became_active":"2024-09-21T02:58:15.048393+0000","last_became_peered":"2024-09-21T02:58:15.048393+0000","last_unstale":"2024-09-21T02:58:49.748543+0000","last_undegraded":"2024-09-21T02:58:49.748543+0000","last_fullsized":"2024-09-21T02:58:49.748543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:07.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225897+0000","last_change":"2024-09-21T02:58:22.087072+0000","last_active":"2024-09-21T02:58:49.225897+0000","last_peered":"2024-09-21T02:58:49.225897+0000","last_clean":"2024-09-21T02:58:49.225897+0000","last_became_active":"2024-09-21T02:58:22.086695+0000","last_became_peered":"2024-09-21T02:58:22.086695+0000","last_unstale":"2024-09-21T02:58:49.225897+0000","last_undegraded":"2024-09-21T02:58:49.225897+0000","last_fullsized":"2024-09-21T02:58:49.225897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:18.592656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230870+0000","last_change":"2024-09-21T02:58:15.043756+0000","last_active":"2024-09-21T02:58:49.230870+0000","last_peered":"2024-09-21T02:58:49.230870+0000","last_clean":"2024-09-21T02:58:49.230870+0000","last_became_active":"2024-09-21T02:58:15.043415+0000","last_became_peered":"2024-09-21T02:58:15.043415+0000","last_unstale":"2024-09-21T02:58:49.230870+0000","last_undegraded":"2024-09-21T02:58:49.230870+0000","last_fullsized":"2024-09-21T02:58:49.230870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:53.655906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147581+0000","last_change":"2024-09-21T02:58:13.017054+0000","last_active":"2024-09-21T02:58:50.147581+0000","last_peered":"2024-09-21T02:58:50.147581+0000","last_clean":"2024-09-21T02:58:50.147581+0000","last_became_active":"2024-09-21T02:58:13.016636+0000","last_became_peered":"2024-09-21T02:58:13.016636+0000","last_unstale":"2024-09-21T02:58:50.147581+0000","last_undegraded":"2024-09-21T02:58:50.147581+0000","last_fullsized":"2024-09-21T02:58:50.147581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:27.941501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226537+0000","last_change":"2024-09-21T02:58:22.229949+0000","last_active":"2024-09-21T02:58:49.226537+0000","last_peered":"2024-09-21T02:58:49.226537+0000","last_clean":"2024-09-21T02:58:49.226537+0000","last_became_active":"2024-09-21T02:58:22.229490+0000","last_became_peered":"2024-09-21T02:58:22.229490+0000","last_unstale":"2024-09-21T02:58:49.226537+0000","last_undegraded":"2024-09-21T02:58:49.226537+0000","last_fullsized":"2024-09-21T02:58:49.226537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:25.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228272+0000","last_change":"2024-09-21T02:58:15.040559+0000","last_active":"2024-09-21T02:58:49.228272+0000","last_peered":"2024-09-21T02:58:49.228272+0000","last_clean":"2024-09-21T02:58:49.228272+0000","last_became_active":"2024-09-21T02:58:15.040220+0000","last_became_peered":"2024-09-21T02:58:15.040220+0000","last_unstale":"2024-09-21T02:58:49.228272+0000","last_undegraded":"2024-09-21T02:58:49.228272+0000","last_fullsized":"2024-09-21T02:58:49.228272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:55.853966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224522+0000","last_change":"2024-09-21T02:58:13.017985+0000","last_active":"2024-09-21T02:58:49.224522+0000","last_peered":"2024-09-21T02:58:49.224522+0000","last_clean":"2024-09-21T02:58:49.224522+0000","last_became_active":"2024-09-21T02:58:13.017583+0000","last_became_peered":"2024-09-21T02:58:13.017583+0000","last_unstale":"2024-09-21T02:58:49.224522+0000","last_undegraded":"2024-09-21T02:58:49.224522+0000","last_fullsized":"2024-09-21T02:58:49.224522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.917960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226338+0000","last_change":"2024-09-21T02:58:22.077294+0000","last_active":"2024-09-21T02:58:49.226338+0000","last_peered":"2024-09-21T02:58:49.226338+0000","last_clean":"2024-09-21T02:58:49.226338+0000","last_became_active":"2024-09-21T02:58:22.076884+0000","last_became_peered":"2024-09-21T02:58:22.076884+0000","last_unstale":"2024-09-21T02:58:49.226338+0000","last_undegraded":"2024-09-21T02:58:49.226338+0000","last_fullsized":"2024-09-21T02:58:49.226338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:00.045383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226825+0000","last_change":"2024-09-21T02:58:15.045160+0000","last_active":"2024-09-21T02:58:49.226825+0000","last_peered":"2024-09-21T02:58:49.226825+0000","last_clean":"2024-09-21T02:58:49.226825+0000","last_became_active":"2024-09-21T02:58:15.044814+0000","last_became_peered":"2024-09-21T02:58:15.044814+0000","last_unstale":"2024-09-21T02:58:49.226825+0000","last_undegraded":"2024-09-21T02:58:49.226825+0000","last_fullsized":"2024-09-21T02:58:49.226825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:13.325320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146734+0000","last_change":"2024-09-21T02:58:13.011081+0000","last_active":"2024-09-21T02:58:50.146734+0000","last_peered":"2024-09-21T02:58:50.146734+0000","last_clean":"2024-09-21T02:58:50.146734+0000","last_became_active":"2024-09-21T02:58:13.010682+0000","last_became_peered":"2024-09-21T02:58:13.010682+0000","last_unstale":"2024-09-21T02:58:50.146734+0000","last_undegraded":"2024-09-21T02:58:50.146734+0000","last_fullsized":"2024-09-21T02:58:50.146734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224126+0000","last_change":"2024-09-21T02:58:22.083449+0000","last_active":"2024-09-21T02:58:49.224126+0000","last_peered":"2024-09-21T02:58:49.224126+0000","last_clean":"2024-09-21T02:58:49.224126+0000","last_became_active":"2024-09-21T02:58:22.082996+0000","last_became_peered":"2024-09-21T02:58:22.082996+0000","last_unstale":"2024-09-21T02:58:49.224126+0000","last_undegraded":"2024-09-21T02:58:49.224126+0000","last_fullsized":"2024-09-21T02:58:49.224126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:21.667824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230242+0000","last_change":"2024-09-21T02:58:15.039458+0000","last_active":"2024-09-21T02:58:49.230242+0000","last_peered":"2024-09-21T02:58:49.230242+0000","last_clean":"2024-09-21T02:58:49.230242+0000","last_became_active":"2024-09-21T02:58:15.039082+0000","last_became_peered":"2024-09-21T02:58:15.039082+0000","last_unstale":"2024-09-21T02:58:49.230242+0000","last_undegraded":"2024-09-21T02:58:49.230242+0000","last_fullsized":"2024-09-21T02:58:49.230242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:37.102212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147255+0000","last_change":"2024-09-21T02:58:49.982108+0000","last_active":"2024-09-21T02:58:50.147255+0000","last_peered":"2024-09-21T02:58:50.147255+0000","last_clean":"2024-09-21T02:58:50.147255+0000","last_became_active":"2024-09-21T02:58:49.981462+0000","last_became_peered":"2024-09-21T02:58:49.981462+0000","last_unstale":"2024-09-21T02:58:50.147255+0000","last_undegraded":"2024-09-21T02:58:50.147255+0000","last_fullsized":"2024-09-21T02:58:50.147255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:17.624627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226847+0000","last_change":"2024-09-21T02:58:22.231082+0000","last_active":"2024-09-21T02:58:49.226847+0000","last_peered":"2024-09-21T02:58:49.226847+0000","last_clean":"2024-09-21T02:58:49.226847+0000","last_became_active":"2024-09-21T02:58:22.229781+0000","last_became_peered":"2024-09-21T02:58:22.229781+0000","last_unstale":"2024-09-21T02:58:49.226847+0000","last_undegraded":"2024-09-21T02:58:49.226847+0000","last_fullsized":"2024-09-21T02:58:49.226847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:14.964809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980043+0000","last_change":"2024-09-21T02:58:15.033111+0000","last_active":"2024-09-21T02:58:49.980043+0000","last_peered":"2024-09-21T02:58:49.980043+0000","last_clean":"2024-09-21T02:58:49.980043+0000","last_became_active":"2024-09-21T02:58:15.032738+0000","last_became_peered":"2024-09-21T02:58:15.032738+0000","last_unstale":"2024-09-21T02:58:49.980043+0000","last_undegraded":"2024-09-21T02:58:49.980043+0000","last_fullsized":"2024-09-21T02:58:49.980043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:31.209451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147323+0000","last_change":"2024-09-21T02:58:13.229717+0000","last_active":"2024-09-21T02:58:50.147323+0000","last_peered":"2024-09-21T02:58:50.147323+0000","last_clean":"2024-09-21T02:58:50.147323+0000","last_became_active":"2024-09-21T02:58:13.229376+0000","last_became_peered":"2024-09-21T02:58:13.229376+0000","last_unstale":"2024-09-21T02:58:50.147323+0000","last_undegraded":"2024-09-21T02:58:50.147323+0000","last_fullsized":"2024-09-21T02:58:50.147323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:05.436044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224447+0000","last_change":"2024-09-21T02:58:22.081140+0000","last_active":"2024-09-21T02:58:49.224447+0000","last_peered":"2024-09-21T02:58:49.224447+0000","last_clean":"2024-09-21T02:58:49.224447+0000","last_became_active":"2024-09-21T02:58:22.080670+0000","last_became_peered":"2024-09-21T02:58:22.080670+0000","last_unstale":"2024-09-21T02:58:49.224447+0000","last_undegraded":"2024-09-21T02:58:49.224447+0000","last_fullsized":"2024-09-21T02:58:49.224447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:43.078241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228985+0000","last_change":"2024-09-21T02:58:15.035927+0000","last_active":"2024-09-21T02:58:49.228985+0000","last_peered":"2024-09-21T02:58:49.228985+0000","last_clean":"2024-09-21T02:58:49.228985+0000","last_became_active":"2024-09-21T02:58:15.035529+0000","last_became_peered":"2024-09-21T02:58:15.035529+0000","last_unstale":"2024-09-21T02:58:49.228985+0000","last_undegraded":"2024-09-21T02:58:49.228985+0000","last_fullsized":"2024-09-21T02:58:49.228985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:02.045723+0000","last_change":"2024-09-21T02:58:13.016489+0000","last_active":"2024-09-21T02:59:02.045723+0000","last_peered":"2024-09-21T02:59:02.045723+0000","last_clean":"2024-09-21T02:59:02.045723+0000","last_became_active":"2024-09-21T02:58:13.016176+0000","last_became_peered":"2024-09-21T02:58:13.016176+0000","last_unstale":"2024-09-21T02:59:02.045723+0000","last_undegraded":"2024-09-21T02:59:02.045723+0000","last_fullsized":"2024-09-21T02:59:02.045723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:54.908933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227852+0000","last_change":"2024-09-21T02:58:22.229868+0000","last_active":"2024-09-21T02:58:49.227852+0000","last_peered":"2024-09-21T02:58:49.227852+0000","last_clean":"2024-09-21T02:58:49.227852+0000","last_became_active":"2024-09-21T02:58:22.229318+0000","last_became_peered":"2024-09-21T02:58:22.229318+0000","last_unstale":"2024-09-21T02:58:49.227852+0000","last_undegraded":"2024-09-21T02:58:49.227852+0000","last_fullsized":"2024-09-21T02:58:49.227852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:06.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435282+0000","last_change":"2024-09-21T02:58:15.037953+0000","last_active":"2024-09-21T02:58:49.435282+0000","last_peered":"2024-09-21T02:58:49.435282+0000","last_clean":"2024-09-21T02:58:49.435282+0000","last_became_active":"2024-09-21T02:58:15.036934+0000","last_became_peered":"2024-09-21T02:58:15.036934+0000","last_unstale":"2024-09-21T02:58:49.435282+0000","last_undegraded":"2024-09-21T02:58:49.435282+0000","last_fullsized":"2024-09-21T02:58:49.435282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:35.118295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146197+0000","last_change":"2024-09-21T02:58:13.553861+0000","last_active":"2024-09-21T02:58:50.146197+0000","last_peered":"2024-09-21T02:58:50.146197+0000","last_clean":"2024-09-21T02:58:50.146197+0000","last_became_active":"2024-09-21T02:58:13.553016+0000","last_became_peered":"2024-09-21T02:58:13.553016+0000","last_unstale":"2024-09-21T02:58:50.146197+0000","last_undegraded":"2024-09-21T02:58:50.146197+0000","last_fullsized":"2024-09-21T02:58:50.146197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227008+0000","last_change":"2024-09-21T02:58:22.087306+0000","last_active":"2024-09-21T02:58:49.227008+0000","last_peered":"2024-09-21T02:58:49.227008+0000","last_clean":"2024-09-21T02:58:49.227008+0000","last_became_active":"2024-09-21T02:58:22.086800+0000","last_became_peered":"2024-09-21T02:58:22.086800+0000","last_unstale":"2024-09-21T02:58:49.227008+0000","last_undegraded":"2024-09-21T02:58:49.227008+0000","last_fullsized":"2024-09-21T02:58:49.227008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:28.652990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224469+0000","last_change":"2024-09-21T02:58:15.038383+0000","last_active":"2024-09-21T02:58:49.224469+0000","last_peered":"2024-09-21T02:58:49.224469+0000","last_clean":"2024-09-21T02:58:49.224469+0000","last_became_active":"2024-09-21T02:58:15.037878+0000","last_became_peered":"2024-09-21T02:58:15.037878+0000","last_unstale":"2024-09-21T02:58:49.224469+0000","last_undegraded":"2024-09-21T02:58:49.224469+0000","last_fullsized":"2024-09-21T02:58:49.224469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:14.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223874+0000","last_change":"2024-09-21T02:58:13.555218+0000","last_active":"2024-09-21T02:58:49.223874+0000","last_peered":"2024-09-21T02:58:49.223874+0000","last_clean":"2024-09-21T02:58:49.223874+0000","last_became_active":"2024-09-21T02:58:13.554831+0000","last_became_peered":"2024-09-21T02:58:13.554831+0000","last_unstale":"2024-09-21T02:58:49.223874+0000","last_undegraded":"2024-09-21T02:58:49.223874+0000","last_fullsized":"2024-09-21T02:58:49.223874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:32.659118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230124+0000","last_change":"2024-09-21T02:58:22.229673+0000","last_active":"2024-09-21T02:58:49.230124+0000","last_peered":"2024-09-21T02:58:49.230124+0000","last_clean":"2024-09-21T02:58:49.230124+0000","last_became_active":"2024-09-21T02:58:22.229034+0000","last_became_peered":"2024-09-21T02:58:22.229034+0000","last_unstale":"2024-09-21T02:58:49.230124+0000","last_undegraded":"2024-09-21T02:58:49.230124+0000","last_fullsized":"2024-09-21T02:58:49.230124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:26.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.981818+0000","last_change":"2024-09-21T02:58:49.981660+0000","last_active":"2024-09-21T02:58:49.981818+0000","last_peered":"2024-09-21T02:58:49.981818+0000","last_clean":"2024-09-21T02:58:49.981818+0000","last_became_active":"2024-09-21T02:58:49.980972+0000","last_became_peered":"2024-09-21T02:58:49.980972+0000","last_unstale":"2024-09-21T02:58:49.981818+0000","last_undegraded":"2024-09-21T02:58:49.981818+0000","last_fullsized":"2024-09-21T02:58:49.981818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:26.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231087+0000","last_change":"2024-09-21T02:58:13.012751+0000","last_active":"2024-09-21T02:58:49.231087+0000","last_peered":"2024-09-21T02:58:49.231087+0000","last_clean":"2024-09-21T02:58:49.231087+0000","last_became_active":"2024-09-21T02:58:13.012341+0000","last_became_peered":"2024-09-21T02:58:13.012341+0000","last_unstale":"2024-09-21T02:58:49.231087+0000","last_undegraded":"2024-09-21T02:58:49.231087+0000","last_fullsized":"2024-09-21T02:58:49.231087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435050+0000","last_change":"2024-09-21T02:58:22.084620+0000","last_active":"2024-09-21T02:58:49.435050+0000","last_peered":"2024-09-21T02:58:49.435050+0000","last_clean":"2024-09-21T02:58:49.435050+0000","last_became_active":"2024-09-21T02:58:22.083935+0000","last_became_peered":"2024-09-21T02:58:22.083935+0000","last_unstale":"2024-09-21T02:58:49.435050+0000","last_undegraded":"2024-09-21T02:58:49.435050+0000","last_fullsized":"2024-09-21T02:58:49.435050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:37.033928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748547+0000","last_change":"2024-09-21T02:58:15.046935+0000","last_active":"2024-09-21T02:58:49.748547+0000","last_peered":"2024-09-21T02:58:49.748547+0000","last_clean":"2024-09-21T02:58:49.748547+0000","last_became_active":"2024-09-21T02:58:15.046572+0000","last_became_peered":"2024-09-21T02:58:15.046572+0000","last_unstale":"2024-09-21T02:58:49.748547+0000","last_undegraded":"2024-09-21T02:58:49.748547+0000","last_fullsized":"2024-09-21T02:58:49.748547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.942643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:02.176753+0000","last_change":"2024-09-21T02:58:13.553337+0000","last_active":"2024-09-21T02:59:02.176753+0000","last_peered":"2024-09-21T02:59:02.176753+0000","last_clean":"2024-09-21T02:59:02.176753+0000","last_became_active":"2024-09-21T02:58:13.552873+0000","last_became_peered":"2024-09-21T02:58:13.552873+0000","last_unstale":"2024-09-21T02:59:02.176753+0000","last_undegraded":"2024-09-21T02:59:02.176753+0000","last_fullsized":"2024-09-21T02:59:02.176753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:42.800873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435228+0000","last_change":"2024-09-21T02:58:22.230102+0000","last_active":"2024-09-21T02:58:49.435228+0000","last_peered":"2024-09-21T02:58:49.435228+0000","last_clean":"2024-09-21T02:58:49.435228+0000","last_became_active":"2024-09-21T02:58:22.229643+0000","last_became_peered":"2024-09-21T02:58:22.229643+0000","last_unstale":"2024-09-21T02:58:49.435228+0000","last_undegraded":"2024-09-21T02:58:49.435228+0000","last_fullsized":"2024-09-21T02:58:49.435228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.396292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434776+0000","last_change":"2024-09-21T02:58:15.043484+0000","last_active":"2024-09-21T02:58:49.434776+0000","last_peered":"2024-09-21T02:58:49.434776+0000","last_clean":"2024-09-21T02:58:49.434776+0000","last_became_active":"2024-09-21T02:58:15.042663+0000","last_became_peered":"2024-09-21T02:58:15.042663+0000","last_unstale":"2024-09-21T02:58:49.434776+0000","last_undegraded":"2024-09-21T02:58:49.434776+0000","last_fullsized":"2024-09-21T02:58:49.434776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:42.937814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.151290+0000","last_change":"2024-09-21T02:58:13.018109+0000","last_active":"2024-09-21T02:58:51.151290+0000","last_peered":"2024-09-21T02:58:51.151290+0000","last_clean":"2024-09-21T02:58:51.151290+0000","last_became_active":"2024-09-21T02:58:13.017761+0000","last_became_peered":"2024-09-21T02:58:13.017761+0000","last_unstale":"2024-09-21T02:58:51.151290+0000","last_undegraded":"2024-09-21T02:58:51.151290+0000","last_fullsized":"2024-09-21T02:58:51.151290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:12.613051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748710+0000","last_change":"2024-09-21T02:58:22.230520+0000","last_active":"2024-09-21T02:58:49.748710+0000","last_peered":"2024-09-21T02:58:49.748710+0000","last_clean":"2024-09-21T02:58:49.748710+0000","last_became_active":"2024-09-21T02:58:22.229999+0000","last_became_peered":"2024-09-21T02:58:22.229999+0000","last_unstale":"2024-09-21T02:58:49.748710+0000","last_undegraded":"2024-09-21T02:58:49.748710+0000","last_fullsized":"2024-09-21T02:58:49.748710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:12.899892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228426+0000","last_change":"2024-09-21T02:58:15.040357+0000","last_active":"2024-09-21T02:58:49.228426+0000","last_peered":"2024-09-21T02:58:49.228426+0000","last_clean":"2024-09-21T02:58:49.228426+0000","last_became_active":"2024-09-21T02:58:15.040026+0000","last_became_peered":"2024-09-21T02:58:15.040026+0000","last_unstale":"2024-09-21T02:58:49.228426+0000","last_undegraded":"2024-09-21T02:58:49.228426+0000","last_fullsized":"2024-09-21T02:58:49.228426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.216541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.151538+0000","last_change":"2024-09-21T02:58:13.014816+0000","last_active":"2024-09-21T02:58:52.151538+0000","last_peered":"2024-09-21T02:58:52.151538+0000","last_clean":"2024-09-21T02:58:52.151538+0000","last_became_active":"2024-09-21T02:58:13.013918+0000","last_became_peered":"2024-09-21T02:58:13.013918+0000","last_unstale":"2024-09-21T02:58:52.151538+0000","last_undegraded":"2024-09-21T02:58:52.151538+0000","last_fullsized":"2024-09-21T02:58:52.151538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:20.892671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230715+0000","last_change":"2024-09-21T02:57:01.191389+0000","last_active":"2024-09-21T02:58:49.230715+0000","last_peered":"2024-09-21T02:58:49.230715+0000","last_clean":"2024-09-21T02:58:49.230715+0000","last_became_active":"2024-09-21T02:57:01.185686+0000","last_became_peered":"2024-09-21T02:57:01.185686+0000","last_unstale":"2024-09-21T02:58:49.230715+0000","last_undegraded":"2024-09-21T02:58:49.230715+0000","last_fullsized":"2024-09-21T02:58:49.230715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_clean_scrub_stamp":"2024-09-21T02:53:36.647024+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.275496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231134+0000","last_change":"2024-09-21T02:58:22.081891+0000","last_active":"2024-09-21T02:58:49.231134+0000","last_peered":"2024-09-21T02:58:49.231134+0000","last_clean":"2024-09-21T02:58:49.231134+0000","last_became_active":"2024-09-21T02:58:22.081435+0000","last_became_peered":"2024-09-21T02:58:22.081435+0000","last_unstale":"2024-09-21T02:58:49.231134+0000","last_undegraded":"2024-09-21T02:58:49.231134+0000","last_fullsized":"2024-09-21T02:58:49.231134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:51.161690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231223+0000","last_change":"2024-09-21T02:58:15.045013+0000","last_active":"2024-09-21T02:58:49.231223+0000","last_peered":"2024-09-21T02:58:49.231223+0000","last_clean":"2024-09-21T02:58:49.231223+0000","last_became_active":"2024-09-21T02:58:15.044650+0000","last_became_peered":"2024-09-21T02:58:15.044650+0000","last_unstale":"2024-09-21T02:58:49.231223+0000","last_undegraded":"2024-09-21T02:58:49.231223+0000","last_fullsized":"2024-09-21T02:58:49.231223+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:39.087982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153469+0000","last_change":"2024-09-21T02:58:13.553468+0000","last_active":"2024-09-21T02:58:51.153469+0000","last_peered":"2024-09-21T02:58:51.153469+0000","last_clean":"2024-09-21T02:58:51.153469+0000","last_became_active":"2024-09-21T02:58:13.552965+0000","last_became_peered":"2024-09-21T02:58:13.552965+0000","last_unstale":"2024-09-21T02:58:51.153469+0000","last_undegraded":"2024-09-21T02:58:51.153469+0000","last_fullsized":"2024-09-21T02:58:51.153469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:35.224581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227364+0000","last_change":"2024-09-21T02:58:22.086994+0000","last_active":"2024-09-21T02:58:49.227364+0000","last_peered":"2024-09-21T02:58:49.227364+0000","last_clean":"2024-09-21T02:58:49.227364+0000","last_became_active":"2024-09-21T02:58:22.086506+0000","last_became_peered":"2024-09-21T02:58:22.086506+0000","last_unstale":"2024-09-21T02:58:49.227364+0000","last_undegraded":"2024-09-21T02:58:49.227364+0000","last_fullsized":"2024-09-21T02:58:49.227364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:09.102495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230976+0000","last_change":"2024-09-21T02:58:15.040224+0000","last_active":"2024-09-21T02:58:49.230976+0000","last_peered":"2024-09-21T02:58:49.230976+0000","last_clean":"2024-09-21T02:58:49.230976+0000","last_became_active":"2024-09-21T02:58:15.039115+0000","last_became_peered":"2024-09-21T02:58:15.039115+0000","last_unstale":"2024-09-21T02:58:49.230976+0000","last_undegraded":"2024-09-21T02:58:49.230976+0000","last_fullsized":"2024-09-21T02:58:49.230976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:35.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748956+0000","last_change":"2024-09-21T02:58:13.021526+0000","last_active":"2024-09-21T02:58:49.748956+0000","last_peered":"2024-09-21T02:58:49.748956+0000","last_clean":"2024-09-21T02:58:49.748956+0000","last_became_active":"2024-09-21T02:58:13.020521+0000","last_became_peered":"2024-09-21T02:58:13.020521+0000","last_unstale":"2024-09-21T02:58:49.748956+0000","last_undegraded":"2024-09-21T02:58:49.748956+0000","last_fullsized":"2024-09-21T02:58:49.748956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:08.645141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980132+0000","last_change":"2024-09-21T02:58:22.077862+0000","last_active":"2024-09-21T02:58:49.980132+0000","last_peered":"2024-09-21T02:58:49.980132+0000","last_clean":"2024-09-21T02:58:49.980132+0000","last_became_active":"2024-09-21T02:58:22.077410+0000","last_became_peered":"2024-09-21T02:58:22.077410+0000","last_unstale":"2024-09-21T02:58:49.980132+0000","last_undegraded":"2024-09-21T02:58:49.980132+0000","last_fullsized":"2024-09-21T02:58:49.980132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:06.549842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231212+0000","last_change":"2024-09-21T02:58:15.037775+0000","last_active":"2024-09-21T02:58:49.231212+0000","last_peered":"2024-09-21T02:58:49.231212+0000","last_clean":"2024-09-21T02:58:49.231212+0000","last_became_active":"2024-09-21T02:58:15.037036+0000","last_became_peered":"2024-09-21T02:58:15.037036+0000","last_unstale":"2024-09-21T02:58:49.231212+0000","last_undegraded":"2024-09-21T02:58:49.231212+0000","last_fullsized":"2024-09-21T02:58:49.231212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:58.289785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435249+0000","last_change":"2024-09-21T02:58:13.015046+0000","last_active":"2024-09-21T02:58:49.435249+0000","last_peered":"2024-09-21T02:58:49.435249+0000","last_clean":"2024-09-21T02:58:49.435249+0000","last_became_active":"2024-09-21T02:58:13.014643+0000","last_became_peered":"2024-09-21T02:58:13.014643+0000","last_unstale":"2024-09-21T02:58:49.435249+0000","last_undegraded":"2024-09-21T02:58:49.435249+0000","last_fullsized":"2024-09-21T02:58:49.435249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:54.913187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.747869+0000","last_change":"2024-09-21T02:58:22.085805+0000","last_active":"2024-09-21T02:58:49.747869+0000","last_peered":"2024-09-21T02:58:49.747869+0000","last_clean":"2024-09-21T02:58:49.747869+0000","last_became_active":"2024-09-21T02:58:22.084752+0000","last_became_peered":"2024-09-21T02:58:22.084752+0000","last_unstale":"2024-09-21T02:58:49.747869+0000","last_undegraded":"2024-09-21T02:58:49.747869+0000","last_fullsized":"2024-09-21T02:58:49.747869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:39.357089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227424+0000","last_change":"2024-09-21T02:58:15.046643+0000","last_active":"2024-09-21T02:58:49.227424+0000","last_peered":"2024-09-21T02:58:49.227424+0000","last_clean":"2024-09-21T02:58:49.227424+0000","last_became_active":"2024-09-21T02:58:15.046278+0000","last_became_peered":"2024-09-21T02:58:15.046278+0000","last_unstale":"2024-09-21T02:58:49.227424+0000","last_undegraded":"2024-09-21T02:58:49.227424+0000","last_fullsized":"2024-09-21T02:58:49.227424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.648084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.147510+0000","last_change":"2024-09-21T02:58:13.022176+0000","last_active":"2024-09-21T02:58:52.147510+0000","last_peered":"2024-09-21T02:58:52.147510+0000","last_clean":"2024-09-21T02:58:52.147510+0000","last_became_active":"2024-09-21T02:58:13.020122+0000","last_became_peered":"2024-09-21T02:58:13.020122+0000","last_unstale":"2024-09-21T02:58:52.147510+0000","last_undegraded":"2024-09-21T02:58:52.147510+0000","last_fullsized":"2024-09-21T02:58:52.147510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:12.346056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748354+0000","last_change":"2024-09-21T02:58:22.084221+0000","last_active":"2024-09-21T02:58:49.748354+0000","last_peered":"2024-09-21T02:58:49.748354+0000","last_clean":"2024-09-21T02:58:49.748354+0000","last_became_active":"2024-09-21T02:58:22.083793+0000","last_became_peered":"2024-09-21T02:58:22.083793+0000","last_unstale":"2024-09-21T02:58:49.748354+0000","last_undegraded":"2024-09-21T02:58:49.748354+0000","last_fullsized":"2024-09-21T02:58:49.748354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:13.043641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233959+0000","last_change":"2024-09-21T02:58:49.233440+0000","last_active":"2024-09-21T02:58:49.233959+0000","last_peered":"2024-09-21T02:58:49.233959+0000","last_clean":"2024-09-21T02:58:49.233959+0000","last_became_active":"2024-09-21T02:58:49.232996+0000","last_became_peered":"2024-09-21T02:58:49.232996+0000","last_unstale":"2024-09-21T02:58:49.233959+0000","last_undegraded":"2024-09-21T02:58:49.233959+0000","last_fullsized":"2024-09-21T02:58:49.233959+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:13.181861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.154616+0000","last_change":"2024-09-21T02:58:13.553866+0000","last_active":"2024-09-21T02:58:51.154616+0000","last_peered":"2024-09-21T02:58:51.154616+0000","last_clean":"2024-09-21T02:58:51.154616+0000","last_became_active":"2024-09-21T02:58:13.553001+0000","last_became_peered":"2024-09-21T02:58:13.553001+0000","last_unstale":"2024-09-21T02:58:51.154616+0000","last_undegraded":"2024-09-21T02:58:51.154616+0000","last_fullsized":"2024-09-21T02:58:51.154616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:43.995773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435231+0000","last_change":"2024-09-21T02:58:22.090253+0000","last_active":"2024-09-21T02:58:49.435231+0000","last_peered":"2024-09-21T02:58:49.435231+0000","last_clean":"2024-09-21T02:58:49.435231+0000","last_became_active":"2024-09-21T02:58:22.089818+0000","last_became_peered":"2024-09-21T02:58:22.089818+0000","last_unstale":"2024-09-21T02:58:49.435231+0000","last_undegraded":"2024-09-21T02:58:49.435231+0000","last_fullsized":"2024-09-21T02:58:49.435231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:09.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230280+0000","last_change":"2024-09-21T02:58:15.042479+0000","last_active":"2024-09-21T02:58:49.230280+0000","last_peered":"2024-09-21T02:58:49.230280+0000","last_clean":"2024-09-21T02:58:49.230280+0000","last_became_active":"2024-09-21T02:58:15.042087+0000","last_became_peered":"2024-09-21T02:58:15.042087+0000","last_unstale":"2024-09-21T02:58:49.230280+0000","last_undegraded":"2024-09-21T02:58:49.230280+0000","last_fullsized":"2024-09-21T02:58:49.230280+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.427736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:05.200653+0000","last_change":"2024-09-21T02:58:13.012559+0000","last_active":"2024-09-21T02:59:05.200653+0000","last_peered":"2024-09-21T02:59:05.200653+0000","last_clean":"2024-09-21T02:59:05.200653+0000","last_became_active":"2024-09-21T02:58:13.011062+0000","last_became_peered":"2024-09-21T02:58:13.011062+0000","last_unstale":"2024-09-21T02:59:05.200653+0000","last_undegraded":"2024-09-21T02:59:05.200653+0000","last_fullsized":"2024-09-21T02:59:05.200653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:17.839898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224241+0000","last_change":"2024-09-21T02:58:22.081196+0000","last_active":"2024-09-21T02:58:49.224241+0000","last_peered":"2024-09-21T02:58:49.224241+0000","last_clean":"2024-09-21T02:58:49.224241+0000","last_became_active":"2024-09-21T02:58:22.080787+0000","last_became_peered":"2024-09-21T02:58:22.080787+0000","last_unstale":"2024-09-21T02:58:49.224241+0000","last_undegraded":"2024-09-21T02:58:49.224241+0000","last_fullsized":"2024-09-21T02:58:49.224241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.283112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230702+0000","last_change":"2024-09-21T02:58:15.046322+0000","last_active":"2024-09-21T02:58:49.230702+0000","last_peered":"2024-09-21T02:58:49.230702+0000","last_clean":"2024-09-21T02:58:49.230702+0000","last_became_active":"2024-09-21T02:58:15.045936+0000","last_became_peered":"2024-09-21T02:58:15.045936+0000","last_unstale":"2024-09-21T02:58:49.230702+0000","last_undegraded":"2024-09-21T02:58:49.230702+0000","last_fullsized":"2024-09-21T02:58:49.230702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:08.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145891+0000","last_change":"2024-09-21T02:58:13.022277+0000","last_active":"2024-09-21T02:58:50.145891+0000","last_peered":"2024-09-21T02:58:50.145891+0000","last_clean":"2024-09-21T02:58:50.145891+0000","last_became_active":"2024-09-21T02:58:13.021901+0000","last_became_peered":"2024-09-21T02:58:13.021901+0000","last_unstale":"2024-09-21T02:58:50.145891+0000","last_undegraded":"2024-09-21T02:58:50.145891+0000","last_fullsized":"2024-09-21T02:58:50.145891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:01.029435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226991+0000","last_change":"2024-09-21T02:58:22.088951+0000","last_active":"2024-09-21T02:58:49.226991+0000","last_peered":"2024-09-21T02:58:49.226991+0000","last_clean":"2024-09-21T02:58:49.226991+0000","last_became_active":"2024-09-21T02:58:22.088427+0000","last_became_peered":"2024-09-21T02:58:22.088427+0000","last_unstale":"2024-09-21T02:58:49.226991+0000","last_undegraded":"2024-09-21T02:58:49.226991+0000","last_fullsized":"2024-09-21T02:58:49.226991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:52.700517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434868+0000","last_change":"2024-09-21T02:58:15.038390+0000","last_active":"2024-09-21T02:58:49.434868+0000","last_peered":"2024-09-21T02:58:49.434868+0000","last_clean":"2024-09-21T02:58:49.434868+0000","last_became_active":"2024-09-21T02:58:15.037368+0000","last_became_peered":"2024-09-21T02:58:15.037368+0000","last_unstale":"2024-09-21T02:58:49.434868+0000","last_undegraded":"2024-09-21T02:58:49.434868+0000","last_fullsized":"2024-09-21T02:58:49.434868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:54.736444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152969+0000","last_change":"2024-09-21T02:58:13.013246+0000","last_active":"2024-09-21T02:58:51.152969+0000","last_peered":"2024-09-21T02:58:51.152969+0000","last_clean":"2024-09-21T02:58:51.152969+0000","last_became_active":"2024-09-21T02:58:13.012830+0000","last_became_peered":"2024-09-21T02:58:13.012830+0000","last_unstale":"2024-09-21T02:58:51.152969+0000","last_undegraded":"2024-09-21T02:58:51.152969+0000","last_fullsized":"2024-09-21T02:58:51.152969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:31.406565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748517+0000","last_change":"2024-09-21T02:58:22.086799+0000","last_active":"2024-09-21T02:58:49.748517+0000","last_peered":"2024-09-21T02:58:49.748517+0000","last_clean":"2024-09-21T02:58:49.748517+0000","last_became_active":"2024-09-21T02:58:22.086395+0000","last_became_peered":"2024-09-21T02:58:22.086395+0000","last_unstale":"2024-09-21T02:58:49.748517+0000","last_undegraded":"2024-09-21T02:58:49.748517+0000","last_fullsized":"2024-09-21T02:58:49.748517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:38.985072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230971+0000","last_change":"2024-09-21T02:58:15.037346+0000","last_active":"2024-09-21T02:58:49.230971+0000","last_peered":"2024-09-21T02:58:49.230971+0000","last_clean":"2024-09-21T02:58:49.230971+0000","last_became_active":"2024-09-21T02:58:15.036984+0000","last_became_peered":"2024-09-21T02:58:15.036984+0000","last_unstale":"2024-09-21T02:58:49.230971+0000","last_undegraded":"2024-09-21T02:58:49.230971+0000","last_fullsized":"2024-09-21T02:58:49.230971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:43.856844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":98,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:05.242896+0000","last_change":"2024-09-21T02:58:13.018287+0000","last_active":"2024-09-21T02:59:05.242896+0000","last_peered":"2024-09-21T02:59:05.242896+0000","last_clean":"2024-09-21T02:59:05.242896+0000","last_became_active":"2024-09-21T02:58:13.017908+0000","last_became_peered":"2024-09-21T02:58:13.017908+0000","last_unstale":"2024-09-21T02:59:05.242896+0000","last_undegraded":"2024-09-21T02:59:05.242896+0000","last_fullsized":"2024-09-21T02:59:05.242896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:30.422946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60809,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":63,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223420+0000","last_change":"2024-09-21T02:58:22.078106+0000","last_active":"2024-09-21T02:58:49.223420+0000","last_peered":"2024-09-21T02:58:49.223420+0000","last_clean":"2024-09-21T02:58:49.223420+0000","last_became_active":"2024-09-21T02:58:22.077675+0000","last_became_peered":"2024-09-21T02:58:22.077675+0000","last_unstale":"2024-09-21T02:58:49.223420+0000","last_undegraded":"2024-09-21T02:58:49.223420+0000","last_fullsized":"2024-09-21T02:58:49.223420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:08.965865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228496+0000","last_change":"2024-09-21T02:58:15.045911+0000","last_active":"2024-09-21T02:58:49.228496+0000","last_peered":"2024-09-21T02:58:49.228496+0000","last_clean":"2024-09-21T02:58:49.228496+0000","last_became_active":"2024-09-21T02:58:15.045506+0000","last_became_peered":"2024-09-21T02:58:15.045506+0000","last_unstale":"2024-09-21T02:58:49.228496+0000","last_undegraded":"2024-09-21T02:58:49.228496+0000","last_fullsized":"2024-09-21T02:58:49.228496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.982730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.144087+0000","last_change":"2024-09-21T02:58:13.555132+0000","last_active":"2024-09-21T02:58:50.144087+0000","last_peered":"2024-09-21T02:58:50.144087+0000","last_clean":"2024-09-21T02:58:50.144087+0000","last_became_active":"2024-09-21T02:58:13.554582+0000","last_became_peered":"2024-09-21T02:58:13.554582+0000","last_unstale":"2024-09-21T02:58:50.144087+0000","last_undegraded":"2024-09-21T02:58:50.144087+0000","last_fullsized":"2024-09-21T02:58:50.144087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:56.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.234599+0000","last_change":"2024-09-21T02:58:49.234443+0000","last_active":"2024-09-21T02:58:49.234599+0000","last_peered":"2024-09-21T02:58:49.234599+0000","last_clean":"2024-09-21T02:58:49.234599+0000","last_became_active":"2024-09-21T02:58:49.233758+0000","last_became_peered":"2024-09-21T02:58:49.233758+0000","last_unstale":"2024-09-21T02:58:49.234599+0000","last_undegraded":"2024-09-21T02:58:49.234599+0000","last_fullsized":"2024-09-21T02:58:49.234599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:06.821726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980321+0000","last_change":"2024-09-21T02:58:15.033598+0000","last_active":"2024-09-21T02:58:49.980321+0000","last_peered":"2024-09-21T02:58:49.980321+0000","last_clean":"2024-09-21T02:58:49.980321+0000","last_became_active":"2024-09-21T02:58:15.033268+0000","last_became_peered":"2024-09-21T02:58:15.033268+0000","last_unstale":"2024-09-21T02:58:49.980321+0000","last_undegraded":"2024-09-21T02:58:49.980321+0000","last_fullsized":"2024-09-21T02:58:49.980321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:25.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145942+0000","last_change":"2024-09-21T02:58:13.018159+0000","last_active":"2024-09-21T02:58:50.145942+0000","last_peered":"2024-09-21T02:58:50.145942+0000","last_clean":"2024-09-21T02:58:50.145942+0000","last_became_active":"2024-09-21T02:58:13.017263+0000","last_became_peered":"2024-09-21T02:58:13.017263+0000","last_unstale":"2024-09-21T02:58:50.145942+0000","last_undegraded":"2024-09-21T02:58:50.145942+0000","last_fullsized":"2024-09-21T02:58:50.145942+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:47.981435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.982319+0000","last_change":"2024-09-21T02:58:49.981593+0000","last_active":"2024-09-21T02:58:49.982319+0000","last_peered":"2024-09-21T02:58:49.982319+0000","last_clean":"2024-09-21T02:58:49.982319+0000","last_became_active":"2024-09-21T02:58:49.980890+0000","last_became_peered":"2024-09-21T02:58:49.980890+0000","last_unstale":"2024-09-21T02:58:49.982319+0000","last_undegraded":"2024-09-21T02:58:49.982319+0000","last_fullsized":"2024-09-21T02:58:49.982319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:59.251327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229390+0000","last_change":"2024-09-21T02:58:15.049561+0000","last_active":"2024-09-21T02:58:49.229390+0000","last_peered":"2024-09-21T02:58:49.229390+0000","last_clean":"2024-09-21T02:58:49.229390+0000","last_became_active":"2024-09-21T02:58:15.049205+0000","last_became_peered":"2024-09-21T02:58:15.049205+0000","last_unstale":"2024-09-21T02:58:49.229390+0000","last_undegraded":"2024-09-21T02:58:49.229390+0000","last_fullsized":"2024-09-21T02:58:49.229390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:56.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:04.173759+0000","last_change":"2024-09-21T02:58:13.018964+0000","last_active":"2024-09-21T02:59:04.173759+0000","last_peered":"2024-09-21T02:59:04.173759+0000","last_clean":"2024-09-21T02:59:04.173759+0000","last_became_active":"2024-09-21T02:58:13.017420+0000","last_became_peered":"2024-09-21T02:58:13.017420+0000","last_unstale":"2024-09-21T02:59:04.173759+0000","last_undegraded":"2024-09-21T02:59:04.173759+0000","last_fullsized":"2024-09-21T02:59:04.173759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233600+0000","last_change":"2024-09-21T02:58:49.233486+0000","last_active":"2024-09-21T02:58:49.233600+0000","last_peered":"2024-09-21T02:58:49.233600+0000","last_clean":"2024-09-21T02:58:49.233600+0000","last_became_active":"2024-09-21T02:58:49.232940+0000","last_became_peered":"2024-09-21T02:58:49.232940+0000","last_unstale":"2024-09-21T02:58:49.233600+0000","last_undegraded":"2024-09-21T02:58:49.233600+0000","last_fullsized":"2024-09-21T02:58:49.233600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:19.283141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979738+0000","last_change":"2024-09-21T02:58:22.085163+0000","last_active":"2024-09-21T02:58:49.979738+0000","last_peered":"2024-09-21T02:58:49.979738+0000","last_clean":"2024-09-21T02:58:49.979738+0000","last_became_active":"2024-09-21T02:58:22.084768+0000","last_became_peered":"2024-09-21T02:58:22.084768+0000","last_unstale":"2024-09-21T02:58:49.979738+0000","last_undegraded":"2024-09-21T02:58:49.979738+0000","last_fullsized":"2024-09-21T02:58:49.979738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:46.892421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223405+0000","last_change":"2024-09-21T02:58:15.035051+0000","last_active":"2024-09-21T02:58:49.223405+0000","last_peered":"2024-09-21T02:58:49.223405+0000","last_clean":"2024-09-21T02:58:49.223405+0000","last_became_active":"2024-09-21T02:58:15.034692+0000","last_became_peered":"2024-09-21T02:58:15.034692+0000","last_unstale":"2024-09-21T02:58:49.223405+0000","last_undegraded":"2024-09-21T02:58:49.223405+0000","last_fullsized":"2024-09-21T02:58:49.223405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:14.605154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748786+0000","last_change":"2024-09-21T02:58:13.018102+0000","last_active":"2024-09-21T02:58:49.748786+0000","last_peered":"2024-09-21T02:58:49.748786+0000","last_clean":"2024-09-21T02:58:49.748786+0000","last_became_active":"2024-09-21T02:58:13.017537+0000","last_became_peered":"2024-09-21T02:58:13.017537+0000","last_unstale":"2024-09-21T02:58:49.748786+0000","last_undegraded":"2024-09-21T02:58:49.748786+0000","last_fullsized":"2024-09-21T02:58:49.748786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:40.096326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227422+0000","last_change":"2024-09-21T02:58:22.084362+0000","last_active":"2024-09-21T02:58:49.227422+0000","last_peered":"2024-09-21T02:58:49.227422+0000","last_clean":"2024-09-21T02:58:49.227422+0000","last_became_active":"2024-09-21T02:58:22.083895+0000","last_became_peered":"2024-09-21T02:58:22.083895+0000","last_unstale":"2024-09-21T02:58:49.227422+0000","last_undegraded":"2024-09-21T02:58:49.227422+0000","last_fullsized":"2024-09-21T02:58:49.227422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:54.101588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227989+0000","last_change":"2024-09-21T02:58:15.034768+0000","last_active":"2024-09-21T02:58:49.227989+0000","last_peered":"2024-09-21T02:58:49.227989+0000","last_clean":"2024-09-21T02:58:49.227989+0000","last_became_active":"2024-09-21T02:58:15.034420+0000","last_became_peered":"2024-09-21T02:58:15.034420+0000","last_unstale":"2024-09-21T02:58:49.227989+0000","last_undegraded":"2024-09-21T02:58:49.227989+0000","last_fullsized":"2024-09-21T02:58:49.227989+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:25.750158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152269+0000","last_change":"2024-09-21T02:58:13.015026+0000","last_active":"2024-09-21T02:58:51.152269+0000","last_peered":"2024-09-21T02:58:51.152269+0000","last_clean":"2024-09-21T02:58:51.152269+0000","last_became_active":"2024-09-21T02:58:13.014668+0000","last_became_peered":"2024-09-21T02:58:13.014668+0000","last_unstale":"2024-09-21T02:58:51.152269+0000","last_undegraded":"2024-09-21T02:58:51.152269+0000","last_fullsized":"2024-09-21T02:58:51.152269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:20.117518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153234+0000","last_change":"2024-09-21T02:58:13.018044+0000","last_active":"2024-09-21T02:58:51.153234+0000","last_peered":"2024-09-21T02:58:51.153234+0000","last_clean":"2024-09-21T02:58:51.153234+0000","last_became_active":"2024-09-21T02:58:13.017628+0000","last_became_peered":"2024-09-21T02:58:13.017628+0000","last_unstale":"2024-09-21T02:58:51.153234+0000","last_undegraded":"2024-09-21T02:58:51.153234+0000","last_fullsized":"2024-09-21T02:58:51.153234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:38.749379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748507+0000","last_change":"2024-09-21T02:58:15.048160+0000","last_active":"2024-09-21T02:58:49.748507+0000","last_peered":"2024-09-21T02:58:49.748507+0000","last_clean":"2024-09-21T02:58:49.748507+0000","last_became_active":"2024-09-21T02:58:15.046371+0000","last_became_peered":"2024-09-21T02:58:15.046371+0000","last_unstale":"2024-09-21T02:58:49.748507+0000","last_undegraded":"2024-09-21T02:58:49.748507+0000","last_fullsized":"2024-09-21T02:58:49.748507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:49.386799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224497+0000","last_change":"2024-09-21T02:58:22.089918+0000","last_active":"2024-09-21T02:58:49.224497+0000","last_peered":"2024-09-21T02:58:49.224497+0000","last_clean":"2024-09-21T02:58:49.224497+0000","last_became_active":"2024-09-21T02:58:22.089457+0000","last_became_peered":"2024-09-21T02:58:22.089457+0000","last_unstale":"2024-09-21T02:58:49.224497+0000","last_undegraded":"2024-09-21T02:58:49.224497+0000","last_fullsized":"2024-09-21T02:58:49.224497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:28.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:05.176631+0000","last_change":"2024-09-21T02:58:13.021192+0000","last_active":"2024-09-21T02:59:05.176631+0000","last_peered":"2024-09-21T02:59:05.176631+0000","last_clean":"2024-09-21T02:59:05.176631+0000","last_became_active":"2024-09-21T02:58:13.020746+0000","last_became_peered":"2024-09-21T02:58:13.020746+0000","last_unstale":"2024-09-21T02:59:05.176631+0000","last_undegraded":"2024-09-21T02:59:05.176631+0000","last_fullsized":"2024-09-21T02:59:05.176631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:13.260225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230350+0000","last_change":"2024-09-21T02:58:15.038375+0000","last_active":"2024-09-21T02:58:49.230350+0000","last_peered":"2024-09-21T02:58:49.230350+0000","last_clean":"2024-09-21T02:58:49.230350+0000","last_became_active":"2024-09-21T02:58:15.038011+0000","last_became_peered":"2024-09-21T02:58:15.038011+0000","last_unstale":"2024-09-21T02:58:49.230350+0000","last_undegraded":"2024-09-21T02:58:49.230350+0000","last_fullsized":"2024-09-21T02:58:49.230350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:50.820554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224842+0000","last_change":"2024-09-21T02:58:22.088436+0000","last_active":"2024-09-21T02:58:49.224842+0000","last_peered":"2024-09-21T02:58:49.224842+0000","last_clean":"2024-09-21T02:58:49.224842+0000","last_became_active":"2024-09-21T02:58:22.087857+0000","last_became_peered":"2024-09-21T02:58:22.087857+0000","last_unstale":"2024-09-21T02:58:49.224842+0000","last_undegraded":"2024-09-21T02:58:49.224842+0000","last_fullsized":"2024-09-21T02:58:49.224842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:40.314833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226720+0000","last_change":"2024-09-21T02:58:15.041490+0000","last_active":"2024-09-21T02:58:49.226720+0000","last_peered":"2024-09-21T02:58:49.226720+0000","last_clean":"2024-09-21T02:58:49.226720+0000","last_became_active":"2024-09-21T02:58:15.041106+0000","last_became_peered":"2024-09-21T02:58:15.041106+0000","last_unstale":"2024-09-21T02:58:49.226720+0000","last_undegraded":"2024-09-21T02:58:49.226720+0000","last_fullsized":"2024-09-21T02:58:49.226720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:57.228254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224682+0000","last_change":"2024-09-21T02:58:15.041375+0000","last_active":"2024-09-21T02:58:49.224682+0000","last_peered":"2024-09-21T02:58:49.224682+0000","last_clean":"2024-09-21T02:58:49.224682+0000","last_became_active":"2024-09-21T02:58:15.041041+0000","last_became_peered":"2024-09-21T02:58:15.041041+0000","last_unstale":"2024-09-21T02:58:49.224682+0000","last_undegraded":"2024-09-21T02:58:49.224682+0000","last_fullsized":"2024-09-21T02:58:49.224682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:49.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224406+0000","last_change":"2024-09-21T02:58:15.036772+0000","last_active":"2024-09-21T02:58:49.224406+0000","last_peered":"2024-09-21T02:58:49.224406+0000","last_clean":"2024-09-21T02:58:49.224406+0000","last_became_active":"2024-09-21T02:58:15.036390+0000","last_became_peered":"2024-09-21T02:58:15.036390+0000","last_unstale":"2024-09-21T02:58:49.224406+0000","last_undegraded":"2024-09-21T02:58:49.224406+0000","last_fullsized":"2024-09-21T02:58:49.224406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:49.169184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980239+0000","last_change":"2024-09-21T02:58:15.035375+0000","last_active":"2024-09-21T02:58:49.980239+0000","last_peered":"2024-09-21T02:58:49.980239+0000","last_clean":"2024-09-21T02:58:49.980239+0000","last_became_active":"2024-09-21T02:58:15.035015+0000","last_became_peered":"2024-09-21T02:58:15.035015+0000","last_unstale":"2024-09-21T02:58:49.980239+0000","last_undegraded":"2024-09-21T02:58:49.980239+0000","last_fullsized":"2024-09-21T02:58:49.980239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:32.980690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435193+0000","last_change":"2024-09-21T02:58:15.046431+0000","last_active":"2024-09-21T02:58:49.435193+0000","last_peered":"2024-09-21T02:58:49.435193+0000","last_clean":"2024-09-21T02:58:49.435193+0000","last_became_active":"2024-09-21T02:58:15.046048+0000","last_became_peered":"2024-09-21T02:58:15.046048+0000","last_unstale":"2024-09-21T02:58:49.435193+0000","last_undegraded":"2024-09-21T02:58:49.435193+0000","last_fullsized":"2024-09-21T02:58:49.435193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:42.079020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227633+0000","last_change":"2024-09-21T02:58:15.043192+0000","last_active":"2024-09-21T02:58:49.227633+0000","last_peered":"2024-09-21T02:58:49.227633+0000","last_clean":"2024-09-21T02:58:49.227633+0000","last_became_active":"2024-09-21T02:58:15.042413+0000","last_became_peered":"2024-09-21T02:58:15.042413+0000","last_unstale":"2024-09-21T02:58:49.227633+0000","last_undegraded":"2024-09-21T02:58:49.227633+0000","last_fullsized":"2024-09-21T02:58:49.227633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:31.491311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225245+0000","last_change":"2024-09-21T02:58:15.040194+0000","last_active":"2024-09-21T02:58:49.225245+0000","last_peered":"2024-09-21T02:58:49.225245+0000","last_clean":"2024-09-21T02:58:49.225245+0000","last_became_active":"2024-09-21T02:58:15.039803+0000","last_became_peered":"2024-09-21T02:58:15.039803+0000","last_unstale":"2024-09-21T02:58:49.225245+0000","last_undegraded":"2024-09-21T02:58:49.225245+0000","last_fullsized":"2024-09-21T02:58:49.225245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:21.357004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228974+0000","last_change":"2024-09-21T02:58:15.043038+0000","last_active":"2024-09-21T02:58:49.228974+0000","last_peered":"2024-09-21T02:58:49.228974+0000","last_clean":"2024-09-21T02:58:49.228974+0000","last_became_active":"2024-09-21T02:58:15.042643+0000","last_became_peered":"2024-09-21T02:58:15.042643+0000","last_unstale":"2024-09-21T02:58:49.228974+0000","last_undegraded":"2024-09-21T02:58:49.228974+0000","last_fullsized":"2024-09-21T02:58:49.228974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:14.639995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748116+0000","last_change":"2024-09-21T02:58:15.037015+0000","last_active":"2024-09-21T02:58:49.748116+0000","last_peered":"2024-09-21T02:58:49.748116+0000","last_clean":"2024-09-21T02:58:49.748116+0000","last_became_active":"2024-09-21T02:58:15.036628+0000","last_became_peered":"2024-09-21T02:58:15.036628+0000","last_unstale":"2024-09-21T02:58:49.748116+0000","last_undegraded":"2024-09-21T02:58:49.748116+0000","last_fullsized":"2024-09-21T02:58:49.748116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:07.823178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228334+0000","last_change":"2024-09-21T02:58:15.041768+0000","last_active":"2024-09-21T02:58:49.228334+0000","last_peered":"2024-09-21T02:58:49.228334+0000","last_clean":"2024-09-21T02:58:49.228334+0000","last_became_active":"2024-09-21T02:58:15.041374+0000","last_became_peered":"2024-09-21T02:58:15.041374+0000","last_unstale":"2024-09-21T02:58:49.228334+0000","last_undegraded":"2024-09-21T02:58:49.228334+0000","last_fullsized":"2024-09-21T02:58:49.228334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:25.145949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227754+0000","last_change":"2024-09-21T02:58:15.047263+0000","last_active":"2024-09-21T02:58:49.227754+0000","last_peered":"2024-09-21T02:58:49.227754+0000","last_clean":"2024-09-21T02:58:49.227754+0000","last_became_active":"2024-09-21T02:58:15.046490+0000","last_became_peered":"2024-09-21T02:58:15.046490+0000","last_unstale":"2024-09-21T02:58:49.227754+0000","last_undegraded":"2024-09-21T02:58:49.227754+0000","last_fullsized":"2024-09-21T02:58:49.227754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:45.413510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435084+0000","last_change":"2024-09-21T02:58:15.034115+0000","last_active":"2024-09-21T02:58:49.435084+0000","last_peered":"2024-09-21T02:58:49.435084+0000","last_clean":"2024-09-21T02:58:49.435084+0000","last_became_active":"2024-09-21T02:58:15.033709+0000","last_became_peered":"2024-09-21T02:58:15.033709+0000","last_unstale":"2024-09-21T02:58:49.435084+0000","last_undegraded":"2024-09-21T02:58:49.435084+0000","last_fullsized":"2024-09-21T02:58:49.435084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:54.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227143+0000","last_change":"2024-09-21T02:58:15.047154+0000","last_active":"2024-09-21T02:58:49.227143+0000","last_peered":"2024-09-21T02:58:49.227143+0000","last_clean":"2024-09-21T02:58:49.227143+0000","last_became_active":"2024-09-21T02:58:15.046777+0000","last_became_peered":"2024-09-21T02:58:15.046777+0000","last_unstale":"2024-09-21T02:58:49.227143+0000","last_undegraded":"2024-09-21T02:58:49.227143+0000","last_fullsized":"2024-09-21T02:58:49.227143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:56.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225136+0000","last_change":"2024-09-21T02:58:15.036867+0000","last_active":"2024-09-21T02:58:49.225136+0000","last_peered":"2024-09-21T02:58:49.225136+0000","last_clean":"2024-09-21T02:58:49.225136+0000","last_became_active":"2024-09-21T02:58:15.036228+0000","last_became_peered":"2024-09-21T02:58:15.036228+0000","last_unstale":"2024-09-21T02:58:49.225136+0000","last_undegraded":"2024-09-21T02:58:49.225136+0000","last_fullsized":"2024-09-21T02:58:49.225136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:11.245917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224017+0000","last_change":"2024-09-21T02:58:15.037311+0000","last_active":"2024-09-21T02:58:49.224017+0000","last_peered":"2024-09-21T02:58:49.224017+0000","last_clean":"2024-09-21T02:58:49.224017+0000","last_became_active":"2024-09-21T02:58:15.036909+0000","last_became_peered":"2024-09-21T02:58:15.036909+0000","last_unstale":"2024-09-21T02:58:49.224017+0000","last_undegraded":"2024-09-21T02:58:49.224017+0000","last_fullsized":"2024-09-21T02:58:49.224017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:35.250000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227739+0000","last_change":"2024-09-21T02:58:15.042678+0000","last_active":"2024-09-21T02:58:49.227739+0000","last_peered":"2024-09-21T02:58:49.227739+0000","last_clean":"2024-09-21T02:58:49.227739+0000","last_became_active":"2024-09-21T02:58:15.042334+0000","last_became_peered":"2024-09-21T02:58:15.042334+0000","last_unstale":"2024-09-21T02:58:49.227739+0000","last_undegraded":"2024-09-21T02:58:49.227739+0000","last_fullsized":"2024-09-21T02:58:49.227739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:09.302354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227472+0000","last_change":"2024-09-21T02:58:15.040741+0000","last_active":"2024-09-21T02:58:49.227472+0000","last_peered":"2024-09-21T02:58:49.227472+0000","last_clean":"2024-09-21T02:58:49.227472+0000","last_became_active":"2024-09-21T02:58:15.040357+0000","last_became_peered":"2024-09-21T02:58:15.040357+0000","last_unstale":"2024-09-21T02:58:49.227472+0000","last_undegraded":"2024-09-21T02:58:49.227472+0000","last_fullsized":"2024-09-21T02:58:49.227472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979623+0000","last_change":"2024-09-21T02:58:15.029780+0000","last_active":"2024-09-21T02:58:49.979623+0000","last_peered":"2024-09-21T02:58:49.979623+0000","last_clean":"2024-09-21T02:58:49.979623+0000","last_became_active":"2024-09-21T02:58:15.029259+0000","last_became_peered":"2024-09-21T02:58:15.029259+0000","last_unstale":"2024-09-21T02:58:49.979623+0000","last_undegraded":"2024-09-21T02:58:49.979623+0000","last_fullsized":"2024-09-21T02:58:49.979623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:35.683337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979618+0000","last_change":"2024-09-21T02:58:15.040557+0000","last_active":"2024-09-21T02:58:49.979618+0000","last_peered":"2024-09-21T02:58:49.979618+0000","last_clean":"2024-09-21T02:58:49.979618+0000","last_became_active":"2024-09-21T02:58:15.040178+0000","last_became_peered":"2024-09-21T02:58:15.040178+0000","last_unstale":"2024-09-21T02:58:49.979618+0000","last_undegraded":"2024-09-21T02:58:49.979618+0000","last_fullsized":"2024-09-21T02:58:49.979618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:50.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435020+0000","last_change":"2024-09-21T02:58:15.041717+0000","last_active":"2024-09-21T02:58:49.435020+0000","last_peered":"2024-09-21T02:58:49.435020+0000","last_clean":"2024-09-21T02:58:49.435020+0000","last_became_active":"2024-09-21T02:58:15.041375+0000","last_became_peered":"2024-09-21T02:58:15.041375+0000","last_unstale":"2024-09-21T02:58:49.435020+0000","last_undegraded":"2024-09-21T02:58:49.435020+0000","last_fullsized":"2024-09-21T02:58:49.435020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:22.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226572+0000","last_change":"2024-09-21T02:58:15.042001+0000","last_active":"2024-09-21T02:58:49.226572+0000","last_peered":"2024-09-21T02:58:49.226572+0000","last_clean":"2024-09-21T02:58:49.226572+0000","last_became_active":"2024-09-21T02:58:15.038585+0000","last_became_peered":"2024-09-21T02:58:15.038585+0000","last_unstale":"2024-09-21T02:58:49.226572+0000","last_undegraded":"2024-09-21T02:58:49.226572+0000","last_fullsized":"2024-09-21T02:58:49.226572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231199+0000","last_change":"2024-09-21T02:58:15.046636+0000","last_active":"2024-09-21T02:58:49.231199+0000","last_peered":"2024-09-21T02:58:49.231199+0000","last_clean":"2024-09-21T02:58:49.231199+0000","last_became_active":"2024-09-21T02:58:15.046103+0000","last_became_peered":"2024-09-21T02:58:15.046103+0000","last_unstale":"2024-09-21T02:58:49.231199+0000","last_undegraded":"2024-09-21T02:58:49.231199+0000","last_fullsized":"2024-09-21T02:58:49.231199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.579641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225214+0000","last_change":"2024-09-21T02:58:15.045461+0000","last_active":"2024-09-21T02:58:49.225214+0000","last_peered":"2024-09-21T02:58:49.225214+0000","last_clean":"2024-09-21T02:58:49.225214+0000","last_became_active":"2024-09-21T02:58:15.045091+0000","last_became_peered":"2024-09-21T02:58:15.045091+0000","last_unstale":"2024-09-21T02:58:49.225214+0000","last_undegraded":"2024-09-21T02:58:49.225214+0000","last_fullsized":"2024-09-21T02:58:49.225214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:33.078860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229199+0000","last_change":"2024-09-21T02:58:15.042454+0000","last_active":"2024-09-21T02:58:49.229199+0000","last_peered":"2024-09-21T02:58:49.229199+0000","last_clean":"2024-09-21T02:58:49.229199+0000","last_became_active":"2024-09-21T02:58:15.042071+0000","last_became_peered":"2024-09-21T02:58:15.042071+0000","last_unstale":"2024-09-21T02:58:49.229199+0000","last_undegraded":"2024-09-21T02:58:49.229199+0000","last_fullsized":"2024-09-21T02:58:49.229199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:09.798110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227985+0000","last_change":"2024-09-21T02:58:15.039238+0000","last_active":"2024-09-21T02:58:49.227985+0000","last_peered":"2024-09-21T02:58:49.227985+0000","last_clean":"2024-09-21T02:58:49.227985+0000","last_became_active":"2024-09-21T02:58:15.037883+0000","last_became_peered":"2024-09-21T02:58:15.037883+0000","last_unstale":"2024-09-21T02:58:49.227985+0000","last_undegraded":"2024-09-21T02:58:49.227985+0000","last_fullsized":"2024-09-21T02:58:49.227985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:13.418696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230871+0000","last_change":"2024-09-21T02:58:15.040236+0000","last_active":"2024-09-21T02:58:49.230871+0000","last_peered":"2024-09-21T02:58:49.230871+0000","last_clean":"2024-09-21T02:58:49.230871+0000","last_became_active":"2024-09-21T02:58:15.039895+0000","last_became_peered":"2024-09-21T02:58:15.039895+0000","last_unstale":"2024-09-21T02:58:49.230871+0000","last_undegraded":"2024-09-21T02:58:49.230871+0000","last_fullsized":"2024-09-21T02:58:49.230871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:48.099127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224435+0000","last_change":"2024-09-21T02:58:15.044804+0000","last_active":"2024-09-21T02:58:49.224435+0000","last_peered":"2024-09-21T02:58:49.224435+0000","last_clean":"2024-09-21T02:58:49.224435+0000","last_became_active":"2024-09-21T02:58:15.044446+0000","last_became_peered":"2024-09-21T02:58:15.044446+0000","last_unstale":"2024-09-21T02:58:49.224435+0000","last_undegraded":"2024-09-21T02:58:49.224435+0000","last_fullsized":"2024-09-21T02:58:49.224435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:37.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230509+0000","last_change":"2024-09-21T02:58:15.034219+0000","last_active":"2024-09-21T02:58:49.230509+0000","last_peered":"2024-09-21T02:58:49.230509+0000","last_clean":"2024-09-21T02:58:49.230509+0000","last_became_active":"2024-09-21T02:58:15.033775+0000","last_became_peered":"2024-09-21T02:58:15.033775+0000","last_unstale":"2024-09-21T02:58:49.230509+0000","last_undegraded":"2024-09-21T02:58:49.230509+0000","last_fullsized":"2024-09-21T02:58:49.230509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:12.534737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231688+0000","last_change":"2024-09-21T02:58:49.231259+0000","last_active":"2024-09-21T02:58:49.231688+0000","last_peered":"2024-09-21T02:58:49.231688+0000","last_clean":"2024-09-21T02:58:49.231688+0000","last_became_active":"2024-09-21T02:58:49.230867+0000","last_became_peered":"2024-09-21T02:58:49.230867+0000","last_unstale":"2024-09-21T02:58:49.231688+0000","last_undegraded":"2024-09-21T02:58:49.231688+0000","last_fullsized":"2024-09-21T02:58:49.231688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:11.163458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979870+0000","last_change":"2024-09-21T02:58:15.037273+0000","last_active":"2024-09-21T02:58:49.979870+0000","last_peered":"2024-09-21T02:58:49.979870+0000","last_clean":"2024-09-21T02:58:49.979870+0000","last_became_active":"2024-09-21T02:58:15.036879+0000","last_became_peered":"2024-09-21T02:58:15.036879+0000","last_unstale":"2024-09-21T02:58:49.979870+0000","last_undegraded":"2024-09-21T02:58:49.979870+0000","last_fullsized":"2024-09-21T02:58:49.979870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:50.721998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980003+0000","last_change":"2024-09-21T02:58:15.035716+0000","last_active":"2024-09-21T02:58:49.980003+0000","last_peered":"2024-09-21T02:58:49.980003+0000","last_clean":"2024-09-21T02:58:49.980003+0000","last_became_active":"2024-09-21T02:58:15.035356+0000","last_became_peered":"2024-09-21T02:58:15.035356+0000","last_unstale":"2024-09-21T02:58:49.980003+0000","last_undegraded":"2024-09-21T02:58:49.980003+0000","last_fullsized":"2024-09-21T02:58:49.980003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227675+0000","last_change":"2024-09-21T02:58:15.041737+0000","last_active":"2024-09-21T02:58:49.227675+0000","last_peered":"2024-09-21T02:58:49.227675+0000","last_clean":"2024-09-21T02:58:49.227675+0000","last_became_active":"2024-09-21T02:58:15.041387+0000","last_became_peered":"2024-09-21T02:58:15.041387+0000","last_unstale":"2024-09-21T02:58:49.227675+0000","last_undegraded":"2024-09-21T02:58:49.227675+0000","last_fullsized":"2024-09-21T02:58:49.227675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.893510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64810,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":157,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281500,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":462290,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972380,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":1110758,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":466622,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332134,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":462446,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495659,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1058355,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":457702,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855413,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":1053552,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":462743,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215167,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":457896,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":506443,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":518421,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":459090,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:59:10.425 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:59:10.426 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T02:59:10.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T02:59:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:10.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:10 smithi164 ceph-mon[34236]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:10.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:10 smithi181 ceph-mon[34096]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 -- 172.21.15.81:0/1417476839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c1047e0 msgr2=0x7f253c104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 --2- 172.21.15.81:0/1417476839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c1047e0 0x7f253c104bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2530009900 tx=0x7f253002a480 comp rx=0 tx=0).stop 2024-09-21T02:59:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 -- 172.21.15.81:0/1417476839 shutdown_connections 2024-09-21T02:59:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 --2- 172.21.15.81:0/1417476839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c105180 0x7f253c10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 --2- 172.21.15.81:0/1417476839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c1047e0 0x7f253c104bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 --2- 172.21.15.81:0/1417476839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f253c103750 0x7f253c103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 -- 172.21.15.81:0/1417476839 >> 172.21.15.81:0/1417476839 conn(0x7f253c0ff0e0 msgr2=0x7f253c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 -- 172.21.15.81:0/1417476839 shutdown_connections 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.192+0000 7f2541bea640 1 -- 172.21.15.81:0/1417476839 wait complete. 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 Processor -- start 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 -- start start 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c103750 0x7f253c199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f253c1047e0 0x7f253c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c105180 0x7f253c19b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f253c10f250 con 0x7f253c105180 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f253c10f0d0 con 0x7f253c1047e0 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f2541bea640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f253c10f3d0 con 0x7f253c103750 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f253bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c105180 0x7f253c19b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:11.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c103750 0x7f253c199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f253bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c105180 0x7f253c19b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57274/0 (socket says 172.21.15.81:57274) 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f253affd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f253c1047e0 0x7f253c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f253bfff640 1 -- 172.21.15.81:0/605787517 learned_addr learned my addr 172.21.15.81:0/605787517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.193+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c103750 0x7f253c199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:53410/0 (socket says 172.21.15.81:53410) 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f253b7fe640 1 -- 172.21.15.81:0/605787517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f253c1047e0 msgr2=0x7f253c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f253b7fe640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f253c1047e0 0x7f253c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f253b7fe640 1 -- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c105180 msgr2=0x7f253c19b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f253b7fe640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c105180 0x7f253c19b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f253b7fe640 1 -- 172.21.15.81:0/605787517 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c19b8e0 con 0x7f253c103750 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f253bfff640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c105180 0x7f253c19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f253b7fe640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c103750 0x7f253c199eb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f252c005fd0 tx=0x7f252c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f2538ff9640 1 -- 172.21.15.81:0/605787517 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c009c30 con 0x7f253c103750 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c19bbd0 con 0x7f253c103750 2024-09-21T02:59:11.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f2538ff9640 1 -- 172.21.15.81:0/605787517 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f252c0044c0 con 0x7f253c103750 2024-09-21T02:59:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f2538ff9640 1 -- 172.21.15.81:0/605787517 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c003d70 con 0x7f253c103750 2024-09-21T02:59:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.194+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c1a22d0 con 0x7f253c103750 2024-09-21T02:59:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.196+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c103bc0 con 0x7f253c103750 2024-09-21T02:59:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.197+0000 7f2538ff9640 1 -- 172.21.15.81:0/605787517 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f252c004000 con 0x7f253c103750 2024-09-21T02:59:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.198+0000 7f2538ff9640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25240b65a0 0x7f25240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.198+0000 7f2538ff9640 1 -- 172.21.15.81:0/605787517 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f252c0e76a0 con 0x7f253c103750 2024-09-21T02:59:11.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.198+0000 7f253affd640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25240b65a0 0x7f25240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:11.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.198+0000 7f253affd640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25240b65a0 0x7f25240b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f25300057c0 tx=0x7f2530000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:11.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.201+0000 7f2538ff9640 1 -- 172.21.15.81:0/605787517 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f252c017020 con 0x7f253c103750 2024-09-21T02:59:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.469+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f253c02e640 con 0x7f253c103750 2024-09-21T02:59:11.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:11 smithi081 ceph-mon[30991]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-09-21T02:59:11.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:11 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:59:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.478+0000 7f2538ff9640 1 -- 172.21.15.81:0/605787517 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f252c0b1e50 con 0x7f253c103750 2024-09-21T02:59:11.480 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T02:59:11.480 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB/Nu5mIpkiHBAAoN0zD5WTe1pPlCzbsmu2xA== 2024-09-21T02:59:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25240b65a0 msgr2=0x7f25240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25240b65a0 0x7f25240b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f25300057c0 tx=0x7f2530000bc0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c103750 msgr2=0x7f253c199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c103750 0x7f253c199eb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f252c005fd0 tx=0x7f252c00dde0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 shutdown_connections 2024-09-21T02:59:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25240b65a0 0x7f25240b8ab0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253c105180 0x7f253c19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f253c1047e0 0x7f253c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 --2- 172.21.15.81:0/605787517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f253c103750 0x7f253c199eb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 >> 172.21.15.81:0/605787517 conn(0x7f253c0ff0e0 msgr2=0x7f253c107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 shutdown_connections 2024-09-21T02:59:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:11.481+0000 7f2541bea640 1 -- 172.21.15.81:0/605787517 wait complete. 2024-09-21T02:59:11.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:11 smithi181 ceph-mon[34096]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-09-21T02:59:11.640 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:11 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:59:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:11 smithi164 ceph-mon[34236]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-09-21T02:59:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:11 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:59:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:12 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/605787517' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:59:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:12 smithi081 ceph-mon[30991]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:59:12.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:12 smithi081 ceph-mon[30991]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:59:12.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:12 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/605787517' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:59:12.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:12 smithi164 ceph-mon[34236]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:59:12.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:12 smithi164 ceph-mon[34236]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:59:12.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:12 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/605787517' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:59:12.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:12 smithi181 ceph-mon[34096]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:59:12.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:12 smithi181 ceph-mon[34096]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:59:12.887 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T02:59:12.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T02:59:12.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T02:59:12.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T02:59:13.236 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:13.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:13 smithi081 ceph-mon[30991]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T02:59:13.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:13 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:13 smithi181 ceph-mon[34096]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T02:59:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:13 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 -- 172.21.15.81:0/463711308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0441021f0 msgr2=0x7fd044102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/463711308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0441021f0 0x7fd044102600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd034009ca0 tx=0x7fd03402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 -- 172.21.15.81:0/463711308 shutdown_connections 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/463711308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd044108480 0x7fd04410ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/463711308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd044107b30 0x7fd044107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/463711308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0441021f0 0x7fd044102600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 -- 172.21.15.81:0/463711308 >> 172.21.15.81:0/463711308 conn(0x7fd044077c60 msgr2=0x7fd0440780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 -- 172.21.15.81:0/463711308 shutdown_connections 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.734+0000 7fd04b1fb640 1 -- 172.21.15.81:0/463711308 wait complete. 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 Processor -- start 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 -- start start 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0441021f0 0x7fd04419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd044107b30 0x7fd04419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd044108480 0x7fd04419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0441139d0 con 0x7fd044107b30 2024-09-21T02:59:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd044113850 con 0x7fd0441021f0 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd04b1fb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd044113b50 con 0x7fd044108480 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd044107b30 0x7fd04419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd044107b30 0x7fd04419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54420/0 (socket says 172.21.15.81:54420) 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 -- 172.21.15.81:0/3813092691 learned_addr learned my addr 172.21.15.81:0/3813092691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd048f97640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0441021f0 0x7fd04419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 -- 172.21.15.81:0/3813092691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd044108480 msgr2=0x7fd04419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd044108480 0x7fd04419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 -- 172.21.15.81:0/3813092691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0441021f0 msgr2=0x7fd04419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0441021f0 0x7fd04419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd043fff640 1 -- 172.21.15.81:0/3813092691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0441a02b0 con 0x7fd044107b30 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.735+0000 7fd048f97640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0441021f0 0x7fd04419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.736+0000 7fd043fff640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd044107b30 0x7fd04419a9a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c8c0 tx=0x7fd03800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.736+0000 7fd041ffb640 1 -- 172.21.15.81:0/3813092691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038007bb0 con 0x7fd044107b30 2024-09-21T02:59:13.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.736+0000 7fd041ffb640 1 -- 172.21.15.81:0/3813092691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd038007d50 con 0x7fd044107b30 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.736+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0441a05a0 con 0x7fd044107b30 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.736+0000 7fd041ffb640 1 -- 172.21.15.81:0/3813092691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038018660 con 0x7fd044107b30 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.736+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0441a6dc0 con 0x7fd044107b30 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.737+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd044102600 con 0x7fd044107b30 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.739+0000 7fd041ffb640 1 -- 172.21.15.81:0/3813092691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd03800fa00 con 0x7fd044107b30 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.739+0000 7fd041ffb640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd02c0b65d0 0x7fd02c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.739+0000 7fd048f97640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd02c0b65d0 0x7fd02c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.740+0000 7fd041ffb640 1 -- 172.21.15.81:0/3813092691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fd0380e7940 con 0x7fd044107b30 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.740+0000 7fd048f97640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd02c0b65d0 0x7fd02c0b8ae0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd034006010 tx=0x7fd034000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:13.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.744+0000 7fd041ffb640 1 -- 172.21.15.81:0/3813092691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd038014030 con 0x7fd044107b30 2024-09-21T02:59:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.924+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fd04402e640 con 0x7fd044107b30 2024-09-21T02:59:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.925+0000 7fd041ffb640 1 -- 172.21.15.81:0/3813092691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7fd0380add30 con 0x7fd044107b30 2024-09-21T02:59:13.927 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd02c0b65d0 msgr2=0x7fd02c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd02c0b65d0 0x7fd02c0b8ae0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd034006010 tx=0x7fd034000f40 comp rx=0 tx=0).stop 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd044107b30 msgr2=0x7fd04419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd044107b30 0x7fd04419a9a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c8c0 tx=0x7fd03800cd80 comp rx=0 tx=0).stop 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 shutdown_connections 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd02c0b65d0 0x7fd02c0b8ae0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd044108480 0x7fd04419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd044107b30 0x7fd04419a9a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 --2- 172.21.15.81:0/3813092691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0441021f0 0x7fd04419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:13.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 >> 172.21.15.81:0/3813092691 conn(0x7fd044077c60 msgr2=0x7fd044105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 shutdown_connections 2024-09-21T02:59:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:13.929+0000 7fd04b1fb640 1 -- 172.21.15.81:0/3813092691 wait complete. 2024-09-21T02:59:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:13 smithi164 ceph-mon[34236]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T02:59:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:13.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:13 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:14.641 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":54,"timestamp":"2024-09-21T02:58:05.362668+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T02:59:14.641 INFO:tasks.ceph_manager:config epoch is 54 2024-09-21T02:59:14.641 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T02:59:14.641 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T02:59:14.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T02:59:14.665 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:59:14.665 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:59:14.665 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:14.665 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:14 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3813092691' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:59:14.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:14 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:59:14.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:14 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:59:14.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:14 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:14.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:14 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3813092691' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:59:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:14.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:14 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:59:14.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:14 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:59:14.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:14 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T02:59:14.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:14 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3813092691' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:59:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 -- 172.21.15.81:0/1567136921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb481094a0 msgr2=0x7ffb481098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 --2- 172.21.15.81:0/1567136921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb481094a0 0x7ffb481098b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb4402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 -- 172.21.15.81:0/1567136921 shutdown_connections 2024-09-21T02:59:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 --2- 172.21.15.81:0/1567136921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb48109df0 0x7ffb48110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 --2- 172.21.15.81:0/1567136921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb481094a0 0x7ffb481098b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 --2- 172.21.15.81:0/1567136921 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb48103b60 0x7ffb48103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 -- 172.21.15.81:0/1567136921 >> 172.21.15.81:0/1567136921 conn(0x7ffb4807b850 msgr2=0x7ffb4807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 -- 172.21.15.81:0/1567136921 shutdown_connections 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.415+0000 7ffb503af640 1 -- 172.21.15.81:0/1567136921 wait complete. 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 Processor -- start 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 -- start start 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb48103b60 0x7ffb4819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb481094a0 0x7ffb4819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb48109df0 0x7ffb4819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48113960 con 0x7ffb48103b60 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ffb481137e0 con 0x7ffb48109df0 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb503af640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48113ae0 con 0x7ffb481094a0 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb4e14b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb48103b60 0x7ffb4819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb4e14b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb48103b60 0x7ffb4819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54436/0 (socket says 172.21.15.81:54436) 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb4e14b640 1 -- 172.21.15.81:0/1202341982 learned_addr learned my addr 172.21.15.81:0/1202341982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb4d94a640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb481094a0 0x7ffb4819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.416+0000 7ffb4e94c640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb48109df0 0x7ffb4819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb4e14b640 1 -- 172.21.15.81:0/1202341982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb481094a0 msgr2=0x7ffb4819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb4e14b640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb481094a0 0x7ffb4819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb4e14b640 1 -- 172.21.15.81:0/1202341982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb48109df0 msgr2=0x7ffb4819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb4e14b640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb48109df0 0x7ffb4819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb4e14b640 1 -- 172.21.15.81:0/1202341982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb481a02c0 con 0x7ffb48103b60 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb4e94c640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb48109df0 0x7ffb4819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb4e14b640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb48103b60 0x7ffb4819a410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c970 tx=0x7ffb3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb3f7fe640 1 -- 172.21.15.81:0/1202341982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38007bb0 con 0x7ffb48103b60 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb3f7fe640 1 -- 172.21.15.81:0/1202341982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb38007d50 con 0x7ffb48103b60 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb3f7fe640 1 -- 172.21.15.81:0/1202341982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38004e40 con 0x7ffb48103b60 2024-09-21T02:59:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb481a05b0 con 0x7ffb48103b60 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.417+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb481a0a70 con 0x7ffb48103b60 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.418+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb48103f70 con 0x7ffb48103b60 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.419+0000 7ffb3f7fe640 1 -- 172.21.15.81:0/1202341982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ffb38005000 con 0x7ffb48103b60 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.420+0000 7ffb3f7fe640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffb340b6650 0x7ffb340b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.420+0000 7ffb4d94a640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffb340b6650 0x7ffb340b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.420+0000 7ffb3f7fe640 1 -- 172.21.15.81:0/1202341982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ffb380e7830 con 0x7ffb48103b60 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.421+0000 7ffb4d94a640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffb340b6650 0x7ffb340b8b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb44005940 tx=0x7ffb440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.423+0000 7ffb3f7fe640 1 -- 172.21.15.81:0/1202341982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb38014030 con 0x7ffb48103b60 2024-09-21T02:59:15.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.651+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ffb4819b540 con 0x7ffb48103b60 2024-09-21T02:59:15.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.657+0000 7ffb3f7fe640 1 -- 172.21.15.81:0/1202341982 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296437 (secure 0 0 0) 0x7ffb4819b540 con 0x7ffb48103b60 2024-09-21T02:59:15.662 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:15.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffb340b6650 msgr2=0x7ffb340b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffb340b6650 0x7ffb340b8b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb44005940 tx=0x7ffb440058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb48103b60 msgr2=0x7ffb4819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb48103b60 0x7ffb4819a410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c970 tx=0x7ffb3800ce30 comp rx=0 tx=0).stop 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 shutdown_connections 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffb340b6650 0x7ffb340b8b60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb481094a0 0x7ffb4819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb48109df0 0x7ffb4819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 --2- 172.21.15.81:0/1202341982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb48103b60 0x7ffb4819a410 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 >> 172.21.15.81:0/1202341982 conn(0x7ffb4807b850 msgr2=0x7ffb481055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 shutdown_connections 2024-09-21T02:59:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:15.661+0000 7ffb503af640 1 -- 172.21.15.81:0/1202341982 wait complete. 2024-09-21T02:59:15.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:15 smithi164 ceph-mon[34236]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-21T02:59:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:15 smithi181 ceph-mon[34096]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-21T02:59:16.020 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:15 smithi081 ceph-mon[30991]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-21T02:59:16.419 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3007447899},{"type":"v1","addr":"172.21.15.81:6801","nonce":3007447899}]},"active_addr":"172.21.15.81:6801/3007447899","active_change":"2024-09-21T02:50:47.609687+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.81:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1881792293}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1032110273}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":361619384}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1851444584}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2700524427}]}]} 2024-09-21T02:59:16.426 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T02:59:16.426 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T02:59:16.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:59:16.676 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:16.908 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:16 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1202341982' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:59:16.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:16 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1202341982' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:59:16.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:16 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1202341982' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:59:17.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 -- 172.21.15.81:0/2912525997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 msgr2=0x7fa3081106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:17.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 --2- 172.21.15.81:0/2912525997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa3081106e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa300009ca0 tx=0x7fa30002a8e0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 -- 172.21.15.81:0/2912525997 shutdown_connections 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 --2- 172.21.15.81:0/2912525997 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa308109560 0x7fa308109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 --2- 172.21.15.81:0/2912525997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa3081106e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 --2- 172.21.15.81:0/2912525997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa308102080 0x7fa308102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 -- 172.21.15.81:0/2912525997 >> 172.21.15.81:0/2912525997 conn(0x7fa308079ec0 msgr2=0x7fa30807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 -- 172.21.15.81:0/2912525997 shutdown_connections 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.137+0000 7fa310084640 1 -- 172.21.15.81:0/2912525997 wait complete. 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 Processor -- start 2024-09-21T02:59:17.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 -- start start 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa308102080 0x7fa308103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa308109560 0x7fa308103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa308103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa308113a60 con 0x7fa308109eb0 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa3081138e0 con 0x7fa308102080 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa310084640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa308113be0 con 0x7fa308109560 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.138+0000 7fa30e621640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa308103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa308103aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54448/0 (socket says 172.21.15.81:54448) 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 -- 172.21.15.81:0/2213015288 learned_addr learned my addr 172.21.15.81:0/2213015288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30de20640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa308102080 0x7fa308103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30d61f640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa308109560 0x7fa308103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 -- 172.21.15.81:0/2213015288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa308109560 msgr2=0x7fa308103560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa308109560 0x7fa308103560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 -- 172.21.15.81:0/2213015288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa308102080 msgr2=0x7fa308103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa308102080 0x7fa308103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 -- 172.21.15.81:0/2213015288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3081a86f0 con 0x7fa308109eb0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa30e621640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa308103aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa300006010 tx=0x7fa300003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa2faffd640 1 -- 172.21.15.81:0/2213015288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300004240 con 0x7fa308109eb0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa2faffd640 1 -- 172.21.15.81:0/2213015288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3000305e0 con 0x7fa308109eb0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3081a8980 con 0x7fa308109eb0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa2faffd640 1 -- 172.21.15.81:0/2213015288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30003b660 con 0x7fa308109eb0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.139+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3081a8ec0 con 0x7fa308109eb0 2024-09-21T02:59:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.140+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa308102490 con 0x7fa308109eb0 2024-09-21T02:59:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.142+0000 7fa2faffd640 1 -- 172.21.15.81:0/2213015288 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa300030790 con 0x7fa308109eb0 2024-09-21T02:59:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.142+0000 7fa2faffd640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa2f40b65a0 0x7fa2f40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.143+0000 7fa30de20640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa2f40b65a0 0x7fa2f40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.143+0000 7fa2faffd640 1 -- 172.21.15.81:0/2213015288 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fa300108ca0 con 0x7fa308109eb0 2024-09-21T02:59:17.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.143+0000 7fa30de20640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa2f40b65a0 0x7fa2f40b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0058c0 tx=0x7fa2fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.146+0000 7fa2faffd640 1 -- 172.21.15.81:0/2213015288 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3000cf090 con 0x7fa308109eb0 2024-09-21T02:59:17.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.325+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa30802e640 con 0x7fa308109eb0 2024-09-21T02:59:17.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.326+0000 7fa2faffd640 1 -- 172.21.15.81:0/2213015288 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7fa3000d3470 con 0x7fa308109eb0 2024-09-21T02:59:17.329 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:17.329 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:59:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa2f40b65a0 msgr2=0x7fa2f40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa2f40b65a0 0x7fa2f40b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0058c0 tx=0x7fa2fc00a2d0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 msgr2=0x7fa308103aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa308103aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa300006010 tx=0x7fa300003c90 comp rx=0 tx=0).stop 2024-09-21T02:59:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 shutdown_connections 2024-09-21T02:59:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa2f40b65a0 0x7fa2f40b8ab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa308109560 0x7fa308103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa308109eb0 0x7fa308103aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 --2- 172.21.15.81:0/2213015288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa308102080 0x7fa308103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:17.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.328+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 >> 172.21.15.81:0/2213015288 conn(0x7fa308079ec0 msgr2=0x7fa3081075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:17.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.329+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 shutdown_connections 2024-09-21T02:59:17.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:17.329+0000 7fa310084640 1 -- 172.21.15.81:0/2213015288 wait complete. 2024-09-21T02:59:17.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:17 smithi164 ceph-mon[34236]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2024-09-21T02:59:17.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:17 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2213015288' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:17.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:17 smithi081 ceph-mon[30991]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2024-09-21T02:59:17.989 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:17 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2213015288' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:17.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:17 smithi181 ceph-mon[34096]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2024-09-21T02:59:17.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:17 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2213015288' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:18.019 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T02:59:18.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:59:18.268 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 -- 172.21.15.81:0/948321125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c102ae0 msgr2=0x7fac2c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 --2- 172.21.15.81:0/948321125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c102ae0 0x7fac2c102ef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009900 tx=0x7fac1c02a410 comp rx=0 tx=0).stop 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 -- 172.21.15.81:0/948321125 shutdown_connections 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 --2- 172.21.15.81:0/948321125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac2c108420 0x7fac2c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 --2- 172.21.15.81:0/948321125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c108d70 0x7fac2c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 --2- 172.21.15.81:0/948321125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c102ae0 0x7fac2c102ef0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 -- 172.21.15.81:0/948321125 >> 172.21.15.81:0/948321125 conn(0x7fac2c079770 msgr2=0x7fac2c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 -- 172.21.15.81:0/948321125 shutdown_connections 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.748+0000 7fac32140640 1 -- 172.21.15.81:0/948321125 wait complete. 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 Processor -- start 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 -- start start 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac2c102ae0 0x7fac2c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c108420 0x7fac2c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c108d70 0x7fac2c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c1129a0 con 0x7fac2c108d70 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c112820 con 0x7fac2c108420 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac32140640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c112b20 con 0x7fac2c102ae0 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c108d70 0x7fac2c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac2bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c108d70 0x7fac2c19bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54466/0 (socket says 172.21.15.81:54466) 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac2bfff640 1 -- 172.21.15.81:0/1334675839 learned_addr learned my addr 172.21.15.81:0/1334675839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.749+0000 7fac2b7fe640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac2c102ae0 0x7fac2c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2bfff640 1 -- 172.21.15.81:0/1334675839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac2c102ae0 msgr2=0x7fac2c19b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2affd640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c108420 0x7fac2c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2bfff640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac2c102ae0 0x7fac2c19b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2bfff640 1 -- 172.21.15.81:0/1334675839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c108420 msgr2=0x7fac2c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2bfff640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c108420 0x7fac2c19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2bfff640 1 -- 172.21.15.81:0/1334675839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c1a6610 con 0x7fac2c108d70 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2b7fe640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac2c102ae0 0x7fac2c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac2bfff640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c108d70 0x7fac2c19bdd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fac2400b970 tx=0x7fac2400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac28ff9640 1 -- 172.21.15.81:0/1334675839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24019070 con 0x7fac2c108d70 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac28ff9640 1 -- 172.21.15.81:0/1334675839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac24014440 con 0x7fac2c108d70 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac28ff9640 1 -- 172.21.15.81:0/1334675839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac240075d0 con 0x7fac2c108d70 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2c1a6900 con 0x7fac2c108d70 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.750+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2c1a6ec0 con 0x7fac2c108d70 2024-09-21T02:59:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.751+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2c103d60 con 0x7fac2c108d70 2024-09-21T02:59:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.753+0000 7fac28ff9640 1 -- 172.21.15.81:0/1334675839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fac2401c070 con 0x7fac2c108d70 2024-09-21T02:59:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.754+0000 7fac28ff9640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac140b6620 0x7fac140b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.754+0000 7fac2b7fe640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac140b6620 0x7fac140b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.754+0000 7fac28ff9640 1 -- 172.21.15.81:0/1334675839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fac240e7150 con 0x7fac2c108d70 2024-09-21T02:59:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.755+0000 7fac2b7fe640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac140b6620 0x7fac140b8b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fac1c006010 tx=0x7fac1c0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.757+0000 7fac28ff9640 1 -- 172.21.15.81:0/1334675839 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac240ad540 con 0x7fac2c108d70 2024-09-21T02:59:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.936+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac2c06bf90 con 0x7fac2c108d70 2024-09-21T02:59:18.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.937+0000 7fac28ff9640 1 -- 172.21.15.81:0/1334675839 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7fac240b1920 con 0x7fac2c108d70 2024-09-21T02:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:18.939 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:59:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac140b6620 msgr2=0x7fac140b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac140b6620 0x7fac140b8b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fac1c006010 tx=0x7fac1c0058b0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c108d70 msgr2=0x7fac2c19bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c108d70 0x7fac2c19bdd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fac2400b970 tx=0x7fac2400be30 comp rx=0 tx=0).stop 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 shutdown_connections 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fac140b6620 0x7fac140b8b30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac2c108d70 0x7fac2c19bdd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c108420 0x7fac2c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 --2- 172.21.15.81:0/1334675839 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac2c102ae0 0x7fac2c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 >> 172.21.15.81:0/1334675839 conn(0x7fac2c079770 msgr2=0x7fac2c1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 shutdown_connections 2024-09-21T02:59:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:18.940+0000 7fac32140640 1 -- 172.21.15.81:0/1334675839 wait complete. 2024-09-21T02:59:19.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T02:59:19.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T02:59:19.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T02:59:19.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T02:59:19.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T02:59:19.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T02:59:19.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T02:59:19.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T02:59:19.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T02:59:19.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T02:59:19.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T02:59:19.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T02:59:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:19 smithi164 ceph-mon[34236]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:59:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:19 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1334675839' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:19.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:19 smithi181 ceph-mon[34096]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:59:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:19 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1334675839' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:19 smithi081 ceph-mon[30991]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:59:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:19 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1334675839' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:20.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/1420852564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109500 msgr2=0x7f0bd4109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 --2- 172.21.15.81:0/1420852564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109500 0x7f0bd4109910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009900 tx=0x7f0bc802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/1420852564 shutdown_connections 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 --2- 172.21.15.81:0/1420852564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd4109e50 0x7f0bd4110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 --2- 172.21.15.81:0/1420852564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109500 0x7f0bd4109910 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 --2- 172.21.15.81:0/1420852564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd4101fc0 0x7f0bd41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/1420852564 >> 172.21.15.81:0/1420852564 conn(0x7f0bd4079f90 msgr2=0x7f0bd407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/1420852564 shutdown_connections 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.918+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/1420852564 wait complete. 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 Processor -- start 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 -- start start 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd4101fc0 0x7f0bd419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:20.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd4109500 0x7f0bd419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109e50 0x7f0bd419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41139c0 con 0x7f0bd4109e50 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4113840 con 0x7f0bd4101fc0 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd9b5a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4113b40 con 0x7f0bd4109500 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109e50 0x7f0bd419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109e50 0x7f0bd419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54486/0 (socket says 172.21.15.81:54486) 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd3fff640 1 -- 172.21.15.81:0/3074848168 learned_addr learned my addr 172.21.15.81:0/3074848168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd2ffd640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd4109500 0x7f0bd419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.919+0000 7f0bd37fe640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd4101fc0 0x7f0bd419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd3fff640 1 -- 172.21.15.81:0/3074848168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd4109500 msgr2=0x7f0bd419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd3fff640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0bd4109500 0x7f0bd419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd3fff640 1 -- 172.21.15.81:0/3074848168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd4101fc0 msgr2=0x7f0bd419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd3fff640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bd4101fc0 0x7f0bd419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd3fff640 1 -- 172.21.15.81:0/3074848168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd41a02a0 con 0x7f0bd4109e50 2024-09-21T02:59:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd3fff640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109e50 0x7f0bd419fc30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00eaa0 tx=0x7f0bcc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc004d20 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd41a0590 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bcc005020 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0116d0 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.920+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd41a0a50 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.921+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bd4063b50 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.922+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0bcc0051d0 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.923+0000 7f0bd0ff9640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0bbc0b65d0 0x7f0bbc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.923+0000 7f0bd37fe640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0bbc0b65d0 0x7f0bbc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.923+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f0bcc0e7d10 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.923+0000 7f0bd0ff9640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] conn(0x7f0bbc0c1660 0x7f0bbc0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.923+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 --> [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bcc018ec0 con 0x7f0bbc0c1660 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.923+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0bcc0e8160 con 0x7f0bd4109e50 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.924+0000 7f0bd2ffd640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] conn(0x7f0bbc0c1660 0x7f0bbc0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.924+0000 7f0bd37fe640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0bbc0b65d0 0x7f0bbc0b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400abe0 tx=0x7f0bc400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.924+0000 7f0bd2ffd640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] conn(0x7f0bbc0c1660 0x7f0bbc0c3b50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.925+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== osd.0 v2:172.21.15.81:6802/2217822752 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bcc018ec0 con 0x7f0bbc0c1660 2024-09-21T02:59:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.939+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 --> [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bd4063f50 con 0x7f0bbc0c1660 2024-09-21T02:59:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.939+0000 7f0bd0ff9640 1 -- 172.21.15.81:0/3074848168 <== osd.0 v2:172.21.15.81:6802/2217822752 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0bd4063f50 con 0x7f0bbc0c1660 2024-09-21T02:59:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] conn(0x7f0bbc0c1660 msgr2=0x7f0bbc0c3b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] conn(0x7f0bbc0c1660 0x7f0bbc0c3b50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0bbc0b65d0 msgr2=0x7f0bbc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0bbc0b65d0 0x7f0bbc0b8ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400abe0 tx=0x7f0bc400a2d0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109e50 msgr2=0x7f0bd419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 --2- 172.21.15.81:0/3074848168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd4109e50 0x7f0bd419fc30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00eaa0 tx=0x7f0bcc00eea0 comp rx=0 tx=0).stop 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd3fff640 1 -- 172.21.15.81:0/3074848168 reap_dead start 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 shutdown_connections 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 >> 172.21.15.81:0/3074848168 conn(0x7f0bd4079f90 msgr2=0x7f0bd4107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 shutdown_connections 2024-09-21T02:59:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:20.940+0000 7f0bd9b5a640 1 -- 172.21.15.81:0/3074848168 wait complete. 2024-09-21T02:59:21.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:21 smithi081 ceph-mon[30991]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:59:21.899 INFO:teuthology.orchestra.run.smithi081.stdout:34359738450 2024-09-21T02:59:21.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T02:59:21.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:21 smithi164 ceph-mon[34236]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:59:21.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:21 smithi181 ceph-mon[34096]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:59:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 -- 172.21.15.81:0/2547498857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 msgr2=0x7fc00c10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 --2- 172.21.15.81:0/2547498857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 0x7fc00c10d8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009900 tx=0x7fbff402a410 comp rx=0 tx=0).stop 2024-09-21T02:59:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 -- 172.21.15.81:0/2547498857 shutdown_connections 2024-09-21T02:59:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 --2- 172.21.15.81:0/2547498857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00c10de30 0x7fc00c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 --2- 172.21.15.81:0/2547498857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 0x7fc00c10d8f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 --2- 172.21.15.81:0/2547498857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc00c104880 0x7fc00c104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 -- 172.21.15.81:0/2547498857 >> 172.21.15.81:0/2547498857 conn(0x7fc00c0797e0 msgr2=0x7fc00c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 -- 172.21.15.81:0/2547498857 shutdown_connections 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.170+0000 7fc011fb9640 1 -- 172.21.15.81:0/2547498857 wait complete. 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.171+0000 7fc011fb9640 1 Processor -- start 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.171+0000 7fc011fb9640 1 -- start start 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.171+0000 7fc011fb9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00c104880 0x7fc00c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.171+0000 7fc011fb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 0x7fc00c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.171+0000 7fc011fb9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc00c10de30 0x7fc00c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc011fb9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c113960 con 0x7fc00c1052b0 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc011fb9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c1137e0 con 0x7fc00c10de30 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc011fb9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c113ae0 con 0x7fc00c104880 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 0x7fc00c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 0x7fc00c19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34796/0 (socket says 172.21.15.81:34796) 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 -- 172.21.15.81:0/2889925926 learned_addr learned my addr 172.21.15.81:0/2889925926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc00b7fe640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00c104880 0x7fc00c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc00bfff640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc00c10de30 0x7fc00c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 -- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00c104880 msgr2=0x7fc00c19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc00c104880 0x7fc00c19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 -- 172.21.15.81:0/2889925926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc00c10de30 msgr2=0x7fc00c19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc00c10de30 0x7fc00c19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 -- 172.21.15.81:0/2889925926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c1a0320 con 0x7fc00c1052b0 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc002ffd640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 0x7fc00c19a950 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbff4004770 tx=0x7fbff4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff403f030 con 0x7fc00c1052b0 2024-09-21T02:59:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbff4004440 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c1a05b0 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4035070 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.172+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c1a6d70 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.173+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc00c063b50 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.175+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbff4042030 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc0097fa640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbff80b6620 0x7fbff80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc00b7fe640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbff80b6620 0x7fbff80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fbff41080c0 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc0097fa640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] conn(0x7fbff80c16b0 0x7fbff80c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 --> [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbff80c4270 con 0x7fbff80c16b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fbff4108510 con 0x7fc00c1052b0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc00b7fe640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbff80b6620 0x7fbff80b8b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc00c06c5c0 tx=0x7fbffc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:22.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.176+0000 7fc00bfff640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] conn(0x7fbff80c16b0 0x7fbff80c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.177+0000 7fc00bfff640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] conn(0x7fbff80c16b0 0x7fbff80c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.178+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== osd.2 v2:172.21.15.181:6800/1768571017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbff80c4270 con 0x7fbff80c16b0 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.191+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 --> [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc00c063f80 con 0x7fbff80c16b0 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc0097fa640 1 -- 172.21.15.81:0/2889925926 <== osd.2 v2:172.21.15.181:6800/1768571017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc00c063f80 con 0x7fbff80c16b0 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] conn(0x7fbff80c16b0 msgr2=0x7fbff80c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] conn(0x7fbff80c16b0 0x7fbff80c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbff80b6620 msgr2=0x7fbff80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fbff80b6620 0x7fbff80b8b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc00c06c5c0 tx=0x7fbffc005f90 comp rx=0 tx=0).stop 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 msgr2=0x7fc00c19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 --2- 172.21.15.81:0/2889925926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc00c1052b0 0x7fc00c19a950 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbff4004770 tx=0x7fbff4004040 comp rx=0 tx=0).stop 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc00bfff640 1 -- 172.21.15.81:0/2889925926 reap_dead start 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 shutdown_connections 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 >> 172.21.15.81:0/2889925926 conn(0x7fc00c0797e0 msgr2=0x7fc00c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 shutdown_connections 2024-09-21T02:59:22.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:22.192+0000 7fc011fb9640 1 -- 172.21.15.81:0/2889925926 wait complete. 2024-09-21T02:59:22.858 INFO:teuthology.orchestra.run.smithi081.stdout:73014444104 2024-09-21T02:59:22.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T02:59:22.899 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.899 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.899 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.904 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.905 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.905 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.911 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:22.916 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:23.922 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:23 smithi081 ceph-mon[30991]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:59:23.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:23 smithi164 ceph-mon[34236]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:59:23.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:23 smithi181 ceph-mon[34096]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:59:24.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 -- 172.21.15.81:0/831125711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d081094a0 msgr2=0x7f0d081098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:24.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 --2- 172.21.15.81:0/831125711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d081094a0 0x7f0d081098b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009900 tx=0x7f0cfc02a410 comp rx=0 tx=0).stop 2024-09-21T02:59:24.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 -- 172.21.15.81:0/831125711 shutdown_connections 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 --2- 172.21.15.81:0/831125711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d08109df0 0x7f0d08110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 --2- 172.21.15.81:0/831125711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d081094a0 0x7f0d081098b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 --2- 172.21.15.81:0/831125711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103b60 0x7f0d08103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 -- 172.21.15.81:0/831125711 >> 172.21.15.81:0/831125711 conn(0x7f0d0807b850 msgr2=0x7f0d0807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 -- 172.21.15.81:0/831125711 shutdown_connections 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.816+0000 7f0d0dd98640 1 -- 172.21.15.81:0/831125711 wait complete. 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.817+0000 7f0d0dd98640 1 Processor -- start 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.817+0000 7f0d0dd98640 1 -- start start 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d0dd98640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103b60 0x7f0d0819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d0dd98640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d081094a0 0x7f0d0819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d0dd98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d08109df0 0x7f0d0819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d0dd98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08113960 con 0x7f0d08109df0 2024-09-21T02:59:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d0dd98640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0d081137e0 con 0x7f0d08103b60 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d0dd98640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0d08113ae0 con 0x7f0d081094a0 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d08109df0 0x7f0d0819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d08109df0 0x7f0d0819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34832/0 (socket says 172.21.15.81:34832) 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 -- 172.21.15.81:0/3912418616 learned_addr learned my addr 172.21.15.81:0/3912418616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d06ffd640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d081094a0 0x7f0d0819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d077fe640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103b60 0x7f0d0819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 -- 172.21.15.81:0/3912418616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d081094a0 msgr2=0x7f0d0819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d081094a0 0x7f0d0819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 -- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103b60 msgr2=0x7f0d0819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103b60 0x7f0d0819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 -- 172.21.15.81:0/3912418616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d081a0340 con 0x7f0d08109df0 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.818+0000 7f0d07fff640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d08109df0 0x7f0d0819fc10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000eaa0 tx=0x7f0d0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.819+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000cdb0 con 0x7f0d08109df0 2024-09-21T02:59:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.819+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d00005020 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.819+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d081a0630 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.819+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000116d0 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.819+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d081a6d90 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.820+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d08063b50 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.822+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0d000051d0 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.822+0000 7f0d04ff9640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0cf00b6620 0x7f0cf00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.822+0000 7f0d077fe640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0cf00b6620 0x7f0cf00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.822+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f0d000e7f90 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.823+0000 7f0d04ff9640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] conn(0x7f0cf00c1630 0x7f0cf00c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.823+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 --> [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d00004e00 con 0x7f0cf00c1630 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.823+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0d000e83e0 con 0x7f0d08109df0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.823+0000 7f0d077fe640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0cf00b6620 0x7f0cf00b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8005d90 tx=0x7f0cf8005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.823+0000 7f0d06ffd640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] conn(0x7f0cf00c1630 0x7f0cf00c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.824+0000 7f0d06ffd640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] conn(0x7f0cf00c1630 0x7f0cf00c3b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:24.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.825+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== osd.7 v2:172.21.15.164:6816/2193157365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d00004e00 con 0x7f0cf00c1630 2024-09-21T02:59:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.838+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 --> [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d08063f80 con 0x7f0cf00c1630 2024-09-21T02:59:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.839+0000 7f0d04ff9640 1 -- 172.21.15.81:0/3912418616 <== osd.7 v2:172.21.15.164:6816/2193157365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0d08063f80 con 0x7f0cf00c1630 2024-09-21T02:59:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.839+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] conn(0x7f0cf00c1630 msgr2=0x7f0cf00c3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.839+0000 7f0d0dd98640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] conn(0x7f0cf00c1630 0x7f0cf00c3b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.839+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0cf00b6620 msgr2=0x7f0cf00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.839+0000 7f0d0dd98640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0cf00b6620 0x7f0cf00b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8005d90 tx=0x7f0cf8005d20 comp rx=0 tx=0).stop 2024-09-21T02:59:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.840+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d08109df0 msgr2=0x7f0d0819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.840+0000 7f0d0dd98640 1 --2- 172.21.15.81:0/3912418616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d08109df0 0x7f0d0819fc10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000eaa0 tx=0x7f0d0000ef60 comp rx=0 tx=0).stop 2024-09-21T02:59:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.840+0000 7f0d07fff640 1 -- 172.21.15.81:0/3912418616 reap_dead start 2024-09-21T02:59:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.840+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 shutdown_connections 2024-09-21T02:59:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.840+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 >> 172.21.15.81:0/3912418616 conn(0x7f0d0807b850 msgr2=0x7f0d081075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.840+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 shutdown_connections 2024-09-21T02:59:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.840+0000 7f0d0dd98640 1 -- 172.21.15.81:0/3912418616 wait complete. 2024-09-21T02:59:25.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 -- 172.21.15.81:0/2369319201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c1049f0 msgr2=0x7f110c104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 --2- 172.21.15.81:0/2369319201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c1049f0 0x7f110c104e00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1108009900 tx=0x7f110802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:25.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 -- 172.21.15.81:0/2369319201 shutdown_connections 2024-09-21T02:59:25.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 --2- 172.21.15.81:0/2369319201 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110c10de50 0x7f110c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 --2- 172.21.15.81:0/2369319201 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f110c105340 0x7f110c10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 --2- 172.21.15.81:0/2369319201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c1049f0 0x7f110c104e00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 -- 172.21.15.81:0/2369319201 >> 172.21.15.81:0/2369319201 conn(0x7f110c0797e0 msgr2=0x7f110c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 -- 172.21.15.81:0/2369319201 shutdown_connections 2024-09-21T02:59:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.259+0000 7f1113f5d640 1 -- 172.21.15.81:0/2369319201 wait complete. 2024-09-21T02:59:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.260+0000 7f1113f5d640 1 Processor -- start 2024-09-21T02:59:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.260+0000 7f1113f5d640 1 -- start start 2024-09-21T02:59:25.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f1113f5d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110c1049f0 0x7f110c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f1113f5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c105340 0x7f110c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f1113f5d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f110c10de50 0x7f110c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f1113f5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f110c113960 con 0x7f110c105340 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f1113f5d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f110c1137e0 con 0x7f110c10de50 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f1113f5d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f110c113ae0 con 0x7f110c1049f0 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c105340 0x7f110c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c105340 0x7f110c19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34844/0 (socket says 172.21.15.81:34844) 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 -- 172.21.15.81:0/3743650377 learned_addr learned my addr 172.21.15.81:0/3743650377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f1111cf9640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110c1049f0 0x7f110c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11124fa640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f110c10de50 0x7f110c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 -- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110c1049f0 msgr2=0x7f110c19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f110c1049f0 0x7f110c19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 -- 172.21.15.81:0/3743650377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f110c10de50 msgr2=0x7f110c19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f110c10de50 0x7f110c19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 -- 172.21.15.81:0/3743650377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110c1a0260 con 0x7f110c105340 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11124fa640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f110c10de50 0x7f110c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.261+0000 7f11114f8640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c105340 0x7f110c19a950 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00c8c0 tx=0x7f10fc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.262+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc007bb0 con 0x7f110c105340 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.262+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10fc007d50 con 0x7f110c105340 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.262+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0186a0 con 0x7f110c105340 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.262+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110c1a0550 con 0x7f110c105340 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.262+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f110c1a6d70 con 0x7f110c105340 2024-09-21T02:59:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.263+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f110c063ad0 con 0x7f110c105340 2024-09-21T02:59:25.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.264+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f10fc00fa00 con 0x7f110c105340 2024-09-21T02:59:25.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.265+0000 7f1102ffd640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10f80b65d0 0x7f10f80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.265+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f10fc0e7d50 con 0x7f110c105340 2024-09-21T02:59:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.265+0000 7f1111cf9640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10f80b65d0 0x7f10f80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.265+0000 7f1102ffd640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] conn(0x7f10f80c1660 0x7f10f80c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.265+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 --> [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10fc01ee50 con 0x7f10f80c1660 2024-09-21T02:59:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.265+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f10fc0e81a0 con 0x7f110c105340 2024-09-21T02:59:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.266+0000 7f11124fa640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] conn(0x7f10f80c1660 0x7f10f80c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.266+0000 7f1111cf9640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10f80b65d0 0x7f10f80b8ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1108006010 tx=0x7f1108032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:25.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.266+0000 7f11124fa640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] conn(0x7f10f80c1660 0x7f10f80c3b50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:25.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.267+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== osd.11 v2:172.21.15.181:6824/1957538335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10fc01ee50 con 0x7f10f80c1660 2024-09-21T02:59:25.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.281+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 --> [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f110c063f50 con 0x7f10f80c1660 2024-09-21T02:59:25.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1102ffd640 1 -- 172.21.15.81:0/3743650377 <== osd.11 v2:172.21.15.181:6824/1957538335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f110c063f50 con 0x7f10f80c1660 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] conn(0x7f10f80c1660 msgr2=0x7f10f80c3b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] conn(0x7f10f80c1660 0x7f10f80c3b50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10f80b65d0 msgr2=0x7f10f80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10f80b65d0 0x7f10f80b8ae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1108006010 tx=0x7f1108032c80 comp rx=0 tx=0).stop 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c105340 msgr2=0x7f110c19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 --2- 172.21.15.81:0/3743650377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110c105340 0x7f110c19a950 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00c8c0 tx=0x7f10fc00cd80 comp rx=0 tx=0).stop 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f11124fa640 1 -- 172.21.15.81:0/3743650377 reap_dead start 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 shutdown_connections 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 >> 172.21.15.81:0/3743650377 conn(0x7f110c0797e0 msgr2=0x7f110c100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:25.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 shutdown_connections 2024-09-21T02:59:25.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:25.282+0000 7f1113f5d640 1 -- 172.21.15.81:0/3743650377 wait complete. 2024-09-21T02:59:25.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.707+0000 7f4a88ff2640 1 -- 172.21.15.81:0/1447779974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a84108cf0 msgr2=0x7f4a8410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 --2- 172.21.15.81:0/1447779974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a84108cf0 0x7f4a8410f520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009ca0 tx=0x7f4a7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 -- 172.21.15.81:0/1447779974 shutdown_connections 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 --2- 172.21.15.81:0/1447779974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a841083a0 0x7f4a841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 --2- 172.21.15.81:0/1447779974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a84108cf0 0x7f4a8410f520 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 --2- 172.21.15.81:0/1447779974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a84102a60 0x7f4a84102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 -- 172.21.15.81:0/1447779974 >> 172.21.15.81:0/1447779974 conn(0x7f4a84079730 msgr2=0x7f4a84079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 -- 172.21.15.81:0/1447779974 shutdown_connections 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 -- 172.21.15.81:0/1447779974 wait complete. 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.708+0000 7f4a88ff2640 1 Processor -- start 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a88ff2640 1 -- start start 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a88ff2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a84102a60 0x7f4a84199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a88ff2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a841083a0 0x7f4a841998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a88ff2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a84108cf0 0x7f4a8419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a88ff2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841128e0 con 0x7f4a841083a0 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a88ff2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84112760 con 0x7f4a84102a60 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a88ff2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84112a60 con 0x7f4a84108cf0 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a841083a0 0x7f4a841998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a841083a0 0x7f4a841998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34816/0 (socket says 172.21.15.81:34816) 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 -- 172.21.15.81:0/4222342643 learned_addr learned my addr 172.21.15.81:0/4222342643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a8259c640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a84102a60 0x7f4a84199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a82d9d640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a84108cf0 0x7f4a8419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 -- 172.21.15.81:0/4222342643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a84108cf0 msgr2=0x7f4a8419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a84108cf0 0x7f4a8419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 -- 172.21.15.81:0/4222342643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a84102a60 msgr2=0x7f4a84199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a84102a60 0x7f4a84199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a81d9b640 1 -- 172.21.15.81:0/4222342643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8419f2c0 con 0x7f4a841083a0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.709+0000 7f4a82d9d640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a84108cf0 0x7f4a8419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.710+0000 7f4a81d9b640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a841083a0 0x7f4a841998f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800d740 tx=0x7f4a7800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.710+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78017070 con 0x7f4a841083a0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.710+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8419f5b0 con 0x7f4a841083a0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.710+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a78009820 con 0x7f4a841083a0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.710+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78004c60 con 0x7f4a841083a0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.710+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a841a5d10 con 0x7f4a841083a0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.711+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a84063b50 con 0x7f4a841083a0 2024-09-21T02:59:25.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.713+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4a78005220 con 0x7f4a841083a0 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.713+0000 7f4a737fe640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4a6c0b65a0 0x7f4a6c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a8259c640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4a6c0b65a0 0x7f4a6c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f4a780e7750 con 0x7f4a841083a0 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a737fe640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] conn(0x7f4a6c0c1630 0x7f4a6c0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 --> [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a78021e50 con 0x7f4a6c0c1630 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f4a780e7ba0 con 0x7f4a841083a0 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a82d9d640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] conn(0x7f4a6c0c1630 0x7f4a6c0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a8259c640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4a6c0b65a0 0x7f4a6c0b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009990 tx=0x7f4a74009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.714+0000 7f4a82d9d640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] conn(0x7f4a6c0c1630 0x7f4a6c0c3b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.715+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== osd.3 v2:172.21.15.81:6810/2282791523 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a78021e50 con 0x7f4a6c0c1630 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.729+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 --> [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a84063f50 con 0x7f4a6c0c1630 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a737fe640 1 -- 172.21.15.81:0/4222342643 <== osd.3 v2:172.21.15.81:6810/2282791523 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4a84063f50 con 0x7f4a6c0c1630 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] conn(0x7f4a6c0c1630 msgr2=0x7f4a6c0c3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] conn(0x7f4a6c0c1630 0x7f4a6c0c3b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4a6c0b65a0 msgr2=0x7f4a6c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4a6c0b65a0 0x7f4a6c0b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009990 tx=0x7f4a74009110 comp rx=0 tx=0).stop 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a841083a0 msgr2=0x7f4a841998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 --2- 172.21.15.81:0/4222342643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a841083a0 0x7f4a841998f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800d740 tx=0x7f4a7800db40 comp rx=0 tx=0).stop 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a82d9d640 1 -- 172.21.15.81:0/4222342643 reap_dead start 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 shutdown_connections 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 >> 172.21.15.81:0/4222342643 conn(0x7f4a84079730 msgr2=0x7f4a841052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 shutdown_connections 2024-09-21T02:59:25.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:24.730+0000 7f4a88ff2640 1 -- 172.21.15.81:0/4222342643 wait complete. 2024-09-21T02:59:25.919 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:25 smithi081 ceph-mon[30991]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:59:25.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:25 smithi164 ceph-mon[34236]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:59:25.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:25 smithi181 ceph-mon[34096]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:59:26.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 -- 172.21.15.81:0/422702951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76601083a0 msgr2=0x7f76601087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 --2- 172.21.15.81:0/422702951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76601083a0 0x7f76601087b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7650009900 tx=0x7f765002a410 comp rx=0 tx=0).stop 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 -- 172.21.15.81:0/422702951 shutdown_connections 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 --2- 172.21.15.81:0/422702951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7660108cf0 0x7f766010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 --2- 172.21.15.81:0/422702951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76601083a0 0x7f76601087b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 --2- 172.21.15.81:0/422702951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7660102a60 0x7f7660102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 -- 172.21.15.81:0/422702951 >> 172.21.15.81:0/422702951 conn(0x7f7660079730 msgr2=0x7f7660079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 -- 172.21.15.81:0/422702951 shutdown_connections 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.008+0000 7f766786e640 1 -- 172.21.15.81:0/422702951 wait complete. 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 Processor -- start 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 -- start start 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660102a60 0x7f766019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76601083a0 0x7f766019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7660108cf0 0x7f766019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7660112810 con 0x7f7660102a60 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7660112690 con 0x7f7660108cf0 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.009+0000 7f766786e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7660112990 con 0x7f76601083a0 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660102a60 0x7f766019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660102a60 0x7f766019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34860/0 (socket says 172.21.15.81:34860) 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 -- 172.21.15.81:0/3709866094 learned_addr learned my addr 172.21.15.81:0/3709866094 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f7664e09640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76601083a0 0x7f766019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f7665e0b640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7660108cf0 0x7f766019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 -- 172.21.15.81:0/3709866094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76601083a0 msgr2=0x7f766019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:26.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76601083a0 0x7f766019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 -- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7660108cf0 msgr2=0x7f766019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7660108cf0 0x7f766019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 -- 172.21.15.81:0/3709866094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76601a0360 con 0x7f7660102a60 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766560a640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660102a60 0x7f766019a3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f765c00d950 tx=0x7f765c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c017070 con 0x7f7660102a60 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f765c009c30 con 0x7f7660102a60 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c00f620 con 0x7f7660102a60 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76601a0650 con 0x7f7660102a60 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.010+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76601a6db0 con 0x7f7660102a60 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.011+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7660063b50 con 0x7f7660102a60 2024-09-21T02:59:26.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.013+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f765c010460 con 0x7f7660102a60 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.014+0000 7f76567fc640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f764c0b6620 0x7f764c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.014+0000 7f7664e09640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f764c0b6620 0x7f764c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.014+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f765c0e76f0 con 0x7f7660102a60 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.014+0000 7f76567fc640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] conn(0x7f764c0c16b0 0x7f764c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.014+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 --> [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f764c0c4270 con 0x7f764c0c16b0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.014+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f765c0e7b40 con 0x7f7660102a60 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.014+0000 7f7664e09640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f764c0b6620 0x7f764c0b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7650004770 tx=0x7f76500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.015+0000 7f7665e0b640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] conn(0x7f764c0c16b0 0x7f764c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.015+0000 7f7665e0b640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] conn(0x7f764c0c16b0 0x7f764c0c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.016+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== osd.4 v2:172.21.15.164:6808/1406616378 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f764c0c4270 con 0x7f764c0c16b0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.029+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 --> [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7660063fd0 con 0x7f764c0c16b0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.030+0000 7f76567fc640 1 -- 172.21.15.81:0/3709866094 <== osd.4 v2:172.21.15.164:6808/1406616378 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7660063fd0 con 0x7f764c0c16b0 2024-09-21T02:59:26.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] conn(0x7f764c0c16b0 msgr2=0x7f764c0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] conn(0x7f764c0c16b0 0x7f764c0c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f764c0b6620 msgr2=0x7f764c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f764c0b6620 0x7f764c0b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7650004770 tx=0x7f76500058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660102a60 msgr2=0x7f766019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 --2- 172.21.15.81:0/3709866094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7660102a60 0x7f766019a3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f765c00d950 tx=0x7f765c00de10 comp rx=0 tx=0).stop 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f7665e0b640 1 -- 172.21.15.81:0/3709866094 reap_dead start 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 shutdown_connections 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 >> 172.21.15.81:0/3709866094 conn(0x7f7660079730 msgr2=0x7f766006b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 shutdown_connections 2024-09-21T02:59:26.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:26.031+0000 7f766786e640 1 -- 172.21.15.81:0/3709866094 wait complete. 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 -- 172.21.15.81:0/47867321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 msgr2=0x7fe2001087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 --2- 172.21.15.81:0/47867321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 0x7fe2001087d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009900 tx=0x7fe1f402a410 comp rx=0 tx=0).stop 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 -- 172.21.15.81:0/47867321 shutdown_connections 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 --2- 172.21.15.81:0/47867321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe200108d10 0x7fe20010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 --2- 172.21.15.81:0/47867321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 0x7fe2001087d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 --2- 172.21.15.81:0/47867321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe200102a80 0x7fe200102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 -- 172.21.15.81:0/47867321 >> 172.21.15.81:0/47867321 conn(0x7fe200079740 msgr2=0x7fe200079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 -- 172.21.15.81:0/47867321 shutdown_connections 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.355+0000 7fe20868d640 1 -- 172.21.15.81:0/47867321 wait complete. 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 Processor -- start 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 -- start start 2024-09-21T02:59:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe200102a80 0x7fe200199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 0x7fe2001998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe200108d10 0x7fe20019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe200112880 con 0x7fe2001083c0 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe200112700 con 0x7fe200108d10 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe20868d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe200112a00 con 0x7fe200102a80 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe205c28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 0x7fe2001998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe205c28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 0x7fe2001998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34890/0 (socket says 172.21.15.81:34890) 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe205c28640 1 -- 172.21.15.81:0/4285534341 learned_addr learned my addr 172.21.15.81:0/4285534341 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe206429640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe200102a80 0x7fe200199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe206c2a640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe200108d10 0x7fe20019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe205c28640 1 -- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe200102a80 msgr2=0x7fe200199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe205c28640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe200102a80 0x7fe200199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.356+0000 7fe205c28640 1 -- 172.21.15.81:0/4285534341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe200108d10 msgr2=0x7fe20019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe205c28640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe200108d10 0x7fe20019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe205c28640 1 -- 172.21.15.81:0/4285534341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20019f2c0 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe206c2a640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe200108d10 0x7fe20019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe205c28640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 0x7fe2001998f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe1f402a930 tx=0x7fe1f4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f403f070 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1f4003e10 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20019f550 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4035030 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.357+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2001a5d10 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.358+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe200063b50 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.360+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe1f4042070 con 0x7fe2001083c0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.360+0000 7fe1f37fe640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe1ec0b65a0 0x7fe1ec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.360+0000 7fe206429640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe1ec0b65a0 0x7fe1ec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.361+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe1f4108330 con 0x7fe2001083c0 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.361+0000 7fe1f37fe640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] conn(0x7fe1ec0c1630 0x7fe1ec0c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.361+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 --> [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1f403bde0 con 0x7fe1ec0c1630 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.361+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe1f4108810 con 0x7fe2001083c0 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.361+0000 7fe206429640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe1ec0b65a0 0x7fe1ec0b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc005fd0 tx=0x7fe1fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.361+0000 7fe206c2a640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] conn(0x7fe1ec0c1630 0x7fe1ec0c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.362+0000 7fe206c2a640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] conn(0x7fe1ec0c1630 0x7fe1ec0c3b20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.362+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== osd.8 v2:172.21.15.181:6816/3075845600 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1f403bde0 con 0x7fe1ec0c1630 2024-09-21T02:59:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.376+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 --> [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe200063fd0 con 0x7fe1ec0c1630 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.376+0000 7fe1f37fe640 1 -- 172.21.15.81:0/4285534341 <== osd.8 v2:172.21.15.181:6816/3075845600 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe200063fd0 con 0x7fe1ec0c1630 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] conn(0x7fe1ec0c1630 msgr2=0x7fe1ec0c3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] conn(0x7fe1ec0c1630 0x7fe1ec0c3b20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe1ec0b65a0 msgr2=0x7fe1ec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe1ec0b65a0 0x7fe1ec0b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc005fd0 tx=0x7fe1fc00b390 comp rx=0 tx=0).stop 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 msgr2=0x7fe2001998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 --2- 172.21.15.81:0/4285534341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2001083c0 0x7fe2001998f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe1f402a930 tx=0x7fe1f4003c20 comp rx=0 tx=0).stop 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe206c2a640 1 -- 172.21.15.81:0/4285534341 reap_dead start 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 shutdown_connections 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 >> 172.21.15.81:0/4285534341 conn(0x7fe200079740 msgr2=0x7fe2001044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 shutdown_connections 2024-09-21T02:59:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.377+0000 7fe20868d640 1 -- 172.21.15.81:0/4285534341 wait complete. 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 -- 172.21.15.81:0/3267756033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f4108cf0 msgr2=0x7f06f410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 --2- 172.21.15.81:0/3267756033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f4108cf0 0x7f06f410f520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009ca0 tx=0x7f06ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 -- 172.21.15.81:0/3267756033 shutdown_connections 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 --2- 172.21.15.81:0/3267756033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f4108cf0 0x7f06f410f520 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 --2- 172.21.15.81:0/3267756033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06f41083a0 0x7f06f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 --2- 172.21.15.81:0/3267756033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4102a60 0x7f06f4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 -- 172.21.15.81:0/3267756033 >> 172.21.15.81:0/3267756033 conn(0x7f06f4079730 msgr2=0x7f06f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 -- 172.21.15.81:0/3267756033 shutdown_connections 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.805+0000 7f06fa407640 1 -- 172.21.15.81:0/3267756033 wait complete. 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 Processor -- start 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 -- start start 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4102a60 0x7f06f419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f41083a0 0x7f06f419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06f4108cf0 0x7f06f41a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4112940 con 0x7f06f41083a0 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41127c0 con 0x7f06f4108cf0 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06fa407640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4112ac0 con 0x7f06f4102a60 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f41083a0 0x7f06f419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f41083a0 0x7f06f419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34908/0 (socket says 172.21.15.81:34908) 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06f37fe640 1 -- 172.21.15.81:0/4038324492 learned_addr learned my addr 172.21.15.81:0/4038324492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06f3fff640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4102a60 0x7f06f419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.806+0000 7f06f89a4640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06f4108cf0 0x7f06f41a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f37fe640 1 -- 172.21.15.81:0/4038324492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4102a60 msgr2=0x7f06f419c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f37fe640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f06f4102a60 0x7f06f419c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f37fe640 1 -- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06f4108cf0 msgr2=0x7f06f41a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f37fe640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06f4108cf0 0x7f06f41a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f37fe640 1 -- 172.21.15.81:0/4038324492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f41a25d0 con 0x7f06f41083a0 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f37fe640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f41083a0 0x7f06f419cc00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00b450 tx=0x7f06dc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc015020 con 0x7f06f41083a0 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06dc011d20 con 0x7f06f41083a0 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f41a28c0 con 0x7f06f41083a0 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f41a9020 con 0x7f06f41083a0 2024-09-21T02:59:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.807+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc010e10 con 0x7f06f41083a0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.808+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06f406ba00 con 0x7f06f41083a0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.810+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f06dc018020 con 0x7f06f41083a0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.810+0000 7f06f17fa640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f06e00b6620 0x7f06e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.811+0000 7f06f3fff640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f06e00b6620 0x7f06e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.811+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f06dc0e7820 con 0x7f06f41083a0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.811+0000 7f06f17fa640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] conn(0x7f06e00c16b0 0x7f06e00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.811+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 --> [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06e00c4270 con 0x7f06e00c16b0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.811+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f06dc0e7c70 con 0x7f06f41083a0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.811+0000 7f06f3fff640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f06e00b6620 0x7f06e00b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009890 tx=0x7f06e4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.811+0000 7f06f89a4640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] conn(0x7f06e00c16b0 0x7f06e00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.812+0000 7f06f89a4640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] conn(0x7f06e00c16b0 0x7f06e00c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.813+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== osd.10 v2:172.21.15.164:6824/1437229316 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06e00c4270 con 0x7f06e00c16b0 2024-09-21T02:59:27.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.826+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 --> [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06f4103ce0 con 0x7f06e00c16b0 2024-09-21T02:59:27.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06f17fa640 1 -- 172.21.15.81:0/4038324492 <== osd.10 v2:172.21.15.164:6824/1437229316 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f06f4103ce0 con 0x7f06e00c16b0 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] conn(0x7f06e00c16b0 msgr2=0x7f06e00c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] conn(0x7f06e00c16b0 0x7f06e00c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f06e00b6620 msgr2=0x7f06e00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f06e00b6620 0x7f06e00b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009890 tx=0x7f06e4008040 comp rx=0 tx=0).stop 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f41083a0 msgr2=0x7f06f419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 --2- 172.21.15.81:0/4038324492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06f41083a0 0x7f06f419cc00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00b450 tx=0x7f06dc00b910 comp rx=0 tx=0).stop 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06f89a4640 1 -- 172.21.15.81:0/4038324492 reap_dead start 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 shutdown_connections 2024-09-21T02:59:27.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 >> 172.21.15.81:0/4038324492 conn(0x7f06f4079730 msgr2=0x7f06f406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 shutdown_connections 2024-09-21T02:59:27.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.827+0000 7f06fa407640 1 -- 172.21.15.81:0/4038324492 wait complete. 2024-09-21T02:59:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:27 smithi164 ceph-mon[34236]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:59:27.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:27 smithi181 ceph-mon[34096]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:59:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:27 smithi081 ceph-mon[30991]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:59:28.289 INFO:teuthology.orchestra.run.smithi081.stdout:128849018943 2024-09-21T02:59:28.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T02:59:28.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 -- 172.21.15.81:0/3384100625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2590109e00 msgr2=0x7f2590110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:28.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 --2- 172.21.15.81:0/3384100625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2590109e00 0x7f2590110630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2588009900 tx=0x7f258802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 -- 172.21.15.81:0/3384100625 shutdown_connections 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 --2- 172.21.15.81:0/3384100625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25901094b0 0x7f25901098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 --2- 172.21.15.81:0/3384100625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2590109e00 0x7f2590110630 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 --2- 172.21.15.81:0/3384100625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2590103bc0 0x7f2590103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 -- 172.21.15.81:0/3384100625 >> 172.21.15.81:0/3384100625 conn(0x7f259007b910 msgr2=0x7f259007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 -- 172.21.15.81:0/3384100625 shutdown_connections 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.692+0000 7f2595280640 1 -- 172.21.15.81:0/3384100625 wait complete. 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 Processor -- start 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 -- start start 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2590103bc0 0x7f2590075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25901094b0 0x7f2590075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:28.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2590109e00 0x7f2590076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25901139d0 con 0x7f25901094b0 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2590113850 con 0x7f2590103bc0 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f2595280640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2590113b50 con 0x7f2590109e00 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25901094b0 0x7f2590075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25901094b0 0x7f2590075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34918/0 (socket says 172.21.15.81:34918) 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 -- 172.21.15.81:0/2300206306 learned_addr learned my addr 172.21.15.81:0/2300206306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258effd640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2590103bc0 0x7f2590075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258f7fe640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2590109e00 0x7f2590076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 -- 172.21.15.81:0/2300206306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2590109e00 msgr2=0x7f2590076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2590109e00 0x7f2590076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 -- 172.21.15.81:0/2300206306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2590103bc0 msgr2=0x7f2590075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2590103bc0 0x7f2590075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.693+0000 7f258e7fc640 1 -- 172.21.15.81:0/2300206306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25901a8660 con 0x7f25901094b0 2024-09-21T02:59:28.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.694+0000 7f258e7fc640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25901094b0 0x7f2590075c50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f257800c970 tx=0x7f257800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.694+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578007bb0 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.694+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2578007d50 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.694+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25901a8950 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.694+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578004da0 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.694+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25901a8f60 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.695+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2590063b50 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.696+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2578004f40 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.697+0000 7f2587fff640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f257c0b6620 0x7f257c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.697+0000 7f258effd640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f257c0b6620 0x7f257c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.697+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f25780e7940 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.697+0000 7f2587fff640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] conn(0x7f257c0c16b0 0x7f257c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.697+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 --> [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f257c0c4270 con 0x7f257c0c16b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.697+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f25780e7d90 con 0x7f25901094b0 2024-09-21T02:59:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.698+0000 7f258f7fe640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] conn(0x7f257c0c16b0 0x7f257c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.698+0000 7f258effd640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f257c0b6620 0x7f257c0b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2590077160 tx=0x7f258000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.698+0000 7f258f7fe640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] conn(0x7f257c0c16b0 0x7f257c0c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:28.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.699+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== osd.6 v2:172.21.15.81:6818/3031456716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f257c0c4270 con 0x7f257c0c16b0 2024-09-21T02:59:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.713+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 --> [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2590063f50 con 0x7f257c0c16b0 2024-09-21T02:59:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.713+0000 7f2587fff640 1 -- 172.21.15.81:0/2300206306 <== osd.6 v2:172.21.15.81:6818/3031456716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2590063f50 con 0x7f257c0c16b0 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] conn(0x7f257c0c16b0 msgr2=0x7f257c0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] conn(0x7f257c0c16b0 0x7f257c0c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f257c0b6620 msgr2=0x7f257c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f257c0b6620 0x7f257c0b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2590077160 tx=0x7f258000d040 comp rx=0 tx=0).stop 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25901094b0 msgr2=0x7f2590075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 --2- 172.21.15.81:0/2300206306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25901094b0 0x7f2590075c50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f257800c970 tx=0x7f257800ce30 comp rx=0 tx=0).stop 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f258f7fe640 1 -- 172.21.15.81:0/2300206306 reap_dead start 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 shutdown_connections 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 >> 172.21.15.81:0/2300206306 conn(0x7f259007b910 msgr2=0x7f2590107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 shutdown_connections 2024-09-21T02:59:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:28.714+0000 7f2595280640 1 -- 172.21.15.81:0/2300206306 wait complete. 2024-09-21T02:59:29.400 INFO:teuthology.orchestra.run.smithi081.stdout:197568495664 2024-09-21T02:59:29.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T02:59:29.819 INFO:teuthology.orchestra.run.smithi081.stdout:292057776156 2024-09-21T02:59:29.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T02:59:29.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.252+0000 7f81a9576640 1 -- 172.21.15.81:0/136578113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a4108d20 msgr2=0x7f81a410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.252+0000 7f81a9576640 1 --2- 172.21.15.81:0/136578113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a4108d20 0x7f81a410f550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f819c009ca0 tx=0x7f819c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.252+0000 7f81a9576640 1 -- 172.21.15.81:0/136578113 shutdown_connections 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.252+0000 7f81a9576640 1 --2- 172.21.15.81:0/136578113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a4108d20 0x7f81a410f550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.252+0000 7f81a9576640 1 --2- 172.21.15.81:0/136578113 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81a41083d0 0x7f81a41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.252+0000 7f81a9576640 1 --2- 172.21.15.81:0/136578113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81a4102ae0 0x7f81a4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.252+0000 7f81a9576640 1 -- 172.21.15.81:0/136578113 >> 172.21.15.81:0/136578113 conn(0x7f81a4079790 msgr2=0x7f81a4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.253+0000 7f81a9576640 1 -- 172.21.15.81:0/136578113 shutdown_connections 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.253+0000 7f81a9576640 1 -- 172.21.15.81:0/136578113 wait complete. 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.253+0000 7f81a9576640 1 Processor -- start 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.253+0000 7f81a9576640 1 -- start start 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.253+0000 7f81a9576640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81a4102ae0 0x7f81a40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a9576640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a41083d0 0x7f81a40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a9576640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81a4108d20 0x7f81a41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a9576640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81a41128e0 con 0x7f81a41083d0 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a9576640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4112760 con 0x7f81a4102ae0 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a9576640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4112a60 con 0x7f81a4108d20 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a41083d0 0x7f81a40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a41083d0 0x7f81a40ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34882/0 (socket says 172.21.15.81:34882) 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 -- 172.21.15.81:0/1073054947 learned_addr learned my addr 172.21.15.81:0/1073054947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a2ffd640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81a4102ae0 0x7f81a40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a37fe640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81a4108d20 0x7f81a41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 -- 172.21.15.81:0/1073054947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81a4108d20 msgr2=0x7f81a41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81a4108d20 0x7f81a41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 -- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81a4102ae0 msgr2=0x7f81a40ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81a4102ae0 0x7f81a40ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 -- 172.21.15.81:0/1073054947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a41a8680 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f819bfff640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a41083d0 0x7f81a40ffbb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f818c00e9f0 tx=0x7f818c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c00ccc0 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f818c0108c0 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.254+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c018750 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.255+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a41a8970 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.255+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a41a8eb0 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.256+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81a4063b10 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.257+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f818c010430 con 0x7f81a41083d0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.258+0000 7f81a0ff9640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81900b65a0 0x7f81900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.258+0000 7f81a2ffd640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81900b65a0 0x7f81900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.258+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f818c0e83e0 con 0x7f81a41083d0 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.258+0000 7f81a0ff9640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] conn(0x7f81900c1630 0x7f81900c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.258+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 --> [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f818c015e80 con 0x7f81900c1630 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.259+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f818c0e8830 con 0x7f81a41083d0 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.259+0000 7f81a2ffd640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81900b65a0 0x7f81900b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f81a41010c0 tx=0x7f819400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.259+0000 7f81a37fe640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] conn(0x7f81900c1630 0x7f81900c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.259+0000 7f81a37fe640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] conn(0x7f81900c1630 0x7f81900c3b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.260+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== osd.1 v2:172.21.15.164:6800/2618567246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f818c015e80 con 0x7f81900c1630 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.275+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 --> [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f81a4063f90 con 0x7f81900c1630 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a0ff9640 1 -- 172.21.15.81:0/1073054947 <== osd.1 v2:172.21.15.164:6800/2618567246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f81a4063f90 con 0x7f81900c1630 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] conn(0x7f81900c1630 msgr2=0x7f81900c3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] conn(0x7f81900c1630 0x7f81900c3b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81900b65a0 msgr2=0x7f81900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81900b65a0 0x7f81900b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f81a41010c0 tx=0x7f819400b390 comp rx=0 tx=0).stop 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a41083d0 msgr2=0x7f81a40ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 --2- 172.21.15.81:0/1073054947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81a41083d0 0x7f81a40ffbb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f818c00e9f0 tx=0x7f818c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a37fe640 1 -- 172.21.15.81:0/1073054947 reap_dead start 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 shutdown_connections 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 >> 172.21.15.81:0/1073054947 conn(0x7f81a4079790 msgr2=0x7f81a4101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 shutdown_connections 2024-09-21T02:59:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:27.276+0000 7f81a9576640 1 -- 172.21.15.81:0/1073054947 wait complete. 2024-09-21T02:59:29.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:29 smithi164 ceph-mon[34236]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T02:59:29.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:29 smithi181 ceph-mon[34096]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T02:59:30.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:29 smithi081 ceph-mon[30991]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.434+0000 7f44c2af4640 1 -- 172.21.15.81:0/2740563634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1051c0 msgr2=0x7f44bc1055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.434+0000 7f44c2af4640 1 --2- 172.21.15.81:0/2740563634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1051c0 0x7f44bc1055d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009900 tx=0x7f44a802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.434+0000 7f44c2af4640 1 -- 172.21.15.81:0/2740563634 shutdown_connections 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.434+0000 7f44c2af4640 1 --2- 172.21.15.81:0/2740563634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44bc105b10 0x7f44bc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.434+0000 7f44c2af4640 1 --2- 172.21.15.81:0/2740563634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1051c0 0x7f44bc1055d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.434+0000 7f44c2af4640 1 --2- 172.21.15.81:0/2740563634 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44bc1031b0 0x7f44bc1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.434+0000 7f44c2af4640 1 -- 172.21.15.81:0/2740563634 >> 172.21.15.81:0/2740563634 conn(0x7f44bc079e40 msgr2=0x7f44bc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 -- 172.21.15.81:0/2740563634 shutdown_connections 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 -- 172.21.15.81:0/2740563634 wait complete. 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 Processor -- start 2024-09-21T02:59:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 -- start start 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1031b0 0x7f44bc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44bc1051c0 0x7f44bc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44bc105b10 0x7f44bc19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.435+0000 7f44c2af4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc112890 con 0x7f44bc1031b0 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c2af4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc112710 con 0x7f44bc105b10 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c2af4640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc112a10 con 0x7f44bc1051c0 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1031b0 0x7f44bc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1031b0 0x7f44bc19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34934/0 (socket says 172.21.15.81:34934) 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 -- 172.21.15.81:0/3231609535 learned_addr learned my addr 172.21.15.81:0/3231609535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c1091640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44bc105b10 0x7f44bc19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44bbfff640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44bc1051c0 0x7f44bc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 -- 172.21.15.81:0/3231609535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44bc1051c0 msgr2=0x7f44bc19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44bc1051c0 0x7f44bc19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 -- 172.21.15.81:0/3231609535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44bc105b10 msgr2=0x7f44bc19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44bc105b10 0x7f44bc19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 -- 172.21.15.81:0/3231609535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc1a02c0 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c0890640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1031b0 0x7f44bc19a410 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f44b000d950 tx=0x7f44b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0017070 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44b0009c30 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44bc1a05b0 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.436+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b000f620 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.437+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44bc1a0a70 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.438+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44bc1022c0 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.439+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f44b001a070 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.440+0000 7f44b9ffb640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44ac0b65d0 0x7f44ac0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.440+0000 7f44bbfff640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44ac0b65d0 0x7f44ac0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.440+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f44b00e7590 con 0x7f44bc1031b0 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.440+0000 7f44b9ffb640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] conn(0x7f44ac0c1660 0x7f44ac0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.440+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 --> [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44b0020e50 con 0x7f44ac0c1660 2024-09-21T02:59:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.440+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f44b00e79e0 con 0x7f44bc1031b0 2024-09-21T02:59:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.440+0000 7f44c1091640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] conn(0x7f44ac0c1660 0x7f44ac0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.441+0000 7f44bbfff640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44ac0b65d0 0x7f44ac0b8ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44a8005940 tx=0x7f44a80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.441+0000 7f44c1091640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] conn(0x7f44ac0c1660 0x7f44ac0c3b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.441+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== osd.9 v2:172.21.15.81:6826/3125475074 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44b0020e50 con 0x7f44ac0c1660 2024-09-21T02:59:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.455+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 --> [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44bc103f30 con 0x7f44ac0c1660 2024-09-21T02:59:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.455+0000 7f44b9ffb640 1 -- 172.21.15.81:0/3231609535 <== osd.9 v2:172.21.15.81:6826/3125475074 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f44bc103f30 con 0x7f44ac0c1660 2024-09-21T02:59:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] conn(0x7f44ac0c1660 msgr2=0x7f44ac0c3b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] conn(0x7f44ac0c1660 0x7f44ac0c3b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44ac0b65d0 msgr2=0x7f44ac0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f44ac0b65d0 0x7f44ac0b8ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44a8005940 tx=0x7f44a80058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1031b0 msgr2=0x7f44bc19a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 --2- 172.21.15.81:0/3231609535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44bc1031b0 0x7f44bc19a410 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f44b000d950 tx=0x7f44b000de10 comp rx=0 tx=0).stop 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c1091640 1 -- 172.21.15.81:0/3231609535 reap_dead start 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 shutdown_connections 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 >> 172.21.15.81:0/3231609535 conn(0x7f44bc079e40 msgr2=0x7f44bc106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 shutdown_connections 2024-09-21T02:59:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:30.456+0000 7f44c2af4640 1 -- 172.21.15.81:0/3231609535 wait complete. 2024-09-21T02:59:31.163 INFO:teuthology.orchestra.run.smithi081.stdout:176093659190 2024-09-21T02:59:31.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T02:59:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 -- 172.21.15.81:0/860018239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 msgr2=0x7f5034107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 --2- 172.21.15.81:0/860018239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 0x7f5034107640 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5024009930 tx=0x7f502402a420 comp rx=0 tx=0).stop 2024-09-21T02:59:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 -- 172.21.15.81:0/860018239 shutdown_connections 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 --2- 172.21.15.81:0/860018239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5034107c00 0x7f50341080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 --2- 172.21.15.81:0/860018239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 0x7f5034107640 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 --2- 172.21.15.81:0/860018239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50341027c0 0x7f5034102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 -- 172.21.15.81:0/860018239 >> 172.21.15.81:0/860018239 conn(0x7f5034079740 msgr2=0x7f5034079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 -- 172.21.15.81:0/860018239 shutdown_connections 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.325+0000 7f503b5c8640 1 -- 172.21.15.81:0/860018239 wait complete. 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 Processor -- start 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 -- start start 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50341027c0 0x7f50341a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 0x7f50341a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5034107c00 0x7f50341a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5034119f30 con 0x7f5034103110 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5034119db0 con 0x7f5034107c00 2024-09-21T02:59:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f503b5c8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f503411a0b0 con 0x7f50341027c0 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 0x7f50341a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 0x7f50341a0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60896/0 (socket says 172.21.15.81:60896) 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 -- 172.21.15.81:0/3758806992 learned_addr learned my addr 172.21.15.81:0/3758806992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5039364640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50341027c0 0x7f50341a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5039b65640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5034107c00 0x7f50341a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 -- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50341027c0 msgr2=0x7f50341a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50341027c0 0x7f50341a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 -- 172.21.15.81:0/3758806992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5034107c00 msgr2=0x7f50341a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5034107c00 0x7f50341a6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5038b63640 1 -- 172.21.15.81:0/3758806992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50341a6970 con 0x7f5034103110 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.326+0000 7f5039b65640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5034107c00 0x7f50341a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.327+0000 7f5038b63640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 0x7f50341a0fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5024005940 tx=0x7f50240040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.327+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502403f030 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.327+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50341a6c00 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.327+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5024003a80 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.327+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024035070 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.327+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50341ad3c0 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.328+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5034107080 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.330+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5024042030 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f502a7fc640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50200b65a0 0x7f50200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f5039364640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50200b65a0 0x7f50200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5024108190 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f502a7fc640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] conn(0x7f50200c1630 0x7f50200c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 --> [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50200c41f0 con 0x7f50200c1630 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f50241085e0 con 0x7f5034103110 2024-09-21T02:59:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f5039364640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50200b65a0 0x7f50200b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f503406c620 tx=0x7f503000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.331+0000 7f5039b65640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] conn(0x7f50200c1630 0x7f50200c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.332+0000 7f5039b65640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] conn(0x7f50200c1630 0x7f50200c3b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:31.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.333+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== osd.5 v2:172.21.15.181:6808/3082949171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50200c41f0 con 0x7f50200c1630 2024-09-21T02:59:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.346+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 --> [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f503406bf20 con 0x7f50200c1630 2024-09-21T02:59:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.347+0000 7f502a7fc640 1 -- 172.21.15.81:0/3758806992 <== osd.5 v2:172.21.15.181:6808/3082949171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f503406bf20 con 0x7f50200c1630 2024-09-21T02:59:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.347+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] conn(0x7f50200c1630 msgr2=0x7f50200c3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.347+0000 7f503b5c8640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] conn(0x7f50200c1630 0x7f50200c3b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.347+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50200b65a0 msgr2=0x7f50200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.347+0000 7f503b5c8640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f50200b65a0 0x7f50200b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f503406c620 tx=0x7f503000b390 comp rx=0 tx=0).stop 2024-09-21T02:59:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.347+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 msgr2=0x7f50341a0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.348+0000 7f503b5c8640 1 --2- 172.21.15.81:0/3758806992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5034103110 0x7f50341a0fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5024005940 tx=0x7f50240040e0 comp rx=0 tx=0).stop 2024-09-21T02:59:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.348+0000 7f5039b65640 1 -- 172.21.15.81:0/3758806992 reap_dead start 2024-09-21T02:59:31.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.348+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 shutdown_connections 2024-09-21T02:59:31.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.348+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 >> 172.21.15.81:0/3758806992 conn(0x7f5034079740 msgr2=0x7f5034105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:31.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.348+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 shutdown_connections 2024-09-21T02:59:31.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:31.348+0000 7f503b5c8640 1 -- 172.21.15.81:0/3758806992 wait complete. 2024-09-21T02:59:31.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:31 smithi164 ceph-mon[34236]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-21T02:59:31.974 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:31 smithi081 ceph-mon[30991]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-21T02:59:31.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:31 smithi181 ceph-mon[34096]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-09-21T02:59:32.003 INFO:teuthology.orchestra.run.smithi081.stdout:103079215171 2024-09-21T02:59:32.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T02:59:32.420 INFO:teuthology.orchestra.run.smithi081.stdout:55834574927 2024-09-21T02:59:32.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T02:59:32.607 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:33.086 INFO:teuthology.orchestra.run.smithi081.stdout:219043332139 2024-09-21T02:59:33.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T02:59:33.489 INFO:teuthology.orchestra.run.smithi081.stdout:266287972385 2024-09-21T02:59:33.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T02:59:33.723 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:33 smithi081 ceph-mon[30991]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T02:59:33.924 INFO:teuthology.orchestra.run.smithi081.stdout:244813135911 2024-09-21T02:59:33.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T02:59:33.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:33 smithi181 ceph-mon[34096]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T02:59:34.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:33 smithi164 ceph-mon[34236]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T02:59:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 -- 172.21.15.81:0/656704132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c103b60 msgr2=0x7f8d5c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/656704132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c103b60 0x7f8d5c103f70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009900 tx=0x7f8d4c02a410 comp rx=0 tx=0).stop 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 -- 172.21.15.81:0/656704132 shutdown_connections 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/656704132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c109df0 0x7f8d5c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/656704132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d5c1094a0 0x7f8d5c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/656704132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c103b60 0x7f8d5c103f70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 -- 172.21.15.81:0/656704132 >> 172.21.15.81:0/656704132 conn(0x7f8d5c07b850 msgr2=0x7f8d5c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 -- 172.21.15.81:0/656704132 shutdown_connections 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 -- 172.21.15.81:0/656704132 wait complete. 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.619+0000 7f8d61e8e640 1 Processor -- start 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d61e8e640 1 -- start start 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d61e8e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d5c103b60 0x7f8d5c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d61e8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c1094a0 0x7f8d5c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d61e8e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c109df0 0x7f8d5c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d61e8e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c113960 con 0x7f8d5c1094a0 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d61e8e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c1137e0 con 0x7f8d5c103b60 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d61e8e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c113ae0 con 0x7f8d5c109df0 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c1094a0 0x7f8d5c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c1094a0 0x7f8d5c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60920/0 (socket says 172.21.15.81:60920) 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 -- 172.21.15.81:0/1006403234 learned_addr learned my addr 172.21.15.81:0/1006403234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d5b7fe640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d5c103b60 0x7f8d5c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d5bfff640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c109df0 0x7f8d5c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 -- 172.21.15.81:0/1006403234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c109df0 msgr2=0x7f8d5c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c109df0 0x7f8d5c19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 -- 172.21.15.81:0/1006403234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d5c103b60 msgr2=0x7f8d5c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d5c103b60 0x7f8d5c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 -- 172.21.15.81:0/1006403234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c1a03a0 con 0x7f8d5c1094a0 2024-09-21T02:59:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.620+0000 7f8d53fff640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c1094a0 0x7f8d5c19a9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400d740 tx=0x7f8d4400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.621+0000 7f8d597fa640 1 -- 172.21.15.81:0/1006403234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44017070 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.621+0000 7f8d597fa640 1 -- 172.21.15.81:0/1006403234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d4400de50 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.621+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c1a0690 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.621+0000 7f8d597fa640 1 -- 172.21.15.81:0/1006403234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400f620 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.621+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c1a6df0 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.622+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c103f70 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.623+0000 7f8d597fa640 1 -- 172.21.15.81:0/1006403234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8d4401a070 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.624+0000 7f8d597fa640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8d480b65a0 0x7f8d480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.624+0000 7f8d5b7fe640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8d480b65a0 0x7f8d480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.624+0000 7f8d597fa640 1 -- 172.21.15.81:0/1006403234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f8d440e7200 con 0x7f8d5c1094a0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.624+0000 7f8d5b7fe640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8d480b65a0 0x7f8d480b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0057c0 tx=0x7f8d4c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:34.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.628+0000 7f8d597fa640 1 -- 172.21.15.81:0/1006403234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d440ad5f0 con 0x7f8d5c1094a0 2024-09-21T02:59:34.656 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.823+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8d5c10b630 con 0x7f8d5c1094a0 2024-09-21T02:59:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.824+0000 7f8d597fa640 1 -- 172.21.15.81:0/1006403234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d440b19d0 con 0x7f8d5c1094a0 2024-09-21T02:59:34.825 INFO:teuthology.orchestra.run.smithi081.stdout:73014444106 2024-09-21T02:59:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8d480b65a0 msgr2=0x7f8d480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8d480b65a0 0x7f8d480b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0057c0 tx=0x7f8d4c0058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c1094a0 msgr2=0x7f8d5c19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c1094a0 0x7f8d5c19a9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400d740 tx=0x7f8d4400dc00 comp rx=0 tx=0).stop 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 shutdown_connections 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8d480b65a0 0x7f8d480b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8d5c109df0 0x7f8d5c19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c1094a0 0x7f8d5c19a9d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 --2- 172.21.15.81:0/1006403234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d5c103b60 0x7f8d5c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 >> 172.21.15.81:0/1006403234 conn(0x7f8d5c07b850 msgr2=0x7f8d5c107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 shutdown_connections 2024-09-21T02:59:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:34.826+0000 7f8d61e8e640 1 -- 172.21.15.81:0/1006403234 wait complete. 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 -- 172.21.15.81:0/3763450924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c108420 msgr2=0x7fb26c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 --2- 172.21.15.81:0/3763450924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c108420 0x7fb26c108830 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb260009900 tx=0x7fb26002a410 comp rx=0 tx=0).stop 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 -- 172.21.15.81:0/3763450924 shutdown_connections 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 --2- 172.21.15.81:0/3763450924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c108d70 0x7fb26c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 --2- 172.21.15.81:0/3763450924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c108420 0x7fb26c108830 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 --2- 172.21.15.81:0/3763450924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb26c102ae0 0x7fb26c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 -- 172.21.15.81:0/3763450924 >> 172.21.15.81:0/3763450924 conn(0x7fb26c079770 msgr2=0x7fb26c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 -- 172.21.15.81:0/3763450924 shutdown_connections 2024-09-21T02:59:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 -- 172.21.15.81:0/3763450924 wait complete. 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 Processor -- start 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.093+0000 7fb2745db640 1 -- start start 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb2745db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c102ae0 0x7fb26c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb2745db640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb26c108420 0x7fb26c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb2745db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c108d70 0x7fb26c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb2745db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c113a00 con 0x7fb26c102ae0 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb2745db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c113880 con 0x7fb26c108d70 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb2745db640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c113b80 con 0x7fb26c108420 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c102ae0 0x7fb26c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c102ae0 0x7fb26c19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60946/0 (socket says 172.21.15.81:60946) 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 -- 172.21.15.81:0/1417630579 learned_addr learned my addr 172.21.15.81:0/1417630579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb271b76640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb26c108420 0x7fb26c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272b78640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c108d70 0x7fb26c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 -- 172.21.15.81:0/1417630579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb26c108420 msgr2=0x7fb26c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb26c108420 0x7fb26c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 -- 172.21.15.81:0/1417630579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c108d70 msgr2=0x7fb26c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c108d70 0x7fb26c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 -- 172.21.15.81:0/1417630579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c1a0400 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb272377640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c102ae0 0x7fb26c19a490 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00cce0 tx=0x7fb25c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb26b7fe640 1 -- 172.21.15.81:0/1417630579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c004b20 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb26b7fe640 1 -- 172.21.15.81:0/1417630579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb25c004cc0 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.094+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c1a06f0 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.095+0000 7fb26b7fe640 1 -- 172.21.15.81:0/1417630579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c00f670 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.095+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c1a6e50 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.096+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c103d60 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.097+0000 7fb26b7fe640 1 -- 172.21.15.81:0/1417630579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb25c005540 con 0x7fb26c102ae0 2024-09-21T02:59:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.098+0000 7fb26b7fe640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2540b65a0 0x7fb2540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.098+0000 7fb271b76640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2540b65a0 0x7fb2540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.098+0000 7fb26b7fe640 1 -- 172.21.15.81:0/1417630579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb25c0e7990 con 0x7fb26c102ae0 2024-09-21T02:59:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.098+0000 7fb271b76640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2540b65a0 0x7fb2540b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2600057c0 tx=0x7fb260000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.102+0000 7fb26b7fe640 1 -- 172.21.15.81:0/1417630579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb25c014030 con 0x7fb26c102ae0 2024-09-21T02:59:35.116 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.290+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb26c10ab90 con 0x7fb26c102ae0 2024-09-21T02:59:35.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.291+0000 7fb26b7fe640 1 -- 172.21.15.81:0/1417630579 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb25c0add80 con 0x7fb26c102ae0 2024-09-21T02:59:35.293 INFO:teuthology.orchestra.run.smithi081.stdout:34359738453 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2540b65a0 msgr2=0x7fb2540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2540b65a0 0x7fb2540b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2600057c0 tx=0x7fb260000bc0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c102ae0 msgr2=0x7fb26c19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c102ae0 0x7fb26c19a490 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00cce0 tx=0x7fb25c00a620 comp rx=0 tx=0).stop 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 shutdown_connections 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2540b65a0 0x7fb2540b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb26c108420 0x7fb26c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c108d70 0x7fb26c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 --2- 172.21.15.81:0/1417630579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb26c102ae0 0x7fb26c19a490 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:35.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 >> 172.21.15.81:0/1417630579 conn(0x7fb26c079770 msgr2=0x7fb26c1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 shutdown_connections 2024-09-21T02:59:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:35.293+0000 7fb2745db640 1 -- 172.21.15.81:0/1417630579 wait complete. 2024-09-21T02:59:35.565 INFO:teuthology.orchestra.run.smithi081.stdout:150323855419 2024-09-21T02:59:35.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T02:59:35.997 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:35 smithi081 ceph-mon[30991]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:35.997 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:35 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1006403234' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:59:35.997 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:35 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1417630579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:59:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:35 smithi181 ceph-mon[34096]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:35 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1006403234' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:59:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:35 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1417630579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:59:36.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:35 smithi164 ceph-mon[34236]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:36.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:35 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1006403234' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:59:36.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:35 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1417630579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:59:36.356 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444104 got 73014444106 for osd.2 2024-09-21T02:59:36.356 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:36.552 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:36.553 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:36.993 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738450 got 34359738453 for osd.0 2024-09-21T02:59:36.994 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/672307405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 msgr2=0x7f2f78103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/672307405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f78103f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009900 tx=0x7f2f6802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/672307405 shutdown_connections 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/672307405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f78109df0 0x7f2f78110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/672307405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f781094a0 0x7f2f781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/672307405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f78103f70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/672307405 >> 172.21.15.81:0/672307405 conn(0x7f2f7807b850 msgr2=0x7f2f7807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/672307405 shutdown_connections 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/672307405 wait complete. 2024-09-21T02:59:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 Processor -- start 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.385+0000 7f2f7dd8a640 1 -- start start 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f7dd8a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f7819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f7dd8a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f781094a0 0x7f2f7819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f7dd8a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f78109df0 0x7f2f7819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f7dd8a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f78113960 con 0x7f2f78103b60 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f7dd8a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781137e0 con 0x7f2f781094a0 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f7dd8a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f78113ae0 con 0x7f2f78109df0 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f7819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f7819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60962/0 (socket says 172.21.15.81:60962) 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 -- 172.21.15.81:0/1173089805 learned_addr learned my addr 172.21.15.81:0/1173089805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f77fff640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f78109df0 0x7f2f7819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f6ffff640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f781094a0 0x7f2f7819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 -- 172.21.15.81:0/1173089805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f78109df0 msgr2=0x7f2f7819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f78109df0 0x7f2f7819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 -- 172.21.15.81:0/1173089805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f781094a0 msgr2=0x7f2f7819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f781094a0 0x7f2f7819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 -- 172.21.15.81:0/1173089805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f781a0340 con 0x7f2f78103b60 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f6ffff640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f781094a0 0x7f2f7819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f777fe640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f7819a3d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009230 tx=0x7f2f68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f757fa640 1 -- 172.21.15.81:0/1173089805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6803f030 con 0x7f2f78103b60 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f757fa640 1 -- 172.21.15.81:0/1173089805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f68003a80 con 0x7f2f78103b60 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f781a05d0 con 0x7f2f78103b60 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.386+0000 7f2f757fa640 1 -- 172.21.15.81:0/1173089805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68035070 con 0x7f2f78103b60 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.387+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f781a6d90 con 0x7f2f78103b60 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.387+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f78103f70 con 0x7f2f78103b60 2024-09-21T02:59:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.389+0000 7f2f757fa640 1 -- 172.21.15.81:0/1173089805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2f68042030 con 0x7f2f78103b60 2024-09-21T02:59:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.389+0000 7f2f757fa640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f640b65a0 0x7f2f640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.390+0000 7f2f6ffff640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f640b65a0 0x7f2f640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.390+0000 7f2f757fa640 1 -- 172.21.15.81:0/1173089805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2f68108310 con 0x7f2f78103b60 2024-09-21T02:59:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.390+0000 7f2f6ffff640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f640b65a0 0x7f2f640b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2f781065a0 tx=0x7f2f60005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.393+0000 7f2f757fa640 1 -- 172.21.15.81:0/1173089805 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f680ce700 con 0x7f2f78103b60 2024-09-21T02:59:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.583+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2f7819b500 con 0x7f2f78103b60 2024-09-21T02:59:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.583+0000 7f2f757fa640 1 -- 172.21.15.81:0/1173089805 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2f680b3e20 con 0x7f2f78103b60 2024-09-21T02:59:37.585 INFO:teuthology.orchestra.run.smithi081.stdout:128849018945 2024-09-21T02:59:37.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f640b65a0 msgr2=0x7f2f640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:37.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f640b65a0 0x7f2f640b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2f781065a0 tx=0x7f2f60005e50 comp rx=0 tx=0).stop 2024-09-21T02:59:37.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 msgr2=0x7f2f7819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:37.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f7819a3d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009230 tx=0x7f2f68004270 comp rx=0 tx=0).stop 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 shutdown_connections 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f640b65a0 0x7f2f640b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f78109df0 0x7f2f7819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f781094a0 0x7f2f7819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 --2- 172.21.15.81:0/1173089805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f78103b60 0x7f2f7819a3d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 >> 172.21.15.81:0/1173089805 conn(0x7f2f7807b850 msgr2=0x7f2f781075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 shutdown_connections 2024-09-21T02:59:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:37.586+0000 7f2f7dd8a640 1 -- 172.21.15.81:0/1173089805 wait complete. 2024-09-21T02:59:37.936 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:37 smithi081 ceph-mon[30991]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:37.936 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:37 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1173089805' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:59:37.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:37 smithi181 ceph-mon[34096]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:37.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:37 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1173089805' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:59:38.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:37 smithi164 ceph-mon[34236]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:38.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:37 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1173089805' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:59:38.257 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018943 got 128849018945 for osd.4 2024-09-21T02:59:38.257 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:38.438 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:38.438 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:38.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.440+0000 7f9d7926f640 1 -- 172.21.15.81:0/3940326346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d74101f70 msgr2=0x7f9d74102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:38.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.440+0000 7f9d7926f640 1 --2- 172.21.15.81:0/3940326346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d74101f70 0x7f9d74102380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009900 tx=0x7f9d6402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.440+0000 7f9d7926f640 1 -- 172.21.15.81:0/3940326346 shutdown_connections 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.441+0000 7f9d7926f640 1 --2- 172.21.15.81:0/3940326346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d74109e00 0x7f9d74110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.441+0000 7f9d7926f640 1 --2- 172.21.15.81:0/3940326346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d741094b0 0x7f9d741098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.441+0000 7f9d7926f640 1 --2- 172.21.15.81:0/3940326346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d74101f70 0x7f9d74102380 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.441+0000 7f9d7926f640 1 -- 172.21.15.81:0/3940326346 >> 172.21.15.81:0/3940326346 conn(0x7f9d74077c60 msgr2=0x7f9d740780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.441+0000 7f9d7926f640 1 -- 172.21.15.81:0/3940326346 shutdown_connections 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.441+0000 7f9d7926f640 1 -- 172.21.15.81:0/3940326346 wait complete. 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.442+0000 7f9d7926f640 1 Processor -- start 2024-09-21T02:59:38.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.442+0000 7f9d7926f640 1 -- start start 2024-09-21T02:59:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d7926f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d74101f70 0x7f9d7419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d7926f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d741094b0 0x7f9d7419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d7926f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d74109e00 0x7f9d7419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d7926f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74113970 con 0x7f9d741094b0 2024-09-21T02:59:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d7926f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741137f0 con 0x7f9d74101f70 2024-09-21T02:59:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d7926f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74113af0 con 0x7f9d74109e00 2024-09-21T02:59:38.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d741094b0 0x7f9d7419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d741094b0 0x7f9d7419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60992/0 (socket says 172.21.15.81:60992) 2024-09-21T02:59:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 -- 172.21.15.81:0/722695783 learned_addr learned my addr 172.21.15.81:0/722695783 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d72ffd640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d74101f70 0x7f9d7419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:38.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d737fe640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d74109e00 0x7f9d7419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 -- 172.21.15.81:0/722695783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d74109e00 msgr2=0x7f9d7419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d74109e00 0x7f9d7419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 -- 172.21.15.81:0/722695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d74101f70 msgr2=0x7f9d7419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d74101f70 0x7f9d7419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d727fc640 1 -- 172.21.15.81:0/722695783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d741a0390 con 0x7f9d741094b0 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.443+0000 7f9d72ffd640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d74101f70 0x7f9d7419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.444+0000 7f9d727fc640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d741094b0 0x7f9d7419a9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800e9f0 tx=0x7f9d6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.444+0000 7f9d5bfff640 1 -- 172.21.15.81:0/722695783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6800ccc0 con 0x7f9d741094b0 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.444+0000 7f9d5bfff640 1 -- 172.21.15.81:0/722695783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d680108c0 con 0x7f9d741094b0 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.444+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d741a0680 con 0x7f9d741094b0 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.444+0000 7f9d5bfff640 1 -- 172.21.15.81:0/722695783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68018750 con 0x7f9d741094b0 2024-09-21T02:59:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.444+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a6de0 con 0x7f9d741094b0 2024-09-21T02:59:38.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.446+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d74102380 con 0x7f9d741094b0 2024-09-21T02:59:38.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.447+0000 7f9d5bfff640 1 -- 172.21.15.81:0/722695783 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9d68010430 con 0x7f9d741094b0 2024-09-21T02:59:38.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.448+0000 7f9d5bfff640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9d5c0b6620 0x7f9d5c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:38.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.448+0000 7f9d72ffd640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9d5c0b6620 0x7f9d5c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:38.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.449+0000 7f9d5bfff640 1 -- 172.21.15.81:0/722695783 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f9d680e7ae0 con 0x7f9d741094b0 2024-09-21T02:59:38.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.449+0000 7f9d72ffd640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9d5c0b6620 0x7f9d5c0b8b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d640057c0 tx=0x7f9d640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.453+0000 7f9d5bfff640 1 -- 172.21.15.81:0/722695783 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d680b22b0 con 0x7f9d741094b0 2024-09-21T02:59:38.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.643+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9d7410bc30 con 0x7f9d741094b0 2024-09-21T02:59:38.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.644+0000 7f9d5bfff640 1 -- 172.21.15.81:0/722695783 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d680b71f0 con 0x7f9d741094b0 2024-09-21T02:59:38.646 INFO:teuthology.orchestra.run.smithi081.stdout:55834574928 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9d5c0b6620 msgr2=0x7f9d5c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9d5c0b6620 0x7f9d5c0b8b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d640057c0 tx=0x7f9d640058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d741094b0 msgr2=0x7f9d7419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d741094b0 0x7f9d7419a9c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800e9f0 tx=0x7f9d6800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 shutdown_connections 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9d5c0b6620 0x7f9d5c0b8b30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9d74109e00 0x7f9d7419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d741094b0 0x7f9d7419a9c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 --2- 172.21.15.81:0/722695783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d74101f70 0x7f9d7419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 >> 172.21.15.81:0/722695783 conn(0x7f9d74077c60 msgr2=0x7f9d74107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:38.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 shutdown_connections 2024-09-21T02:59:38.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:38.646+0000 7f9d7926f640 1 -- 172.21.15.81:0/722695783 wait complete. 2024-09-21T02:59:38.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:38 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/722695783' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:59:39.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:38 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/722695783' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:59:39.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:38 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/722695783' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:59:39.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574928 for osd.1 2024-09-21T02:59:39.434 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 -- 172.21.15.81:0/3690919124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc102a90 msgr2=0x7fcdfc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 --2- 172.21.15.81:0/3690919124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc102a90 0x7fcdfc102ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009900 tx=0x7fcdec02a410 comp rx=0 tx=0).stop 2024-09-21T02:59:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 -- 172.21.15.81:0/3690919124 shutdown_connections 2024-09-21T02:59:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 --2- 172.21.15.81:0/3690919124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdfc108d20 0x7fcdfc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:39.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 --2- 172.21.15.81:0/3690919124 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc1083d0 0x7fcdfc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 --2- 172.21.15.81:0/3690919124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc102a90 0x7fcdfc102ea0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 -- 172.21.15.81:0/3690919124 >> 172.21.15.81:0/3690919124 conn(0x7fcdfc079750 msgr2=0x7fcdfc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 -- 172.21.15.81:0/3690919124 shutdown_connections 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.915+0000 7fce023d0640 1 -- 172.21.15.81:0/3690919124 wait complete. 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 Processor -- start 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 -- start start 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdfc102a90 0x7fcdfc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc1083d0 0x7fcdfc19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc108d20 0x7fcdfc19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc112840 con 0x7fcdfc108d20 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc1126c0 con 0x7fcdfc1083d0 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce023d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc1129c0 con 0x7fcdfc102a90 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce0096d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc108d20 0x7fcdfc19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:39.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce0096d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc108d20 0x7fcdfc19bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60996/0 (socket says 172.21.15.81:60996) 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fce0096d640 1 -- 172.21.15.81:0/1854155657 learned_addr learned my addr 172.21.15.81:0/1854155657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.916+0000 7fcdf3fff640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc1083d0 0x7fcdfc19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fcdfbfff640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdfc102a90 0x7fcdfc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce0096d640 1 -- 172.21.15.81:0/1854155657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdfc102a90 msgr2=0x7fcdfc19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce0096d640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdfc102a90 0x7fcdfc19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce0096d640 1 -- 172.21.15.81:0/1854155657 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc1083d0 msgr2=0x7fcdfc19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce0096d640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc1083d0 0x7fcdfc19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce0096d640 1 -- 172.21.15.81:0/1854155657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc1a63b0 con 0x7fcdfc108d20 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fcdfbfff640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdfc102a90 0x7fcdfc19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce0096d640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc108d20 0x7fcdfc19bc30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400cce0 tx=0x7fcdf400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fcdf9ffb640 1 -- 172.21.15.81:0/1854155657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf400f450 con 0x7fcdfc108d20 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdfc1a66a0 con 0x7fcdfc108d20 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fcdf9ffb640 1 -- 172.21.15.81:0/1854155657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcdf400fa80 con 0x7fcdfc108d20 2024-09-21T02:59:39.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fcdf9ffb640 1 -- 172.21.15.81:0/1854155657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4018ad0 con 0x7fcdfc108d20 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.917+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdfc1a6be0 con 0x7fcdfc108d20 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.918+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdfc103d10 con 0x7fcdfc108d20 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.920+0000 7fcdf9ffb640 1 -- 172.21.15.81:0/1854155657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcdf400f5f0 con 0x7fcdfc108d20 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.921+0000 7fcdf9ffb640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcde80b65d0 0x7fcde80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.921+0000 7fcdfbfff640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcde80b65d0 0x7fcde80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.921+0000 7fcdf9ffb640 1 -- 172.21.15.81:0/1854155657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fcdf40e7f80 con 0x7fcdfc108d20 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.921+0000 7fcdfbfff640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcde80b65d0 0x7fcde80b8ae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcdec000c00 tx=0x7fcdec032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:39.925+0000 7fcdf9ffb640 1 -- 172.21.15.81:0/1854155657 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdf4014030 con 0x7fcdfc108d20 2024-09-21T02:59:39.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:39 smithi181 ceph-mon[34096]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:40.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:39 smithi081 ceph-mon[30991]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:40.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.111+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fcdfc10a560 con 0x7fcdfc108d20 2024-09-21T02:59:40.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.111+0000 7fcdf9ffb640 1 -- 172.21.15.81:0/1854155657 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcdf40ae370 con 0x7fcdfc108d20 2024-09-21T02:59:40.113 INFO:teuthology.orchestra.run.smithi081.stdout:292057776158 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcde80b65d0 msgr2=0x7fcde80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcde80b65d0 0x7fcde80b8ae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcdec000c00 tx=0x7fcdec032c80 comp rx=0 tx=0).stop 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc108d20 msgr2=0x7fcdfc19bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc108d20 0x7fcdfc19bc30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400cce0 tx=0x7fcdf400a620 comp rx=0 tx=0).stop 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 shutdown_connections 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fcde80b65d0 0x7fcde80b8ae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdfc108d20 0x7fcdfc19bc30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdfc1083d0 0x7fcdfc19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 --2- 172.21.15.81:0/1854155657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdfc102a90 0x7fcdfc19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 >> 172.21.15.81:0/1854155657 conn(0x7fcdfc079750 msgr2=0x7fcdfc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 shutdown_connections 2024-09-21T02:59:40.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.113+0000 7fce023d0640 1 -- 172.21.15.81:0/1854155657 wait complete. 2024-09-21T02:59:40.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:39 smithi164 ceph-mon[34236]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 -- 172.21.15.81:0/803122676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 msgr2=0x7f1118104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 --2- 172.21.15.81:0/803122676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f1118104df0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1114009900 tx=0x7f111402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 -- 172.21.15.81:0/803122676 shutdown_connections 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 --2- 172.21.15.81:0/803122676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111810de40 0x7f1118110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 --2- 172.21.15.81:0/803122676 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1118105330 0x7f111810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 --2- 172.21.15.81:0/803122676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f1118104df0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 -- 172.21.15.81:0/803122676 >> 172.21.15.81:0/803122676 conn(0x7f1118079730 msgr2=0x7f1118079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 -- 172.21.15.81:0/803122676 shutdown_connections 2024-09-21T02:59:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.686+0000 7f111f73d640 1 -- 172.21.15.81:0/803122676 wait complete. 2024-09-21T02:59:40.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.687+0000 7f111f73d640 1 Processor -- start 2024-09-21T02:59:40.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.687+0000 7f111f73d640 1 -- start start 2024-09-21T02:59:40.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111f73d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f111819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:40.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111f73d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1118105330 0x7f111819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111f73d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111810de40 0x7f111819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111f73d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1118113950 con 0x7f11181049e0 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111d4d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f111819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111d4d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f111819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32798/0 (socket says 172.21.15.81:32798) 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111d4d9640 1 -- 172.21.15.81:0/1777011255 learned_addr learned my addr 172.21.15.81:0/1777011255 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111dcda640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111810de40 0x7f111819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111ccd8640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1118105330 0x7f111819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111f73d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f11181137d0 con 0x7f1118105330 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.688+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1118113ad0 con 0x7f111810de40 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111d4d9640 1 -- 172.21.15.81:0/1777011255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111810de40 msgr2=0x7f111819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111d4d9640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111810de40 0x7f111819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111d4d9640 1 -- 172.21.15.81:0/1777011255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1118105330 msgr2=0x7f111819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111d4d9640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1118105330 0x7f111819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111d4d9640 1 -- 172.21.15.81:0/1777011255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11181a03b0 con 0x7f11181049e0 2024-09-21T02:59:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111d4d9640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f111819a440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1114009230 tx=0x7f1114004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f110e7fc640 1 -- 172.21.15.81:0/1777011255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111403f030 con 0x7f11181049e0 2024-09-21T02:59:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11181a0640 con 0x7f11181049e0 2024-09-21T02:59:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f110e7fc640 1 -- 172.21.15.81:0/1777011255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1114003a80 con 0x7f11181049e0 2024-09-21T02:59:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f110e7fc640 1 -- 172.21.15.81:0/1777011255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114035070 con 0x7f11181049e0 2024-09-21T02:59:40.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.689+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11181a6e00 con 0x7f11181049e0 2024-09-21T02:59:40.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.690+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111806c280 con 0x7f11181049e0 2024-09-21T02:59:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.693+0000 7f110e7fc640 1 -- 172.21.15.81:0/1777011255 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1114042030 con 0x7f11181049e0 2024-09-21T02:59:40.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.694+0000 7f110e7fc640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11040b65a0 0x7f11040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.694+0000 7f111ccd8640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11040b65a0 0x7f11040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.694+0000 7f110e7fc640 1 -- 172.21.15.81:0/1777011255 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1114108260 con 0x7f11181049e0 2024-09-21T02:59:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.695+0000 7f111ccd8640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11040b65a0 0x7f11040b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11080095f0 tx=0x7f1108005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.697+0000 7f110e7fc640 1 -- 172.21.15.81:0/1777011255 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11140d2a30 con 0x7f11181049e0 2024-09-21T02:59:40.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.888+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1118104df0 con 0x7f11181049e0 2024-09-21T02:59:40.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.888+0000 7f110e7fc640 1 -- 172.21.15.81:0/1777011255 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f11140b3e20 con 0x7f11181049e0 2024-09-21T02:59:40.890 INFO:teuthology.orchestra.run.smithi081.stdout:176093659192 2024-09-21T02:59:40.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11040b65a0 msgr2=0x7f11040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:40.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11040b65a0 0x7f11040b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11080095f0 tx=0x7f1108005f90 comp rx=0 tx=0).stop 2024-09-21T02:59:40.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 msgr2=0x7f111819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:40.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f111819a440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1114009230 tx=0x7f1114004270 comp rx=0 tx=0).stop 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 shutdown_connections 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11040b65a0 0x7f11040b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f111810de40 0x7f111819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1118105330 0x7f111819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 --2- 172.21.15.81:0/1777011255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11181049e0 0x7f111819a440 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.890+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 >> 172.21.15.81:0/1777011255 conn(0x7f1118079730 msgr2=0x7f11181068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.891+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 shutdown_connections 2024-09-21T02:59:40.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.891+0000 7f111f73d640 1 -- 172.21.15.81:0/1777011255 wait complete. 2024-09-21T02:59:40.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:40 smithi181 ceph-mon[34096]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:40.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:40 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1854155657' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:59:41.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:40 smithi081 ceph-mon[30991]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:41.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:40 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1854155657' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:59:41.158 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776156 got 292057776158 for osd.11 2024-09-21T02:59:41.158 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:41.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:40 smithi164 ceph-mon[34236]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:41.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:40 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1854155657' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:59:41.788 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659190 got 176093659192 for osd.6 2024-09-21T02:59:41.789 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 -- 172.21.15.81:0/736730569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43641083e0 msgr2=0x7f43641087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 --2- 172.21.15.81:0/736730569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43641083e0 0x7f43641087f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4358009900 tx=0x7f435802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 -- 172.21.15.81:0/736730569 shutdown_connections 2024-09-21T02:59:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 --2- 172.21.15.81:0/736730569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4364108d30 0x7f436410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:41.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 --2- 172.21.15.81:0/736730569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43641083e0 0x7f43641087f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 --2- 172.21.15.81:0/736730569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4364102aa0 0x7f4364102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 -- 172.21.15.81:0/736730569 >> 172.21.15.81:0/736730569 conn(0x7f43640797e0 msgr2=0x7f4364079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 -- 172.21.15.81:0/736730569 shutdown_connections 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.943+0000 7f436a6e9640 1 -- 172.21.15.81:0/736730569 wait complete. 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 Processor -- start 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 -- start start 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4364102aa0 0x7f436419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43641083e0 0x7f436419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4364108d30 0x7f436419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4364112850 con 0x7f4364102aa0 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f43641126d0 con 0x7f43641083e0 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f436a6e9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f43641129d0 con 0x7f4364108d30 2024-09-21T02:59:41.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f4363fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4364102aa0 0x7f436419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f4363fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4364102aa0 0x7f436419b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40602/0 (socket says 172.21.15.81:40602) 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.944+0000 7f4363fff640 1 -- 172.21.15.81:0/3540162473 learned_addr learned my addr 172.21.15.81:0/3540162473 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f43637fe640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43641083e0 0x7f436419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f4368c86640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4364108d30 0x7f436419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f4363fff640 1 -- 172.21.15.81:0/3540162473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4364108d30 msgr2=0x7f436419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f4363fff640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4364108d30 0x7f436419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f4363fff640 1 -- 172.21.15.81:0/3540162473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43641083e0 msgr2=0x7f436419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f4363fff640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43641083e0 0x7f436419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f4363fff640 1 -- 172.21.15.81:0/3540162473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43641a64d0 con 0x7f4364102aa0 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f43637fe640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43641083e0 0x7f436419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f4363fff640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4364102aa0 0x7f436419b2a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f435400d950 tx=0x7f435400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f43617fa640 1 -- 172.21.15.81:0/3540162473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354017030 con 0x7f4364102aa0 2024-09-21T02:59:41.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f43617fa640 1 -- 172.21.15.81:0/3540162473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4354004020 con 0x7f4364102aa0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43641a67c0 con 0x7f4364102aa0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f43617fa640 1 -- 172.21.15.81:0/3540162473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43540055d0 con 0x7f4364102aa0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.945+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43641a6cd0 con 0x7f4364102aa0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.946+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4364102eb0 con 0x7f4364102aa0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.948+0000 7f43617fa640 1 -- 172.21.15.81:0/3540162473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4354009a30 con 0x7f4364102aa0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.948+0000 7f43617fa640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f434c0b65a0 0x7f434c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.948+0000 7f43637fe640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f434c0b65a0 0x7f434c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.948+0000 7f43617fa640 1 -- 172.21.15.81:0/3540162473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f43540e7900 con 0x7f4364102aa0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.949+0000 7f43637fe640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f434c0b65a0 0x7f434c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4358006010 tx=0x7f4358005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:41.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:41.951+0000 7f43617fa640 1 -- 172.21.15.81:0/3540162473 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43540adcf0 con 0x7f4364102aa0 2024-09-21T02:59:41.957 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:41.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:41 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3787135760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:59:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:41 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1777011255' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:59:42.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:41 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3787135760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:59:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:41 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1777011255' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:59:42.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.146+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f436406bc50 con 0x7f4364102aa0 2024-09-21T02:59:42.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.147+0000 7f43617fa640 1 -- 172.21.15.81:0/3540162473 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f43540b20d0 con 0x7f4364102aa0 2024-09-21T02:59:42.149 INFO:teuthology.orchestra.run.smithi081.stdout:197568495667 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f434c0b65a0 msgr2=0x7f434c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f434c0b65a0 0x7f434c0b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4358006010 tx=0x7f4358005de0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4364102aa0 msgr2=0x7f436419b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4364102aa0 0x7f436419b2a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f435400d950 tx=0x7f435400de10 comp rx=0 tx=0).stop 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 shutdown_connections 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f434c0b65a0 0x7f434c0b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4364108d30 0x7f436419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f43641083e0 0x7f436419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 --2- 172.21.15.81:0/3540162473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4364102aa0 0x7f436419b2a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 >> 172.21.15.81:0/3540162473 conn(0x7f43640797e0 msgr2=0x7f43641045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:42.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 shutdown_connections 2024-09-21T02:59:42.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:42.149+0000 7f436a6e9640 1 -- 172.21.15.81:0/3540162473 wait complete. 2024-09-21T02:59:42.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:41 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3787135760' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:59:42.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:41 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1777011255' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.574+0000 7ff7cc963640 1 -- 172.21.15.81:0/2460455189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106280 msgr2=0x7ff7c8106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.574+0000 7ff7cc963640 1 --2- 172.21.15.81:0/2460455189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106280 0x7ff7c8106690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009900 tx=0x7ff7b002a410 comp rx=0 tx=0).stop 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.575+0000 7ff7cc963640 1 -- 172.21.15.81:0/2460455189 shutdown_connections 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.575+0000 7ff7cc963640 1 --2- 172.21.15.81:0/2460455189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c8106bd0 0x7ff7c8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.575+0000 7ff7cc963640 1 --2- 172.21.15.81:0/2460455189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106280 0x7ff7c8106690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.575+0000 7ff7cc963640 1 --2- 172.21.15.81:0/2460455189 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7c8102030 0x7ff7c8102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.575+0000 7ff7cc963640 1 -- 172.21.15.81:0/2460455189 >> 172.21.15.81:0/2460455189 conn(0x7ff7c8077c60 msgr2=0x7ff7c80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.575+0000 7ff7cc963640 1 -- 172.21.15.81:0/2460455189 shutdown_connections 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.575+0000 7ff7cc963640 1 -- 172.21.15.81:0/2460455189 wait complete. 2024-09-21T02:59:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 Processor -- start 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 -- start start 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7c8102030 0x7ff7c819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c8106280 0x7ff7c819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106bd0 0x7ff7c819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8113950 con 0x7ff7c8106bd0 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c81137d0 con 0x7ff7c8106280 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7cc963640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8113ad0 con 0x7ff7c8102030 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7c6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106bd0 0x7ff7c819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.576+0000 7ff7c6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106bd0 0x7ff7c819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32776/0 (socket says 172.21.15.81:32776) 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c6d9d640 1 -- 172.21.15.81:0/3787135760 learned_addr learned my addr 172.21.15.81:0/3787135760 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c659c640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7c8102030 0x7ff7c819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c5d9b640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c8106280 0x7ff7c819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c6d9d640 1 -- 172.21.15.81:0/3787135760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7c8102030 msgr2=0x7ff7c819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:42.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c6d9d640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7c8102030 0x7ff7c819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c6d9d640 1 -- 172.21.15.81:0/3787135760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c8106280 msgr2=0x7ff7c819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c6d9d640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c8106280 0x7ff7c819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c6d9d640 1 -- 172.21.15.81:0/3787135760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c81a0290 con 0x7ff7c8106bd0 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7c6d9d640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106bd0 0x7ff7c819fc20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000cce0 tx=0x7ff7c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7bf7fe640 1 -- 172.21.15.81:0/3787135760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000f450 con 0x7ff7c8106bd0 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stdout:244813135913 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c81a0580 con 0x7ff7c8106bd0 2024-09-21T02:59:42.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7bf7fe640 1 -- 172.21.15.81:0/3787135760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7c000fa80 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7bf7fe640 1 -- 172.21.15.81:0/3787135760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0018ad0 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.577+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c81a6da0 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.579+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c806ab90 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.580+0000 7ff7bf7fe640 1 -- 172.21.15.81:0/3787135760 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff7c000f5f0 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.582+0000 7ff7bf7fe640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff7b40b65d0 0x7ff7b40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.582+0000 7ff7c659c640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff7b40b65d0 0x7ff7b40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.582+0000 7ff7bf7fe640 1 -- 172.21.15.81:0/3787135760 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ff7c00e7f80 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.583+0000 7ff7c659c640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff7b40b65d0 0x7ff7b40b8ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8005fd0 tx=0x7ff7b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.589+0000 7ff7bf7fe640 1 -- 172.21.15.81:0/3787135760 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7c0014030 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.801+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff7c810bcf0 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.801+0000 7ff7bf7fe640 1 -- 172.21.15.81:0/3787135760 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff7c00ae400 con 0x7ff7c8106bd0 2024-09-21T02:59:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff7b40b65d0 msgr2=0x7ff7b40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff7b40b65d0 0x7ff7b40b8ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8005fd0 tx=0x7ff7b800b390 comp rx=0 tx=0).stop 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106bd0 msgr2=0x7ff7c819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106bd0 0x7ff7c819fc20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000cce0 tx=0x7ff7c000a620 comp rx=0 tx=0).stop 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 shutdown_connections 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff7b40b65d0 0x7ff7b40b8ae0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7c8106bd0 0x7ff7c819fc20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7c8106280 0x7ff7c819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 --2- 172.21.15.81:0/3787135760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7c8102030 0x7ff7c819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.803+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 >> 172.21.15.81:0/3787135760 conn(0x7ff7c8077c60 msgr2=0x7ff7c81075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.804+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 shutdown_connections 2024-09-21T02:59:42.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:40.804+0000 7ff7cc963640 1 -- 172.21.15.81:0/3787135760 wait complete. 2024-09-21T02:59:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:42.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:42 smithi081 ceph-mon[30991]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T02:59:42.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:42 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3540162473' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:59:42.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:42 smithi181 ceph-mon[34096]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T02:59:42.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:42 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3540162473' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:59:43.172 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135911 got 244813135913 for osd.9 2024-09-21T02:59:43.173 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:42 smithi164 ceph-mon[34236]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T02:59:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:42 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3540162473' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:59:43.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 -- 172.21.15.81:0/3650842556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b8108d20 msgr2=0x7f47b810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3650842556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b8108d20 0x7f47b810f550 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009ca0 tx=0x7f47b002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 -- 172.21.15.81:0/3650842556 shutdown_connections 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3650842556 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47b81083d0 0x7f47b81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3650842556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b8108d20 0x7f47b810f550 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3650842556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47b8102ae0 0x7f47b8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 -- 172.21.15.81:0/3650842556 >> 172.21.15.81:0/3650842556 conn(0x7f47b8079760 msgr2=0x7f47b8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 -- 172.21.15.81:0/3650842556 shutdown_connections 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.597+0000 7f47c04a7640 1 -- 172.21.15.81:0/3650842556 wait complete. 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 Processor -- start 2024-09-21T02:59:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 -- start start 2024-09-21T02:59:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47b8102ae0 0x7f47b819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b81083d0 0x7f47b819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47b8108d20 0x7f47b819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8112890 con 0x7f47b81083d0 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8112710 con 0x7f47b8102ae0 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47c04a7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8112a10 con 0x7f47b8108d20 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47bda42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b81083d0 0x7f47b819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47bda42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b81083d0 0x7f47b819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40630/0 (socket says 172.21.15.81:40630) 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.598+0000 7f47bda42640 1 -- 172.21.15.81:0/3313358265 learned_addr learned my addr 172.21.15.81:0/3313358265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47be243640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47b8102ae0 0x7f47b819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47bea44640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47b8108d20 0x7f47b819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47bda42640 1 -- 172.21.15.81:0/3313358265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47b8108d20 msgr2=0x7f47b819bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47bda42640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47b8108d20 0x7f47b819bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47bda42640 1 -- 172.21.15.81:0/3313358265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47b8102ae0 msgr2=0x7f47b819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47bda42640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47b8102ae0 0x7f47b819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47bda42640 1 -- 172.21.15.81:0/3313358265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81a6450 con 0x7f47b81083d0 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47bda42640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b81083d0 0x7f47b819b700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f47a8005fd0 tx=0x7f47a800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47af7fe640 1 -- 172.21.15.81:0/3313358265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8017070 con 0x7f47b81083d0 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81a6740 con 0x7f47b81083d0 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47af7fe640 1 -- 172.21.15.81:0/3313358265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47a8009c30 con 0x7f47b81083d0 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47af7fe640 1 -- 172.21.15.81:0/3313358265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8003c70 con 0x7f47b81083d0 2024-09-21T02:59:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.599+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81a6c80 con 0x7f47b81083d0 2024-09-21T02:59:43.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.601+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b8103d10 con 0x7f47b81083d0 2024-09-21T02:59:43.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.602+0000 7f47af7fe640 1 -- 172.21.15.81:0/3313358265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f47a8003e10 con 0x7f47b81083d0 2024-09-21T02:59:43.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.603+0000 7f47af7fe640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f47a40b65d0 0x7f47a40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.603+0000 7f47be243640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f47a40b65d0 0x7f47a40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.603+0000 7f47af7fe640 1 -- 172.21.15.81:0/3313358265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f47a80e7330 con 0x7f47b81083d0 2024-09-21T02:59:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.603+0000 7f47be243640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f47a40b65d0 0x7f47a40b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47b806c6a0 tx=0x7f47b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:43.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.611+0000 7f47af7fe640 1 -- 172.21.15.81:0/3313358265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47a8020030 con 0x7f47b81083d0 2024-09-21T02:59:43.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.798+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f47b8102ef0 con 0x7f47b81083d0 2024-09-21T02:59:43.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.799+0000 7f47af7fe640 1 -- 172.21.15.81:0/3313358265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f47a80ad720 con 0x7f47b81083d0 2024-09-21T02:59:43.800 INFO:teuthology.orchestra.run.smithi081.stdout:103079215175 2024-09-21T02:59:43.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f47a40b65d0 msgr2=0x7f47a40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f47a40b65d0 0x7f47a40b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47b806c6a0 tx=0x7f47b4005f90 comp rx=0 tx=0).stop 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b81083d0 msgr2=0x7f47b819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b81083d0 0x7f47b819b700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f47a8005fd0 tx=0x7f47a800dde0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 shutdown_connections 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f47a40b65d0 0x7f47a40b8ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f47b8108d20 0x7f47b819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47b81083d0 0x7f47b819b700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 --2- 172.21.15.81:0/3313358265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f47b8102ae0 0x7f47b819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 >> 172.21.15.81:0/3313358265 conn(0x7f47b8079760 msgr2=0x7f47b8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 shutdown_connections 2024-09-21T02:59:43.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.801+0000 7f47c04a7640 1 -- 172.21.15.81:0/3313358265 wait complete. 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.817+0000 7fe063781640 1 -- 172.21.15.81:0/1865145716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c108d30 msgr2=0x7fe05c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.817+0000 7fe063781640 1 --2- 172.21.15.81:0/1865145716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c108d30 0x7fe05c10f560 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe054009ca0 tx=0x7fe05402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.817+0000 7fe063781640 1 -- 172.21.15.81:0/1865145716 shutdown_connections 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.817+0000 7fe063781640 1 --2- 172.21.15.81:0/1865145716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c108d30 0x7fe05c10f560 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.817+0000 7fe063781640 1 --2- 172.21.15.81:0/1865145716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05c1083e0 0x7fe05c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.817+0000 7fe063781640 1 --2- 172.21.15.81:0/1865145716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c102aa0 0x7fe05c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.817+0000 7fe063781640 1 -- 172.21.15.81:0/1865145716 >> 172.21.15.81:0/1865145716 conn(0x7fe05c0797e0 msgr2=0x7fe05c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.818+0000 7fe063781640 1 -- 172.21.15.81:0/1865145716 shutdown_connections 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.818+0000 7fe063781640 1 -- 172.21.15.81:0/1865145716 wait complete. 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.818+0000 7fe063781640 1 Processor -- start 2024-09-21T02:59:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.818+0000 7fe063781640 1 -- start start 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe063781640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05c102aa0 0x7fe05c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe063781640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c1083e0 0x7fe05c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe063781640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c108d30 0x7fe05c19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe063781640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1128a0 con 0x7fe05c1083e0 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe063781640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c112720 con 0x7fe05c102aa0 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe063781640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c112a20 con 0x7fe05c108d30 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c1083e0 0x7fe05c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c1083e0 0x7fe05c19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40640/0 (socket says 172.21.15.81:40640) 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 -- 172.21.15.81:0/360037016 learned_addr learned my addr 172.21.15.81:0/360037016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe06151d640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05c102aa0 0x7fe05c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe061d1e640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c108d30 0x7fe05c19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 -- 172.21.15.81:0/360037016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c108d30 msgr2=0x7fe05c19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c108d30 0x7fe05c19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 -- 172.21.15.81:0/360037016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05c102aa0 msgr2=0x7fe05c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05c102aa0 0x7fe05c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 -- 172.21.15.81:0/360037016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c1a02b0 con 0x7fe05c1083e0 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.819+0000 7fe060d1c640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c1083e0 0x7fe05c19a8e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe04c005fd0 tx=0x7fe04c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.820+0000 7fe0527fc640 1 -- 172.21.15.81:0/360037016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c017070 con 0x7fe05c1083e0 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.820+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05c1a05a0 con 0x7fe05c1083e0 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.820+0000 7fe0527fc640 1 -- 172.21.15.81:0/360037016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe04c009c30 con 0x7fe05c1083e0 2024-09-21T02:59:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.820+0000 7fe0527fc640 1 -- 172.21.15.81:0/360037016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c003c70 con 0x7fe05c1083e0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.820+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05c1a6d00 con 0x7fe05c1083e0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.821+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05c102eb0 con 0x7fe05c1083e0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.822+0000 7fe0527fc640 1 -- 172.21.15.81:0/360037016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe04c003e10 con 0x7fe05c1083e0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.823+0000 7fe0527fc640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe0480b65a0 0x7fe0480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.823+0000 7fe06151d640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe0480b65a0 0x7fe0480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.823+0000 7fe0527fc640 1 -- 172.21.15.81:0/360037016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe04c0e7450 con 0x7fe05c1083e0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.824+0000 7fe06151d640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe0480b65a0 0x7fe0480b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe058009bd0 tx=0x7fe058005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:43.828+0000 7fe0527fc640 1 -- 172.21.15.81:0/360037016 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe04c020030 con 0x7fe05c1083e0 2024-09-21T02:59:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.012+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe05c1a6fa0 con 0x7fe05c1083e0 2024-09-21T02:59:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.012+0000 7fe0527fc640 1 -- 172.21.15.81:0/360037016 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe04c0ad840 con 0x7fe05c1083e0 2024-09-21T02:59:44.014 INFO:teuthology.orchestra.run.smithi081.stdout:266287972388 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe0480b65a0 msgr2=0x7fe0480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe0480b65a0 0x7fe0480b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe058009bd0 tx=0x7fe058005f90 comp rx=0 tx=0).stop 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c1083e0 msgr2=0x7fe05c19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c1083e0 0x7fe05c19a8e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe04c005fd0 tx=0x7fe04c00dde0 comp rx=0 tx=0).stop 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 shutdown_connections 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe0480b65a0 0x7fe0480b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe05c108d30 0x7fe05c19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe05c1083e0 0x7fe05c19a8e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 --2- 172.21.15.81:0/360037016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe05c102aa0 0x7fe05c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:44.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 >> 172.21.15.81:0/360037016 conn(0x7fe05c0797e0 msgr2=0x7fe05c101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 shutdown_connections 2024-09-21T02:59:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:44.014+0000 7fe063781640 1 -- 172.21.15.81:0/360037016 wait complete. 2024-09-21T02:59:44.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972385 got 266287972388 for osd.10 2024-09-21T02:59:44.730 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:45.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:44 smithi081 ceph-mon[30991]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:44 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3313358265' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:59:45.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:44 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/360037016' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:59:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:44 smithi164 ceph-mon[34236]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:44 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3313358265' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:59:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:44 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/360037016' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:59:45.189 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495664 got 197568495667 for osd.7 2024-09-21T02:59:45.189 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:45.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:44 smithi181 ceph-mon[34096]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:45.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:44 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3313358265' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:59:45.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:44 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/360037016' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:59:45.655 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215171 got 103079215175 for osd.3 2024-09-21T02:59:45.656 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:46.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 -- 172.21.15.81:0/95174522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc109df0 msgr2=0x7f60bc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:46.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 --2- 172.21.15.81:0/95174522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc109df0 0x7f60bc110620 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009ca0 tx=0x7f60b402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 -- 172.21.15.81:0/95174522 shutdown_connections 2024-09-21T02:59:46.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 --2- 172.21.15.81:0/95174522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc109df0 0x7f60bc110620 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 --2- 172.21.15.81:0/95174522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc1094a0 0x7f60bc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 --2- 172.21.15.81:0/95174522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60bc103b60 0x7f60bc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 -- 172.21.15.81:0/95174522 >> 172.21.15.81:0/95174522 conn(0x7f60bc07b850 msgr2=0x7f60bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 -- 172.21.15.81:0/95174522 shutdown_connections 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.090+0000 7f60c3133640 1 -- 172.21.15.81:0/95174522 wait complete. 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 Processor -- start 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 -- start start 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60bc103b60 0x7f60bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc1094a0 0x7f60bc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc109df0 0x7f60bc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc113a10 con 0x7f60bc1094a0 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc113890 con 0x7f60bc109df0 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60c3133640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc113b90 con 0x7f60bc103b60 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc1094a0 0x7f60bc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:46.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc1094a0 0x7f60bc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40646/0 (socket says 172.21.15.81:40646) 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.091+0000 7f60b3fff640 1 -- 172.21.15.81:0/3827017231 learned_addr learned my addr 172.21.15.81:0/3827017231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60c16d0640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc109df0 0x7f60bc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60c0ecf640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60bc103b60 0x7f60bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b3fff640 1 -- 172.21.15.81:0/3827017231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60bc103b60 msgr2=0x7f60bc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b3fff640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60bc103b60 0x7f60bc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b3fff640 1 -- 172.21.15.81:0/3827017231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc109df0 msgr2=0x7f60bc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b3fff640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc109df0 0x7f60bc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b3fff640 1 -- 172.21.15.81:0/3827017231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1a8730 con 0x7f60bc1094a0 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60c0ecf640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60bc103b60 0x7f60bc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60c16d0640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc109df0 0x7f60bc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b3fff640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc1094a0 0x7f60bc075c50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00c8c0 tx=0x7f60ac00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b1ffb640 1 -- 172.21.15.81:0/3827017231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac007bb0 con 0x7f60bc1094a0 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc1a8a20 con 0x7f60bc1094a0 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b1ffb640 1 -- 172.21.15.81:0/3827017231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60ac007d50 con 0x7f60bc1094a0 2024-09-21T02:59:46.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60b1ffb640 1 -- 172.21.15.81:0/3827017231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac018660 con 0x7f60bc1094a0 2024-09-21T02:59:46.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.092+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc1a8f60 con 0x7f60bc1094a0 2024-09-21T02:59:46.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.093+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60bc103f70 con 0x7f60bc1094a0 2024-09-21T02:59:46.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.095+0000 7f60b1ffb640 1 -- 172.21.15.81:0/3827017231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f60ac00fa00 con 0x7f60bc1094a0 2024-09-21T02:59:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.096+0000 7f60b1ffb640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f60a40b65a0 0x7f60a40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.096+0000 7f60c0ecf640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f60a40b65a0 0x7f60a40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.096+0000 7f60b1ffb640 1 -- 172.21.15.81:0/3827017231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f60ac0e7bf0 con 0x7f60bc1094a0 2024-09-21T02:59:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.096+0000 7f60c0ecf640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f60a40b65a0 0x7f60a40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006fd0 tx=0x7f60b8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.099+0000 7f60b1ffb640 1 -- 172.21.15.81:0/3827017231 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60ac014030 con 0x7f60bc1094a0 2024-09-21T02:59:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.286+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f60bc02e640 con 0x7f60bc1094a0 2024-09-21T02:59:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.287+0000 7f60b1ffb640 1 -- 172.21.15.81:0/3827017231 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f60ac0ae070 con 0x7f60bc1094a0 2024-09-21T02:59:46.288 INFO:teuthology.orchestra.run.smithi081.stdout:150323855421 2024-09-21T02:59:46.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f60a40b65a0 msgr2=0x7f60a40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f60a40b65a0 0x7f60a40b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006fd0 tx=0x7f60b8008040 comp rx=0 tx=0).stop 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc1094a0 msgr2=0x7f60bc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc1094a0 0x7f60bc075c50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00c8c0 tx=0x7f60ac00cd80 comp rx=0 tx=0).stop 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 shutdown_connections 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f60a40b65a0 0x7f60a40b8ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60bc109df0 0x7f60bc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60bc1094a0 0x7f60bc075c50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 --2- 172.21.15.81:0/3827017231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f60bc103b60 0x7f60bc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 >> 172.21.15.81:0/3827017231 conn(0x7f60bc07b850 msgr2=0x7f60bc107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 shutdown_connections 2024-09-21T02:59:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:46.289+0000 7f60c3133640 1 -- 172.21.15.81:0/3827017231 wait complete. 2024-09-21T02:59:46.978 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855419 got 150323855421 for osd.5 2024-09-21T02:59:46.978 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:47.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:47 smithi081 ceph-mon[30991]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:47.220 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:47 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3827017231' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 -- 172.21.15.81:0/4093991769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8102ae0 msgr2=0x7fa0e8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 --2- 172.21.15.81:0/4093991769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8102ae0 0x7fa0e8102ef0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009900 tx=0x7fa0d802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 -- 172.21.15.81:0/4093991769 shutdown_connections 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 --2- 172.21.15.81:0/4093991769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0e8108d20 0x7fa0e810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 --2- 172.21.15.81:0/4093991769 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0e81083d0 0x7fa0e81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 --2- 172.21.15.81:0/4093991769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8102ae0 0x7fa0e8102ef0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 -- 172.21.15.81:0/4093991769 >> 172.21.15.81:0/4093991769 conn(0x7fa0e8079760 msgr2=0x7fa0e8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 -- 172.21.15.81:0/4093991769 shutdown_connections 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.219+0000 7fa0ee018640 1 -- 172.21.15.81:0/4093991769 wait complete. 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 Processor -- start 2024-09-21T02:59:47.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 -- start start 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0e8102ae0 0x7fa0e819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0e81083d0 0x7fa0e819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8108d20 0x7fa0e819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8113960 con 0x7fa0e8108d20 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e81137e0 con 0x7fa0e8102ae0 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0ee018640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e8113ae0 con 0x7fa0e81083d0 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0e7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8108d20 0x7fa0e819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0e7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8108d20 0x7fa0e819fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40652/0 (socket says 172.21.15.81:40652) 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0e7fff640 1 -- 172.21.15.81:0/740837225 learned_addr learned my addr 172.21.15.81:0/740837225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0e77fe640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0e8102ae0 0x7fa0e819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.220+0000 7fa0e6ffd640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0e81083d0 0x7fa0e819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e7fff640 1 -- 172.21.15.81:0/740837225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0e81083d0 msgr2=0x7fa0e819a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e7fff640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0e81083d0 0x7fa0e819a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e7fff640 1 -- 172.21.15.81:0/740837225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0e8102ae0 msgr2=0x7fa0e819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:47.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e7fff640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0e8102ae0 0x7fa0e819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e7fff640 1 -- 172.21.15.81:0/740837225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e81a02e0 con 0x7fa0e8108d20 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e6ffd640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0e81083d0 0x7fa0e819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e7fff640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8108d20 0x7fa0e819fbb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000eaa0 tx=0x7fa0e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e4ff9640 1 -- 172.21.15.81:0/740837225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000cdb0 con 0x7fa0e8108d20 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e81a05d0 con 0x7fa0e8108d20 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e4ff9640 1 -- 172.21.15.81:0/740837225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0e0005020 con 0x7fa0e8108d20 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0e4ff9640 1 -- 172.21.15.81:0/740837225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00116d0 con 0x7fa0e8108d20 2024-09-21T02:59:47.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.221+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e81a6d30 con 0x7fa0e8108d20 2024-09-21T02:59:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.222+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e8103d10 con 0x7fa0e8108d20 2024-09-21T02:59:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.224+0000 7fa0e4ff9640 1 -- 172.21.15.81:0/740837225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa0e0004a40 con 0x7fa0e8108d20 2024-09-21T02:59:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.225+0000 7fa0e4ff9640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0d00b6620 0x7fa0d00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.225+0000 7fa0e77fe640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0d00b6620 0x7fa0d00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:47.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.225+0000 7fa0e4ff9640 1 -- 172.21.15.81:0/740837225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fa0e00e7c40 con 0x7fa0e8108d20 2024-09-21T02:59:47.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.225+0000 7fa0e77fe640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0d00b6620 0x7fa0d00b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80057c0 tx=0x7fa0d80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:47.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.228+0000 7fa0e4ff9640 1 -- 172.21.15.81:0/740837225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0e0016030 con 0x7fa0e8108d20 2024-09-21T02:59:47.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.406+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa0e8102ef0 con 0x7fa0e8108d20 2024-09-21T02:59:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.406+0000 7fa0e4ff9640 1 -- 172.21.15.81:0/740837225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa0e8102ef0 con 0x7fa0e8108d20 2024-09-21T02:59:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:219043332143 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0d00b6620 msgr2=0x7fa0d00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0d00b6620 0x7fa0d00b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80057c0 tx=0x7fa0d80058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8108d20 msgr2=0x7fa0e819fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8108d20 0x7fa0e819fbb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000eaa0 tx=0x7fa0e000ef60 comp rx=0 tx=0).stop 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 shutdown_connections 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0d00b6620 0x7fa0d00b8b30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0e81083d0 0x7fa0e819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0e8108d20 0x7fa0e819fbb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 --2- 172.21.15.81:0/740837225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0e8102ae0 0x7fa0e819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 >> 172.21.15.81:0/740837225 conn(0x7fa0e8079760 msgr2=0x7fa0e81015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 shutdown_connections 2024-09-21T02:59:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:47.408+0000 7fa0ee018640 1 -- 172.21.15.81:0/740837225 wait complete. 2024-09-21T02:59:47.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:47 smithi164 ceph-mon[34236]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:47.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:47 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3827017231' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:59:47.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:47 smithi181 ceph-mon[34096]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:47.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:47 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3827017231' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:59:48.092 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332139 got 219043332143 for osd.8 2024-09-21T02:59:48.093 DEBUG:teuthology.parallel:result is None 2024-09-21T02:59:48.093 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:59:48.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:59:48.343 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:48.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:48 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/740837225' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:59:48.464 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:48 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/740837225' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:59:48.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:48 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/740837225' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 -- 172.21.15.81:0/2895818704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 msgr2=0x7fe030102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2895818704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe030102200 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe020009900 tx=0x7fe02002a480 comp rx=0 tx=0).stop 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 -- 172.21.15.81:0/2895818704 shutdown_connections 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2895818704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe030102940 0x7fe0301125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2895818704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe030102200 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2895818704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe030104710 0x7fe030104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 -- 172.21.15.81:0/2895818704 >> 172.21.15.81:0/2895818704 conn(0x7fe030079ec0 msgr2=0x7fe03007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 -- 172.21.15.81:0/2895818704 shutdown_connections 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 -- 172.21.15.81:0/2895818704 wait complete. 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 Processor -- start 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.902+0000 7fe037eb7640 1 -- start start 2024-09-21T02:59:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe037eb7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe03019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe037eb7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe030102940 0x7fe03019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe037eb7640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe030104710 0x7fe0301a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe037eb7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe030115be0 con 0x7fe030101df0 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe037eb7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe030115a60 con 0x7fe030102940 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe037eb7640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe030115d60 con 0x7fe030104710 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe03019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe03019c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40672/0 (socket says 172.21.15.81:40672) 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 -- 172.21.15.81:0/2739864962 learned_addr learned my addr 172.21.15.81:0/2739864962 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035452640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe030102940 0x7fe03019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe036454640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe030104710 0x7fe0301a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 -- 172.21.15.81:0/2739864962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe030104710 msgr2=0x7fe0301a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe030104710 0x7fe0301a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 -- 172.21.15.81:0/2739864962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe030102940 msgr2=0x7fe03019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe030102940 0x7fe03019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 -- 172.21.15.81:0/2739864962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0301a25a0 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe036454640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe030104710 0x7fe0301a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe035c53640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe03019c6f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c920 tx=0x7fe02c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe026ffd640 1 -- 172.21.15.81:0/2739864962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c007c70 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.903+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0301a2890 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.904+0000 7fe026ffd640 1 -- 172.21.15.81:0/2739864962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe02c007e10 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.904+0000 7fe026ffd640 1 -- 172.21.15.81:0/2739864962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0186f0 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.904+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0301a90b0 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.904+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe030102200 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.907+0000 7fe026ffd640 1 -- 172.21.15.81:0/2739864962 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe02c00f450 con 0x7fe030101df0 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.908+0000 7fe026ffd640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe01c0b65d0 0x7fe01c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.908+0000 7fe035452640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe01c0b65d0 0x7fe01c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.908+0000 7fe026ffd640 1 -- 172.21.15.81:0/2739864962 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe02c0e7b70 con 0x7fe030101df0 2024-09-21T02:59:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.908+0000 7fe035452640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe01c0b65d0 0x7fe01c0b8ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe020004770 tx=0x7fe0200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:48.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:48.911+0000 7fe026ffd640 1 -- 172.21.15.81:0/2739864962 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe02c014030 con 0x7fe030101df0 2024-09-21T02:59:49.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.087+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0301014f0 con 0x7fe01c0b65d0 2024-09-21T02:59:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.093+0000 7fe026ffd640 1 -- 172.21.15.81:0/2739864962 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340610 (secure 0 0 0) 0x7fe0301014f0 con 0x7fe01c0b65d0 2024-09-21T02:59:49.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:49.099 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe01c0b65d0 msgr2=0x7fe01c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe01c0b65d0 0x7fe01c0b8ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe020004770 tx=0x7fe0200058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 msgr2=0x7fe03019c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe03019c6f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c920 tx=0x7fe02c00cde0 comp rx=0 tx=0).stop 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 shutdown_connections 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe01c0b65d0 0x7fe01c0b8ae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe030104710 0x7fe0301a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe030102940 0x7fe03019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 --2- 172.21.15.81:0/2739864962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe030101df0 0x7fe03019c6f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 >> 172.21.15.81:0/2739864962 conn(0x7fe030079ec0 msgr2=0x7fe030100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 shutdown_connections 2024-09-21T02:59:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:49.096+0000 7fe037eb7640 1 -- 172.21.15.81:0/2739864962 wait complete. 2024-09-21T02:59:49.411 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:49 smithi081 ceph-mon[30991]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:49.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:49 smithi164 ceph-mon[34236]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:49.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:49 smithi181 ceph-mon[34096]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:49.983 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-21T02:59:47.724854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660815,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":428,"num_read_kb":313,"num_write":293,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376920,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564904,"statfs":{"total":1151940427776,"available":1151554461696,"internally_reserved":0,"allocated":11288576,"data_stored":7505855,"data_compressed":389853,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003598"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153188+0000","last_change":"2024-09-21T02:58:13.017321+0000","last_active":"2024-09-21T02:58:51.153188+0000","last_peered":"2024-09-21T02:58:51.153188+0000","last_clean":"2024-09-21T02:58:51.153188+0000","last_became_active":"2024-09-21T02:58:13.017017+0000","last_became_peered":"2024-09-21T02:58:13.017017+0000","last_unstale":"2024-09-21T02:58:51.153188+0000","last_undegraded":"2024-09-21T02:58:51.153188+0000","last_fullsized":"2024-09-21T02:58:51.153188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:11.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228749+0000","last_change":"2024-09-21T02:58:15.043883+0000","last_active":"2024-09-21T02:58:49.228749+0000","last_peered":"2024-09-21T02:58:49.228749+0000","last_clean":"2024-09-21T02:58:49.228749+0000","last_became_active":"2024-09-21T02:58:15.043551+0000","last_became_peered":"2024-09-21T02:58:15.043551+0000","last_unstale":"2024-09-21T02:58:49.228749+0000","last_undegraded":"2024-09-21T02:58:49.228749+0000","last_fullsized":"2024-09-21T02:58:49.228749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:40.867181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224252+0000","last_change":"2024-09-21T02:58:22.084562+0000","last_active":"2024-09-21T02:58:49.224252+0000","last_peered":"2024-09-21T02:58:49.224252+0000","last_clean":"2024-09-21T02:58:49.224252+0000","last_became_active":"2024-09-21T02:58:22.084145+0000","last_became_peered":"2024-09-21T02:58:22.084145+0000","last_unstale":"2024-09-21T02:58:49.224252+0000","last_undegraded":"2024-09-21T02:58:49.224252+0000","last_fullsized":"2024-09-21T02:58:49.224252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:56.402375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229202+0000","last_change":"2024-09-21T02:58:13.553479+0000","last_active":"2024-09-21T02:58:49.229202+0000","last_peered":"2024-09-21T02:58:49.229202+0000","last_clean":"2024-09-21T02:58:49.229202+0000","last_became_active":"2024-09-21T02:58:13.553117+0000","last_became_peered":"2024-09-21T02:58:13.553117+0000","last_unstale":"2024-09-21T02:58:49.229202+0000","last_undegraded":"2024-09-21T02:58:49.229202+0000","last_fullsized":"2024-09-21T02:58:49.229202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:34.301361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980234+0000","last_change":"2024-09-21T02:58:15.041724+0000","last_active":"2024-09-21T02:58:49.980234+0000","last_peered":"2024-09-21T02:58:49.980234+0000","last_clean":"2024-09-21T02:58:49.980234+0000","last_became_active":"2024-09-21T02:58:15.041355+0000","last_became_peered":"2024-09-21T02:58:15.041355+0000","last_unstale":"2024-09-21T02:58:49.980234+0000","last_undegraded":"2024-09-21T02:58:49.980234+0000","last_fullsized":"2024-09-21T02:58:49.980234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:19.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226270+0000","last_change":"2024-09-21T02:58:22.085004+0000","last_active":"2024-09-21T02:58:49.226270+0000","last_peered":"2024-09-21T02:58:49.226270+0000","last_clean":"2024-09-21T02:58:49.226270+0000","last_became_active":"2024-09-21T02:58:22.084622+0000","last_became_peered":"2024-09-21T02:58:22.084622+0000","last_unstale":"2024-09-21T02:58:49.226270+0000","last_undegraded":"2024-09-21T02:58:49.226270+0000","last_fullsized":"2024-09-21T02:58:49.226270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.303286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152223+0000","last_change":"2024-09-21T02:58:49.237002+0000","last_active":"2024-09-21T02:58:51.152223+0000","last_peered":"2024-09-21T02:58:51.152223+0000","last_clean":"2024-09-21T02:58:51.152223+0000","last_became_active":"2024-09-21T02:58:49.233219+0000","last_became_peered":"2024-09-21T02:58:49.233219+0000","last_unstale":"2024-09-21T02:58:51.152223+0000","last_undegraded":"2024-09-21T02:58:51.152223+0000","last_fullsized":"2024-09-21T02:58:51.152223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:38.409153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228358+0000","last_change":"2024-09-21T02:58:15.051658+0000","last_active":"2024-09-21T02:58:49.228358+0000","last_peered":"2024-09-21T02:58:49.228358+0000","last_clean":"2024-09-21T02:58:49.228358+0000","last_became_active":"2024-09-21T02:58:15.048345+0000","last_became_peered":"2024-09-21T02:58:15.048345+0000","last_unstale":"2024-09-21T02:58:49.228358+0000","last_undegraded":"2024-09-21T02:58:49.228358+0000","last_fullsized":"2024-09-21T02:58:49.228358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:36.069051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.750150+0000","last_change":"2024-09-21T02:58:49.750028+0000","last_active":"2024-09-21T02:58:49.750150+0000","last_peered":"2024-09-21T02:58:49.750150+0000","last_clean":"2024-09-21T02:58:49.750150+0000","last_became_active":"2024-09-21T02:58:49.749587+0000","last_became_peered":"2024-09-21T02:58:49.749587+0000","last_unstale":"2024-09-21T02:58:49.750150+0000","last_undegraded":"2024-09-21T02:58:49.750150+0000","last_fullsized":"2024-09-21T02:58:49.750150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:33.018490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230873+0000","last_change":"2024-09-21T02:58:13.020762+0000","last_active":"2024-09-21T02:58:49.230873+0000","last_peered":"2024-09-21T02:58:49.230873+0000","last_clean":"2024-09-21T02:58:49.230873+0000","last_became_active":"2024-09-21T02:58:13.020263+0000","last_became_peered":"2024-09-21T02:58:13.020263+0000","last_unstale":"2024-09-21T02:58:49.230873+0000","last_undegraded":"2024-09-21T02:58:49.230873+0000","last_fullsized":"2024-09-21T02:58:49.230873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:14.490179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748543+0000","last_change":"2024-09-21T02:58:15.048732+0000","last_active":"2024-09-21T02:58:49.748543+0000","last_peered":"2024-09-21T02:58:49.748543+0000","last_clean":"2024-09-21T02:58:49.748543+0000","last_became_active":"2024-09-21T02:58:15.048393+0000","last_became_peered":"2024-09-21T02:58:15.048393+0000","last_unstale":"2024-09-21T02:58:49.748543+0000","last_undegraded":"2024-09-21T02:58:49.748543+0000","last_fullsized":"2024-09-21T02:58:49.748543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:07.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225897+0000","last_change":"2024-09-21T02:58:22.087072+0000","last_active":"2024-09-21T02:58:49.225897+0000","last_peered":"2024-09-21T02:58:49.225897+0000","last_clean":"2024-09-21T02:58:49.225897+0000","last_became_active":"2024-09-21T02:58:22.086695+0000","last_became_peered":"2024-09-21T02:58:22.086695+0000","last_unstale":"2024-09-21T02:58:49.225897+0000","last_undegraded":"2024-09-21T02:58:49.225897+0000","last_fullsized":"2024-09-21T02:58:49.225897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:18.592656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230870+0000","last_change":"2024-09-21T02:58:15.043756+0000","last_active":"2024-09-21T02:58:49.230870+0000","last_peered":"2024-09-21T02:58:49.230870+0000","last_clean":"2024-09-21T02:58:49.230870+0000","last_became_active":"2024-09-21T02:58:15.043415+0000","last_became_peered":"2024-09-21T02:58:15.043415+0000","last_unstale":"2024-09-21T02:58:49.230870+0000","last_undegraded":"2024-09-21T02:58:49.230870+0000","last_fullsized":"2024-09-21T02:58:49.230870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:53.655906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147581+0000","last_change":"2024-09-21T02:58:13.017054+0000","last_active":"2024-09-21T02:58:50.147581+0000","last_peered":"2024-09-21T02:58:50.147581+0000","last_clean":"2024-09-21T02:58:50.147581+0000","last_became_active":"2024-09-21T02:58:13.016636+0000","last_became_peered":"2024-09-21T02:58:13.016636+0000","last_unstale":"2024-09-21T02:58:50.147581+0000","last_undegraded":"2024-09-21T02:58:50.147581+0000","last_fullsized":"2024-09-21T02:58:50.147581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:27.941501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226537+0000","last_change":"2024-09-21T02:58:22.229949+0000","last_active":"2024-09-21T02:58:49.226537+0000","last_peered":"2024-09-21T02:58:49.226537+0000","last_clean":"2024-09-21T02:58:49.226537+0000","last_became_active":"2024-09-21T02:58:22.229490+0000","last_became_peered":"2024-09-21T02:58:22.229490+0000","last_unstale":"2024-09-21T02:58:49.226537+0000","last_undegraded":"2024-09-21T02:58:49.226537+0000","last_fullsized":"2024-09-21T02:58:49.226537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:25.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228272+0000","last_change":"2024-09-21T02:58:15.040559+0000","last_active":"2024-09-21T02:58:49.228272+0000","last_peered":"2024-09-21T02:58:49.228272+0000","last_clean":"2024-09-21T02:58:49.228272+0000","last_became_active":"2024-09-21T02:58:15.040220+0000","last_became_peered":"2024-09-21T02:58:15.040220+0000","last_unstale":"2024-09-21T02:58:49.228272+0000","last_undegraded":"2024-09-21T02:58:49.228272+0000","last_fullsized":"2024-09-21T02:58:49.228272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:55.853966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224522+0000","last_change":"2024-09-21T02:58:13.017985+0000","last_active":"2024-09-21T02:58:49.224522+0000","last_peered":"2024-09-21T02:58:49.224522+0000","last_clean":"2024-09-21T02:58:49.224522+0000","last_became_active":"2024-09-21T02:58:13.017583+0000","last_became_peered":"2024-09-21T02:58:13.017583+0000","last_unstale":"2024-09-21T02:58:49.224522+0000","last_undegraded":"2024-09-21T02:58:49.224522+0000","last_fullsized":"2024-09-21T02:58:49.224522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.917960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226338+0000","last_change":"2024-09-21T02:58:22.077294+0000","last_active":"2024-09-21T02:58:49.226338+0000","last_peered":"2024-09-21T02:58:49.226338+0000","last_clean":"2024-09-21T02:58:49.226338+0000","last_became_active":"2024-09-21T02:58:22.076884+0000","last_became_peered":"2024-09-21T02:58:22.076884+0000","last_unstale":"2024-09-21T02:58:49.226338+0000","last_undegraded":"2024-09-21T02:58:49.226338+0000","last_fullsized":"2024-09-21T02:58:49.226338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:00.045383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226825+0000","last_change":"2024-09-21T02:58:15.045160+0000","last_active":"2024-09-21T02:58:49.226825+0000","last_peered":"2024-09-21T02:58:49.226825+0000","last_clean":"2024-09-21T02:58:49.226825+0000","last_became_active":"2024-09-21T02:58:15.044814+0000","last_became_peered":"2024-09-21T02:58:15.044814+0000","last_unstale":"2024-09-21T02:58:49.226825+0000","last_undegraded":"2024-09-21T02:58:49.226825+0000","last_fullsized":"2024-09-21T02:58:49.226825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:13.325320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146734+0000","last_change":"2024-09-21T02:58:13.011081+0000","last_active":"2024-09-21T02:58:50.146734+0000","last_peered":"2024-09-21T02:58:50.146734+0000","last_clean":"2024-09-21T02:58:50.146734+0000","last_became_active":"2024-09-21T02:58:13.010682+0000","last_became_peered":"2024-09-21T02:58:13.010682+0000","last_unstale":"2024-09-21T02:58:50.146734+0000","last_undegraded":"2024-09-21T02:58:50.146734+0000","last_fullsized":"2024-09-21T02:58:50.146734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224126+0000","last_change":"2024-09-21T02:58:22.083449+0000","last_active":"2024-09-21T02:58:49.224126+0000","last_peered":"2024-09-21T02:58:49.224126+0000","last_clean":"2024-09-21T02:58:49.224126+0000","last_became_active":"2024-09-21T02:58:22.082996+0000","last_became_peered":"2024-09-21T02:58:22.082996+0000","last_unstale":"2024-09-21T02:58:49.224126+0000","last_undegraded":"2024-09-21T02:58:49.224126+0000","last_fullsized":"2024-09-21T02:58:49.224126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:21.667824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230242+0000","last_change":"2024-09-21T02:58:15.039458+0000","last_active":"2024-09-21T02:58:49.230242+0000","last_peered":"2024-09-21T02:58:49.230242+0000","last_clean":"2024-09-21T02:58:49.230242+0000","last_became_active":"2024-09-21T02:58:15.039082+0000","last_became_peered":"2024-09-21T02:58:15.039082+0000","last_unstale":"2024-09-21T02:58:49.230242+0000","last_undegraded":"2024-09-21T02:58:49.230242+0000","last_fullsized":"2024-09-21T02:58:49.230242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:37.102212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147255+0000","last_change":"2024-09-21T02:58:49.982108+0000","last_active":"2024-09-21T02:58:50.147255+0000","last_peered":"2024-09-21T02:58:50.147255+0000","last_clean":"2024-09-21T02:58:50.147255+0000","last_became_active":"2024-09-21T02:58:49.981462+0000","last_became_peered":"2024-09-21T02:58:49.981462+0000","last_unstale":"2024-09-21T02:58:50.147255+0000","last_undegraded":"2024-09-21T02:58:50.147255+0000","last_fullsized":"2024-09-21T02:58:50.147255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:17.624627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226847+0000","last_change":"2024-09-21T02:58:22.231082+0000","last_active":"2024-09-21T02:58:49.226847+0000","last_peered":"2024-09-21T02:58:49.226847+0000","last_clean":"2024-09-21T02:58:49.226847+0000","last_became_active":"2024-09-21T02:58:22.229781+0000","last_became_peered":"2024-09-21T02:58:22.229781+0000","last_unstale":"2024-09-21T02:58:49.226847+0000","last_undegraded":"2024-09-21T02:58:49.226847+0000","last_fullsized":"2024-09-21T02:58:49.226847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:14.964809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980043+0000","last_change":"2024-09-21T02:58:15.033111+0000","last_active":"2024-09-21T02:58:49.980043+0000","last_peered":"2024-09-21T02:58:49.980043+0000","last_clean":"2024-09-21T02:58:49.980043+0000","last_became_active":"2024-09-21T02:58:15.032738+0000","last_became_peered":"2024-09-21T02:58:15.032738+0000","last_unstale":"2024-09-21T02:58:49.980043+0000","last_undegraded":"2024-09-21T02:58:49.980043+0000","last_fullsized":"2024-09-21T02:58:49.980043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:31.209451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147323+0000","last_change":"2024-09-21T02:58:13.229717+0000","last_active":"2024-09-21T02:58:50.147323+0000","last_peered":"2024-09-21T02:58:50.147323+0000","last_clean":"2024-09-21T02:58:50.147323+0000","last_became_active":"2024-09-21T02:58:13.229376+0000","last_became_peered":"2024-09-21T02:58:13.229376+0000","last_unstale":"2024-09-21T02:58:50.147323+0000","last_undegraded":"2024-09-21T02:58:50.147323+0000","last_fullsized":"2024-09-21T02:58:50.147323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:05.436044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224447+0000","last_change":"2024-09-21T02:58:22.081140+0000","last_active":"2024-09-21T02:58:49.224447+0000","last_peered":"2024-09-21T02:58:49.224447+0000","last_clean":"2024-09-21T02:58:49.224447+0000","last_became_active":"2024-09-21T02:58:22.080670+0000","last_became_peered":"2024-09-21T02:58:22.080670+0000","last_unstale":"2024-09-21T02:58:49.224447+0000","last_undegraded":"2024-09-21T02:58:49.224447+0000","last_fullsized":"2024-09-21T02:58:49.224447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:43.078241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228985+0000","last_change":"2024-09-21T02:58:15.035927+0000","last_active":"2024-09-21T02:58:49.228985+0000","last_peered":"2024-09-21T02:58:49.228985+0000","last_clean":"2024-09-21T02:58:49.228985+0000","last_became_active":"2024-09-21T02:58:15.035529+0000","last_became_peered":"2024-09-21T02:58:15.035529+0000","last_unstale":"2024-09-21T02:58:49.228985+0000","last_undegraded":"2024-09-21T02:58:49.228985+0000","last_fullsized":"2024-09-21T02:58:49.228985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:07.046836+0000","last_change":"2024-09-21T02:58:13.016489+0000","last_active":"2024-09-21T02:59:07.046836+0000","last_peered":"2024-09-21T02:59:07.046836+0000","last_clean":"2024-09-21T02:59:07.046836+0000","last_became_active":"2024-09-21T02:58:13.016176+0000","last_became_peered":"2024-09-21T02:58:13.016176+0000","last_unstale":"2024-09-21T02:59:07.046836+0000","last_undegraded":"2024-09-21T02:59:07.046836+0000","last_fullsized":"2024-09-21T02:59:07.046836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:54.908933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227852+0000","last_change":"2024-09-21T02:58:22.229868+0000","last_active":"2024-09-21T02:58:49.227852+0000","last_peered":"2024-09-21T02:58:49.227852+0000","last_clean":"2024-09-21T02:58:49.227852+0000","last_became_active":"2024-09-21T02:58:22.229318+0000","last_became_peered":"2024-09-21T02:58:22.229318+0000","last_unstale":"2024-09-21T02:58:49.227852+0000","last_undegraded":"2024-09-21T02:58:49.227852+0000","last_fullsized":"2024-09-21T02:58:49.227852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:06.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435282+0000","last_change":"2024-09-21T02:58:15.037953+0000","last_active":"2024-09-21T02:58:49.435282+0000","last_peered":"2024-09-21T02:58:49.435282+0000","last_clean":"2024-09-21T02:58:49.435282+0000","last_became_active":"2024-09-21T02:58:15.036934+0000","last_became_peered":"2024-09-21T02:58:15.036934+0000","last_unstale":"2024-09-21T02:58:49.435282+0000","last_undegraded":"2024-09-21T02:58:49.435282+0000","last_fullsized":"2024-09-21T02:58:49.435282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:35.118295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146197+0000","last_change":"2024-09-21T02:58:13.553861+0000","last_active":"2024-09-21T02:58:50.146197+0000","last_peered":"2024-09-21T02:58:50.146197+0000","last_clean":"2024-09-21T02:58:50.146197+0000","last_became_active":"2024-09-21T02:58:13.553016+0000","last_became_peered":"2024-09-21T02:58:13.553016+0000","last_unstale":"2024-09-21T02:58:50.146197+0000","last_undegraded":"2024-09-21T02:58:50.146197+0000","last_fullsized":"2024-09-21T02:58:50.146197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227008+0000","last_change":"2024-09-21T02:58:22.087306+0000","last_active":"2024-09-21T02:58:49.227008+0000","last_peered":"2024-09-21T02:58:49.227008+0000","last_clean":"2024-09-21T02:58:49.227008+0000","last_became_active":"2024-09-21T02:58:22.086800+0000","last_became_peered":"2024-09-21T02:58:22.086800+0000","last_unstale":"2024-09-21T02:58:49.227008+0000","last_undegraded":"2024-09-21T02:58:49.227008+0000","last_fullsized":"2024-09-21T02:58:49.227008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:28.652990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224469+0000","last_change":"2024-09-21T02:58:15.038383+0000","last_active":"2024-09-21T02:58:49.224469+0000","last_peered":"2024-09-21T02:58:49.224469+0000","last_clean":"2024-09-21T02:58:49.224469+0000","last_became_active":"2024-09-21T02:58:15.037878+0000","last_became_peered":"2024-09-21T02:58:15.037878+0000","last_unstale":"2024-09-21T02:58:49.224469+0000","last_undegraded":"2024-09-21T02:58:49.224469+0000","last_fullsized":"2024-09-21T02:58:49.224469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:14.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223874+0000","last_change":"2024-09-21T02:58:13.555218+0000","last_active":"2024-09-21T02:58:49.223874+0000","last_peered":"2024-09-21T02:58:49.223874+0000","last_clean":"2024-09-21T02:58:49.223874+0000","last_became_active":"2024-09-21T02:58:13.554831+0000","last_became_peered":"2024-09-21T02:58:13.554831+0000","last_unstale":"2024-09-21T02:58:49.223874+0000","last_undegraded":"2024-09-21T02:58:49.223874+0000","last_fullsized":"2024-09-21T02:58:49.223874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:32.659118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230124+0000","last_change":"2024-09-21T02:58:22.229673+0000","last_active":"2024-09-21T02:58:49.230124+0000","last_peered":"2024-09-21T02:58:49.230124+0000","last_clean":"2024-09-21T02:58:49.230124+0000","last_became_active":"2024-09-21T02:58:22.229034+0000","last_became_peered":"2024-09-21T02:58:22.229034+0000","last_unstale":"2024-09-21T02:58:49.230124+0000","last_undegraded":"2024-09-21T02:58:49.230124+0000","last_fullsized":"2024-09-21T02:58:49.230124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:26.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.981818+0000","last_change":"2024-09-21T02:58:49.981660+0000","last_active":"2024-09-21T02:58:49.981818+0000","last_peered":"2024-09-21T02:58:49.981818+0000","last_clean":"2024-09-21T02:58:49.981818+0000","last_became_active":"2024-09-21T02:58:49.980972+0000","last_became_peered":"2024-09-21T02:58:49.980972+0000","last_unstale":"2024-09-21T02:58:49.981818+0000","last_undegraded":"2024-09-21T02:58:49.981818+0000","last_fullsized":"2024-09-21T02:58:49.981818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:26.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231087+0000","last_change":"2024-09-21T02:58:13.012751+0000","last_active":"2024-09-21T02:58:49.231087+0000","last_peered":"2024-09-21T02:58:49.231087+0000","last_clean":"2024-09-21T02:58:49.231087+0000","last_became_active":"2024-09-21T02:58:13.012341+0000","last_became_peered":"2024-09-21T02:58:13.012341+0000","last_unstale":"2024-09-21T02:58:49.231087+0000","last_undegraded":"2024-09-21T02:58:49.231087+0000","last_fullsized":"2024-09-21T02:58:49.231087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435050+0000","last_change":"2024-09-21T02:58:22.084620+0000","last_active":"2024-09-21T02:58:49.435050+0000","last_peered":"2024-09-21T02:58:49.435050+0000","last_clean":"2024-09-21T02:58:49.435050+0000","last_became_active":"2024-09-21T02:58:22.083935+0000","last_became_peered":"2024-09-21T02:58:22.083935+0000","last_unstale":"2024-09-21T02:58:49.435050+0000","last_undegraded":"2024-09-21T02:58:49.435050+0000","last_fullsized":"2024-09-21T02:58:49.435050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:37.033928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748547+0000","last_change":"2024-09-21T02:58:15.046935+0000","last_active":"2024-09-21T02:58:49.748547+0000","last_peered":"2024-09-21T02:58:49.748547+0000","last_clean":"2024-09-21T02:58:49.748547+0000","last_became_active":"2024-09-21T02:58:15.046572+0000","last_became_peered":"2024-09-21T02:58:15.046572+0000","last_unstale":"2024-09-21T02:58:49.748547+0000","last_undegraded":"2024-09-21T02:58:49.748547+0000","last_fullsized":"2024-09-21T02:58:49.748547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.942643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:42.277725+0000","last_change":"2024-09-21T02:58:13.553337+0000","last_active":"2024-09-21T02:59:42.277725+0000","last_peered":"2024-09-21T02:59:42.277725+0000","last_clean":"2024-09-21T02:59:42.277725+0000","last_became_active":"2024-09-21T02:58:13.552873+0000","last_became_peered":"2024-09-21T02:58:13.552873+0000","last_unstale":"2024-09-21T02:59:42.277725+0000","last_undegraded":"2024-09-21T02:59:42.277725+0000","last_fullsized":"2024-09-21T02:59:42.277725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:42.800873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435228+0000","last_change":"2024-09-21T02:58:22.230102+0000","last_active":"2024-09-21T02:58:49.435228+0000","last_peered":"2024-09-21T02:58:49.435228+0000","last_clean":"2024-09-21T02:58:49.435228+0000","last_became_active":"2024-09-21T02:58:22.229643+0000","last_became_peered":"2024-09-21T02:58:22.229643+0000","last_unstale":"2024-09-21T02:58:49.435228+0000","last_undegraded":"2024-09-21T02:58:49.435228+0000","last_fullsized":"2024-09-21T02:58:49.435228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.396292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434776+0000","last_change":"2024-09-21T02:58:15.043484+0000","last_active":"2024-09-21T02:58:49.434776+0000","last_peered":"2024-09-21T02:58:49.434776+0000","last_clean":"2024-09-21T02:58:49.434776+0000","last_became_active":"2024-09-21T02:58:15.042663+0000","last_became_peered":"2024-09-21T02:58:15.042663+0000","last_unstale":"2024-09-21T02:58:49.434776+0000","last_undegraded":"2024-09-21T02:58:49.434776+0000","last_fullsized":"2024-09-21T02:58:49.434776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:42.937814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.151290+0000","last_change":"2024-09-21T02:58:13.018109+0000","last_active":"2024-09-21T02:58:51.151290+0000","last_peered":"2024-09-21T02:58:51.151290+0000","last_clean":"2024-09-21T02:58:51.151290+0000","last_became_active":"2024-09-21T02:58:13.017761+0000","last_became_peered":"2024-09-21T02:58:13.017761+0000","last_unstale":"2024-09-21T02:58:51.151290+0000","last_undegraded":"2024-09-21T02:58:51.151290+0000","last_fullsized":"2024-09-21T02:58:51.151290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:12.613051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748710+0000","last_change":"2024-09-21T02:58:22.230520+0000","last_active":"2024-09-21T02:58:49.748710+0000","last_peered":"2024-09-21T02:58:49.748710+0000","last_clean":"2024-09-21T02:58:49.748710+0000","last_became_active":"2024-09-21T02:58:22.229999+0000","last_became_peered":"2024-09-21T02:58:22.229999+0000","last_unstale":"2024-09-21T02:58:49.748710+0000","last_undegraded":"2024-09-21T02:58:49.748710+0000","last_fullsized":"2024-09-21T02:58:49.748710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:12.899892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228426+0000","last_change":"2024-09-21T02:58:15.040357+0000","last_active":"2024-09-21T02:58:49.228426+0000","last_peered":"2024-09-21T02:58:49.228426+0000","last_clean":"2024-09-21T02:58:49.228426+0000","last_became_active":"2024-09-21T02:58:15.040026+0000","last_became_peered":"2024-09-21T02:58:15.040026+0000","last_unstale":"2024-09-21T02:58:49.228426+0000","last_undegraded":"2024-09-21T02:58:49.228426+0000","last_fullsized":"2024-09-21T02:58:49.228426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.216541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.151538+0000","last_change":"2024-09-21T02:58:13.014816+0000","last_active":"2024-09-21T02:58:52.151538+0000","last_peered":"2024-09-21T02:58:52.151538+0000","last_clean":"2024-09-21T02:58:52.151538+0000","last_became_active":"2024-09-21T02:58:13.013918+0000","last_became_peered":"2024-09-21T02:58:13.013918+0000","last_unstale":"2024-09-21T02:58:52.151538+0000","last_undegraded":"2024-09-21T02:58:52.151538+0000","last_fullsized":"2024-09-21T02:58:52.151538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:20.892671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230715+0000","last_change":"2024-09-21T02:57:01.191389+0000","last_active":"2024-09-21T02:58:49.230715+0000","last_peered":"2024-09-21T02:58:49.230715+0000","last_clean":"2024-09-21T02:58:49.230715+0000","last_became_active":"2024-09-21T02:57:01.185686+0000","last_became_peered":"2024-09-21T02:57:01.185686+0000","last_unstale":"2024-09-21T02:58:49.230715+0000","last_undegraded":"2024-09-21T02:58:49.230715+0000","last_fullsized":"2024-09-21T02:58:49.230715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_clean_scrub_stamp":"2024-09-21T02:53:36.647024+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.275496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231134+0000","last_change":"2024-09-21T02:58:22.081891+0000","last_active":"2024-09-21T02:58:49.231134+0000","last_peered":"2024-09-21T02:58:49.231134+0000","last_clean":"2024-09-21T02:58:49.231134+0000","last_became_active":"2024-09-21T02:58:22.081435+0000","last_became_peered":"2024-09-21T02:58:22.081435+0000","last_unstale":"2024-09-21T02:58:49.231134+0000","last_undegraded":"2024-09-21T02:58:49.231134+0000","last_fullsized":"2024-09-21T02:58:49.231134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:51.161690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231223+0000","last_change":"2024-09-21T02:58:15.045013+0000","last_active":"2024-09-21T02:58:49.231223+0000","last_peered":"2024-09-21T02:58:49.231223+0000","last_clean":"2024-09-21T02:58:49.231223+0000","last_became_active":"2024-09-21T02:58:15.044650+0000","last_became_peered":"2024-09-21T02:58:15.044650+0000","last_unstale":"2024-09-21T02:58:49.231223+0000","last_undegraded":"2024-09-21T02:58:49.231223+0000","last_fullsized":"2024-09-21T02:58:49.231223+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:39.087982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153469+0000","last_change":"2024-09-21T02:58:13.553468+0000","last_active":"2024-09-21T02:58:51.153469+0000","last_peered":"2024-09-21T02:58:51.153469+0000","last_clean":"2024-09-21T02:58:51.153469+0000","last_became_active":"2024-09-21T02:58:13.552965+0000","last_became_peered":"2024-09-21T02:58:13.552965+0000","last_unstale":"2024-09-21T02:58:51.153469+0000","last_undegraded":"2024-09-21T02:58:51.153469+0000","last_fullsized":"2024-09-21T02:58:51.153469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:35.224581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227364+0000","last_change":"2024-09-21T02:58:22.086994+0000","last_active":"2024-09-21T02:58:49.227364+0000","last_peered":"2024-09-21T02:58:49.227364+0000","last_clean":"2024-09-21T02:58:49.227364+0000","last_became_active":"2024-09-21T02:58:22.086506+0000","last_became_peered":"2024-09-21T02:58:22.086506+0000","last_unstale":"2024-09-21T02:58:49.227364+0000","last_undegraded":"2024-09-21T02:58:49.227364+0000","last_fullsized":"2024-09-21T02:58:49.227364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:09.102495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230976+0000","last_change":"2024-09-21T02:58:15.040224+0000","last_active":"2024-09-21T02:58:49.230976+0000","last_peered":"2024-09-21T02:58:49.230976+0000","last_clean":"2024-09-21T02:58:49.230976+0000","last_became_active":"2024-09-21T02:58:15.039115+0000","last_became_peered":"2024-09-21T02:58:15.039115+0000","last_unstale":"2024-09-21T02:58:49.230976+0000","last_undegraded":"2024-09-21T02:58:49.230976+0000","last_fullsized":"2024-09-21T02:58:49.230976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:35.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748956+0000","last_change":"2024-09-21T02:58:13.021526+0000","last_active":"2024-09-21T02:58:49.748956+0000","last_peered":"2024-09-21T02:58:49.748956+0000","last_clean":"2024-09-21T02:58:49.748956+0000","last_became_active":"2024-09-21T02:58:13.020521+0000","last_became_peered":"2024-09-21T02:58:13.020521+0000","last_unstale":"2024-09-21T02:58:49.748956+0000","last_undegraded":"2024-09-21T02:58:49.748956+0000","last_fullsized":"2024-09-21T02:58:49.748956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:08.645141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980132+0000","last_change":"2024-09-21T02:58:22.077862+0000","last_active":"2024-09-21T02:58:49.980132+0000","last_peered":"2024-09-21T02:58:49.980132+0000","last_clean":"2024-09-21T02:58:49.980132+0000","last_became_active":"2024-09-21T02:58:22.077410+0000","last_became_peered":"2024-09-21T02:58:22.077410+0000","last_unstale":"2024-09-21T02:58:49.980132+0000","last_undegraded":"2024-09-21T02:58:49.980132+0000","last_fullsized":"2024-09-21T02:58:49.980132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:06.549842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231212+0000","last_change":"2024-09-21T02:58:15.037775+0000","last_active":"2024-09-21T02:58:49.231212+0000","last_peered":"2024-09-21T02:58:49.231212+0000","last_clean":"2024-09-21T02:58:49.231212+0000","last_became_active":"2024-09-21T02:58:15.037036+0000","last_became_peered":"2024-09-21T02:58:15.037036+0000","last_unstale":"2024-09-21T02:58:49.231212+0000","last_undegraded":"2024-09-21T02:58:49.231212+0000","last_fullsized":"2024-09-21T02:58:49.231212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:58.289785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435249+0000","last_change":"2024-09-21T02:58:13.015046+0000","last_active":"2024-09-21T02:58:49.435249+0000","last_peered":"2024-09-21T02:58:49.435249+0000","last_clean":"2024-09-21T02:58:49.435249+0000","last_became_active":"2024-09-21T02:58:13.014643+0000","last_became_peered":"2024-09-21T02:58:13.014643+0000","last_unstale":"2024-09-21T02:58:49.435249+0000","last_undegraded":"2024-09-21T02:58:49.435249+0000","last_fullsized":"2024-09-21T02:58:49.435249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:54.913187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.747869+0000","last_change":"2024-09-21T02:58:22.085805+0000","last_active":"2024-09-21T02:58:49.747869+0000","last_peered":"2024-09-21T02:58:49.747869+0000","last_clean":"2024-09-21T02:58:49.747869+0000","last_became_active":"2024-09-21T02:58:22.084752+0000","last_became_peered":"2024-09-21T02:58:22.084752+0000","last_unstale":"2024-09-21T02:58:49.747869+0000","last_undegraded":"2024-09-21T02:58:49.747869+0000","last_fullsized":"2024-09-21T02:58:49.747869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:39.357089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227424+0000","last_change":"2024-09-21T02:58:15.046643+0000","last_active":"2024-09-21T02:58:49.227424+0000","last_peered":"2024-09-21T02:58:49.227424+0000","last_clean":"2024-09-21T02:58:49.227424+0000","last_became_active":"2024-09-21T02:58:15.046278+0000","last_became_peered":"2024-09-21T02:58:15.046278+0000","last_unstale":"2024-09-21T02:58:49.227424+0000","last_undegraded":"2024-09-21T02:58:49.227424+0000","last_fullsized":"2024-09-21T02:58:49.227424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.648084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.147510+0000","last_change":"2024-09-21T02:58:13.022176+0000","last_active":"2024-09-21T02:58:52.147510+0000","last_peered":"2024-09-21T02:58:52.147510+0000","last_clean":"2024-09-21T02:58:52.147510+0000","last_became_active":"2024-09-21T02:58:13.020122+0000","last_became_peered":"2024-09-21T02:58:13.020122+0000","last_unstale":"2024-09-21T02:58:52.147510+0000","last_undegraded":"2024-09-21T02:58:52.147510+0000","last_fullsized":"2024-09-21T02:58:52.147510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:12.346056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748354+0000","last_change":"2024-09-21T02:58:22.084221+0000","last_active":"2024-09-21T02:58:49.748354+0000","last_peered":"2024-09-21T02:58:49.748354+0000","last_clean":"2024-09-21T02:58:49.748354+0000","last_became_active":"2024-09-21T02:58:22.083793+0000","last_became_peered":"2024-09-21T02:58:22.083793+0000","last_unstale":"2024-09-21T02:58:49.748354+0000","last_undegraded":"2024-09-21T02:58:49.748354+0000","last_fullsized":"2024-09-21T02:58:49.748354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:13.043641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233959+0000","last_change":"2024-09-21T02:58:49.233440+0000","last_active":"2024-09-21T02:58:49.233959+0000","last_peered":"2024-09-21T02:58:49.233959+0000","last_clean":"2024-09-21T02:58:49.233959+0000","last_became_active":"2024-09-21T02:58:49.232996+0000","last_became_peered":"2024-09-21T02:58:49.232996+0000","last_unstale":"2024-09-21T02:58:49.233959+0000","last_undegraded":"2024-09-21T02:58:49.233959+0000","last_fullsized":"2024-09-21T02:58:49.233959+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:13.181861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.154616+0000","last_change":"2024-09-21T02:58:13.553866+0000","last_active":"2024-09-21T02:58:51.154616+0000","last_peered":"2024-09-21T02:58:51.154616+0000","last_clean":"2024-09-21T02:58:51.154616+0000","last_became_active":"2024-09-21T02:58:13.553001+0000","last_became_peered":"2024-09-21T02:58:13.553001+0000","last_unstale":"2024-09-21T02:58:51.154616+0000","last_undegraded":"2024-09-21T02:58:51.154616+0000","last_fullsized":"2024-09-21T02:58:51.154616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:43.995773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435231+0000","last_change":"2024-09-21T02:58:22.090253+0000","last_active":"2024-09-21T02:58:49.435231+0000","last_peered":"2024-09-21T02:58:49.435231+0000","last_clean":"2024-09-21T02:58:49.435231+0000","last_became_active":"2024-09-21T02:58:22.089818+0000","last_became_peered":"2024-09-21T02:58:22.089818+0000","last_unstale":"2024-09-21T02:58:49.435231+0000","last_undegraded":"2024-09-21T02:58:49.435231+0000","last_fullsized":"2024-09-21T02:58:49.435231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:09.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230280+0000","last_change":"2024-09-21T02:58:15.042479+0000","last_active":"2024-09-21T02:58:49.230280+0000","last_peered":"2024-09-21T02:58:49.230280+0000","last_clean":"2024-09-21T02:58:49.230280+0000","last_became_active":"2024-09-21T02:58:15.042087+0000","last_became_peered":"2024-09-21T02:58:15.042087+0000","last_unstale":"2024-09-21T02:58:49.230280+0000","last_undegraded":"2024-09-21T02:58:49.230280+0000","last_fullsized":"2024-09-21T02:58:49.230280+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.427736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:45.284796+0000","last_change":"2024-09-21T02:58:13.012559+0000","last_active":"2024-09-21T02:59:45.284796+0000","last_peered":"2024-09-21T02:59:45.284796+0000","last_clean":"2024-09-21T02:59:45.284796+0000","last_became_active":"2024-09-21T02:58:13.011062+0000","last_became_peered":"2024-09-21T02:58:13.011062+0000","last_unstale":"2024-09-21T02:59:45.284796+0000","last_undegraded":"2024-09-21T02:59:45.284796+0000","last_fullsized":"2024-09-21T02:59:45.284796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:17.839898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224241+0000","last_change":"2024-09-21T02:58:22.081196+0000","last_active":"2024-09-21T02:58:49.224241+0000","last_peered":"2024-09-21T02:58:49.224241+0000","last_clean":"2024-09-21T02:58:49.224241+0000","last_became_active":"2024-09-21T02:58:22.080787+0000","last_became_peered":"2024-09-21T02:58:22.080787+0000","last_unstale":"2024-09-21T02:58:49.224241+0000","last_undegraded":"2024-09-21T02:58:49.224241+0000","last_fullsized":"2024-09-21T02:58:49.224241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.283112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230702+0000","last_change":"2024-09-21T02:58:15.046322+0000","last_active":"2024-09-21T02:58:49.230702+0000","last_peered":"2024-09-21T02:58:49.230702+0000","last_clean":"2024-09-21T02:58:49.230702+0000","last_became_active":"2024-09-21T02:58:15.045936+0000","last_became_peered":"2024-09-21T02:58:15.045936+0000","last_unstale":"2024-09-21T02:58:49.230702+0000","last_undegraded":"2024-09-21T02:58:49.230702+0000","last_fullsized":"2024-09-21T02:58:49.230702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:08.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145891+0000","last_change":"2024-09-21T02:58:13.022277+0000","last_active":"2024-09-21T02:58:50.145891+0000","last_peered":"2024-09-21T02:58:50.145891+0000","last_clean":"2024-09-21T02:58:50.145891+0000","last_became_active":"2024-09-21T02:58:13.021901+0000","last_became_peered":"2024-09-21T02:58:13.021901+0000","last_unstale":"2024-09-21T02:58:50.145891+0000","last_undegraded":"2024-09-21T02:58:50.145891+0000","last_fullsized":"2024-09-21T02:58:50.145891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:01.029435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226991+0000","last_change":"2024-09-21T02:58:22.088951+0000","last_active":"2024-09-21T02:58:49.226991+0000","last_peered":"2024-09-21T02:58:49.226991+0000","last_clean":"2024-09-21T02:58:49.226991+0000","last_became_active":"2024-09-21T02:58:22.088427+0000","last_became_peered":"2024-09-21T02:58:22.088427+0000","last_unstale":"2024-09-21T02:58:49.226991+0000","last_undegraded":"2024-09-21T02:58:49.226991+0000","last_fullsized":"2024-09-21T02:58:49.226991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:52.700517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434868+0000","last_change":"2024-09-21T02:58:15.038390+0000","last_active":"2024-09-21T02:58:49.434868+0000","last_peered":"2024-09-21T02:58:49.434868+0000","last_clean":"2024-09-21T02:58:49.434868+0000","last_became_active":"2024-09-21T02:58:15.037368+0000","last_became_peered":"2024-09-21T02:58:15.037368+0000","last_unstale":"2024-09-21T02:58:49.434868+0000","last_undegraded":"2024-09-21T02:58:49.434868+0000","last_fullsized":"2024-09-21T02:58:49.434868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:54.736444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152969+0000","last_change":"2024-09-21T02:58:13.013246+0000","last_active":"2024-09-21T02:58:51.152969+0000","last_peered":"2024-09-21T02:58:51.152969+0000","last_clean":"2024-09-21T02:58:51.152969+0000","last_became_active":"2024-09-21T02:58:13.012830+0000","last_became_peered":"2024-09-21T02:58:13.012830+0000","last_unstale":"2024-09-21T02:58:51.152969+0000","last_undegraded":"2024-09-21T02:58:51.152969+0000","last_fullsized":"2024-09-21T02:58:51.152969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:31.406565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748517+0000","last_change":"2024-09-21T02:58:22.086799+0000","last_active":"2024-09-21T02:58:49.748517+0000","last_peered":"2024-09-21T02:58:49.748517+0000","last_clean":"2024-09-21T02:58:49.748517+0000","last_became_active":"2024-09-21T02:58:22.086395+0000","last_became_peered":"2024-09-21T02:58:22.086395+0000","last_unstale":"2024-09-21T02:58:49.748517+0000","last_undegraded":"2024-09-21T02:58:49.748517+0000","last_fullsized":"2024-09-21T02:58:49.748517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:38.985072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230971+0000","last_change":"2024-09-21T02:58:15.037346+0000","last_active":"2024-09-21T02:58:49.230971+0000","last_peered":"2024-09-21T02:58:49.230971+0000","last_clean":"2024-09-21T02:58:49.230971+0000","last_became_active":"2024-09-21T02:58:15.036984+0000","last_became_peered":"2024-09-21T02:58:15.036984+0000","last_unstale":"2024-09-21T02:58:49.230971+0000","last_undegraded":"2024-09-21T02:58:49.230971+0000","last_fullsized":"2024-09-21T02:58:49.230971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:43.856844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":184,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:45.251331+0000","last_change":"2024-09-21T02:58:13.018287+0000","last_active":"2024-09-21T02:59:45.251331+0000","last_peered":"2024-09-21T02:59:45.251331+0000","last_clean":"2024-09-21T02:59:45.251331+0000","last_became_active":"2024-09-21T02:58:13.017908+0000","last_became_peered":"2024-09-21T02:58:13.017908+0000","last_unstale":"2024-09-21T02:59:45.251331+0000","last_undegraded":"2024-09-21T02:59:45.251331+0000","last_fullsized":"2024-09-21T02:59:45.251331+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:30.422946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":124,"num_write":33,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223420+0000","last_change":"2024-09-21T02:58:22.078106+0000","last_active":"2024-09-21T02:58:49.223420+0000","last_peered":"2024-09-21T02:58:49.223420+0000","last_clean":"2024-09-21T02:58:49.223420+0000","last_became_active":"2024-09-21T02:58:22.077675+0000","last_became_peered":"2024-09-21T02:58:22.077675+0000","last_unstale":"2024-09-21T02:58:49.223420+0000","last_undegraded":"2024-09-21T02:58:49.223420+0000","last_fullsized":"2024-09-21T02:58:49.223420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:08.965865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228496+0000","last_change":"2024-09-21T02:58:15.045911+0000","last_active":"2024-09-21T02:58:49.228496+0000","last_peered":"2024-09-21T02:58:49.228496+0000","last_clean":"2024-09-21T02:58:49.228496+0000","last_became_active":"2024-09-21T02:58:15.045506+0000","last_became_peered":"2024-09-21T02:58:15.045506+0000","last_unstale":"2024-09-21T02:58:49.228496+0000","last_undegraded":"2024-09-21T02:58:49.228496+0000","last_fullsized":"2024-09-21T02:58:49.228496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.982730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.144087+0000","last_change":"2024-09-21T02:58:13.555132+0000","last_active":"2024-09-21T02:58:50.144087+0000","last_peered":"2024-09-21T02:58:50.144087+0000","last_clean":"2024-09-21T02:58:50.144087+0000","last_became_active":"2024-09-21T02:58:13.554582+0000","last_became_peered":"2024-09-21T02:58:13.554582+0000","last_unstale":"2024-09-21T02:58:50.144087+0000","last_undegraded":"2024-09-21T02:58:50.144087+0000","last_fullsized":"2024-09-21T02:58:50.144087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:56.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.234599+0000","last_change":"2024-09-21T02:58:49.234443+0000","last_active":"2024-09-21T02:58:49.234599+0000","last_peered":"2024-09-21T02:58:49.234599+0000","last_clean":"2024-09-21T02:58:49.234599+0000","last_became_active":"2024-09-21T02:58:49.233758+0000","last_became_peered":"2024-09-21T02:58:49.233758+0000","last_unstale":"2024-09-21T02:58:49.234599+0000","last_undegraded":"2024-09-21T02:58:49.234599+0000","last_fullsized":"2024-09-21T02:58:49.234599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:06.821726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980321+0000","last_change":"2024-09-21T02:58:15.033598+0000","last_active":"2024-09-21T02:58:49.980321+0000","last_peered":"2024-09-21T02:58:49.980321+0000","last_clean":"2024-09-21T02:58:49.980321+0000","last_became_active":"2024-09-21T02:58:15.033268+0000","last_became_peered":"2024-09-21T02:58:15.033268+0000","last_unstale":"2024-09-21T02:58:49.980321+0000","last_undegraded":"2024-09-21T02:58:49.980321+0000","last_fullsized":"2024-09-21T02:58:49.980321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:25.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145942+0000","last_change":"2024-09-21T02:58:13.018159+0000","last_active":"2024-09-21T02:58:50.145942+0000","last_peered":"2024-09-21T02:58:50.145942+0000","last_clean":"2024-09-21T02:58:50.145942+0000","last_became_active":"2024-09-21T02:58:13.017263+0000","last_became_peered":"2024-09-21T02:58:13.017263+0000","last_unstale":"2024-09-21T02:58:50.145942+0000","last_undegraded":"2024-09-21T02:58:50.145942+0000","last_fullsized":"2024-09-21T02:58:50.145942+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:47.981435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.982319+0000","last_change":"2024-09-21T02:58:49.981593+0000","last_active":"2024-09-21T02:58:49.982319+0000","last_peered":"2024-09-21T02:58:49.982319+0000","last_clean":"2024-09-21T02:58:49.982319+0000","last_became_active":"2024-09-21T02:58:49.980890+0000","last_became_peered":"2024-09-21T02:58:49.980890+0000","last_unstale":"2024-09-21T02:58:49.982319+0000","last_undegraded":"2024-09-21T02:58:49.982319+0000","last_fullsized":"2024-09-21T02:58:49.982319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:59.251327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229390+0000","last_change":"2024-09-21T02:58:15.049561+0000","last_active":"2024-09-21T02:58:49.229390+0000","last_peered":"2024-09-21T02:58:49.229390+0000","last_clean":"2024-09-21T02:58:49.229390+0000","last_became_active":"2024-09-21T02:58:15.049205+0000","last_became_peered":"2024-09-21T02:58:15.049205+0000","last_unstale":"2024-09-21T02:58:49.229390+0000","last_undegraded":"2024-09-21T02:58:49.229390+0000","last_fullsized":"2024-09-21T02:58:49.229390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:56.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:44.238615+0000","last_change":"2024-09-21T02:58:13.018964+0000","last_active":"2024-09-21T02:59:44.238615+0000","last_peered":"2024-09-21T02:59:44.238615+0000","last_clean":"2024-09-21T02:59:44.238615+0000","last_became_active":"2024-09-21T02:58:13.017420+0000","last_became_peered":"2024-09-21T02:58:13.017420+0000","last_unstale":"2024-09-21T02:59:44.238615+0000","last_undegraded":"2024-09-21T02:59:44.238615+0000","last_fullsized":"2024-09-21T02:59:44.238615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233600+0000","last_change":"2024-09-21T02:58:49.233486+0000","last_active":"2024-09-21T02:58:49.233600+0000","last_peered":"2024-09-21T02:58:49.233600+0000","last_clean":"2024-09-21T02:58:49.233600+0000","last_became_active":"2024-09-21T02:58:49.232940+0000","last_became_peered":"2024-09-21T02:58:49.232940+0000","last_unstale":"2024-09-21T02:58:49.233600+0000","last_undegraded":"2024-09-21T02:58:49.233600+0000","last_fullsized":"2024-09-21T02:58:49.233600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:19.283141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979738+0000","last_change":"2024-09-21T02:58:22.085163+0000","last_active":"2024-09-21T02:58:49.979738+0000","last_peered":"2024-09-21T02:58:49.979738+0000","last_clean":"2024-09-21T02:58:49.979738+0000","last_became_active":"2024-09-21T02:58:22.084768+0000","last_became_peered":"2024-09-21T02:58:22.084768+0000","last_unstale":"2024-09-21T02:58:49.979738+0000","last_undegraded":"2024-09-21T02:58:49.979738+0000","last_fullsized":"2024-09-21T02:58:49.979738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:46.892421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223405+0000","last_change":"2024-09-21T02:58:15.035051+0000","last_active":"2024-09-21T02:58:49.223405+0000","last_peered":"2024-09-21T02:58:49.223405+0000","last_clean":"2024-09-21T02:58:49.223405+0000","last_became_active":"2024-09-21T02:58:15.034692+0000","last_became_peered":"2024-09-21T02:58:15.034692+0000","last_unstale":"2024-09-21T02:58:49.223405+0000","last_undegraded":"2024-09-21T02:58:49.223405+0000","last_fullsized":"2024-09-21T02:58:49.223405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:14.605154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748786+0000","last_change":"2024-09-21T02:58:13.018102+0000","last_active":"2024-09-21T02:58:49.748786+0000","last_peered":"2024-09-21T02:58:49.748786+0000","last_clean":"2024-09-21T02:58:49.748786+0000","last_became_active":"2024-09-21T02:58:13.017537+0000","last_became_peered":"2024-09-21T02:58:13.017537+0000","last_unstale":"2024-09-21T02:58:49.748786+0000","last_undegraded":"2024-09-21T02:58:49.748786+0000","last_fullsized":"2024-09-21T02:58:49.748786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:40.096326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227422+0000","last_change":"2024-09-21T02:58:22.084362+0000","last_active":"2024-09-21T02:58:49.227422+0000","last_peered":"2024-09-21T02:58:49.227422+0000","last_clean":"2024-09-21T02:58:49.227422+0000","last_became_active":"2024-09-21T02:58:22.083895+0000","last_became_peered":"2024-09-21T02:58:22.083895+0000","last_unstale":"2024-09-21T02:58:49.227422+0000","last_undegraded":"2024-09-21T02:58:49.227422+0000","last_fullsized":"2024-09-21T02:58:49.227422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:54.101588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227989+0000","last_change":"2024-09-21T02:58:15.034768+0000","last_active":"2024-09-21T02:58:49.227989+0000","last_peered":"2024-09-21T02:58:49.227989+0000","last_clean":"2024-09-21T02:58:49.227989+0000","last_became_active":"2024-09-21T02:58:15.034420+0000","last_became_peered":"2024-09-21T02:58:15.034420+0000","last_unstale":"2024-09-21T02:58:49.227989+0000","last_undegraded":"2024-09-21T02:58:49.227989+0000","last_fullsized":"2024-09-21T02:58:49.227989+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:25.750158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152269+0000","last_change":"2024-09-21T02:58:13.015026+0000","last_active":"2024-09-21T02:58:51.152269+0000","last_peered":"2024-09-21T02:58:51.152269+0000","last_clean":"2024-09-21T02:58:51.152269+0000","last_became_active":"2024-09-21T02:58:13.014668+0000","last_became_peered":"2024-09-21T02:58:13.014668+0000","last_unstale":"2024-09-21T02:58:51.152269+0000","last_undegraded":"2024-09-21T02:58:51.152269+0000","last_fullsized":"2024-09-21T02:58:51.152269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:20.117518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153234+0000","last_change":"2024-09-21T02:58:13.018044+0000","last_active":"2024-09-21T02:58:51.153234+0000","last_peered":"2024-09-21T02:58:51.153234+0000","last_clean":"2024-09-21T02:58:51.153234+0000","last_became_active":"2024-09-21T02:58:13.017628+0000","last_became_peered":"2024-09-21T02:58:13.017628+0000","last_unstale":"2024-09-21T02:58:51.153234+0000","last_undegraded":"2024-09-21T02:58:51.153234+0000","last_fullsized":"2024-09-21T02:58:51.153234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:38.749379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748507+0000","last_change":"2024-09-21T02:58:15.048160+0000","last_active":"2024-09-21T02:58:49.748507+0000","last_peered":"2024-09-21T02:58:49.748507+0000","last_clean":"2024-09-21T02:58:49.748507+0000","last_became_active":"2024-09-21T02:58:15.046371+0000","last_became_peered":"2024-09-21T02:58:15.046371+0000","last_unstale":"2024-09-21T02:58:49.748507+0000","last_undegraded":"2024-09-21T02:58:49.748507+0000","last_fullsized":"2024-09-21T02:58:49.748507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:49.386799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224497+0000","last_change":"2024-09-21T02:58:22.089918+0000","last_active":"2024-09-21T02:58:49.224497+0000","last_peered":"2024-09-21T02:58:49.224497+0000","last_clean":"2024-09-21T02:58:49.224497+0000","last_became_active":"2024-09-21T02:58:22.089457+0000","last_became_peered":"2024-09-21T02:58:22.089457+0000","last_unstale":"2024-09-21T02:58:49.224497+0000","last_undegraded":"2024-09-21T02:58:49.224497+0000","last_fullsized":"2024-09-21T02:58:49.224497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:28.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:45.240912+0000","last_change":"2024-09-21T02:58:13.021192+0000","last_active":"2024-09-21T02:59:45.240912+0000","last_peered":"2024-09-21T02:59:45.240912+0000","last_clean":"2024-09-21T02:59:45.240912+0000","last_became_active":"2024-09-21T02:58:13.020746+0000","last_became_peered":"2024-09-21T02:58:13.020746+0000","last_unstale":"2024-09-21T02:59:45.240912+0000","last_undegraded":"2024-09-21T02:59:45.240912+0000","last_fullsized":"2024-09-21T02:59:45.240912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:13.260225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230350+0000","last_change":"2024-09-21T02:58:15.038375+0000","last_active":"2024-09-21T02:58:49.230350+0000","last_peered":"2024-09-21T02:58:49.230350+0000","last_clean":"2024-09-21T02:58:49.230350+0000","last_became_active":"2024-09-21T02:58:15.038011+0000","last_became_peered":"2024-09-21T02:58:15.038011+0000","last_unstale":"2024-09-21T02:58:49.230350+0000","last_undegraded":"2024-09-21T02:58:49.230350+0000","last_fullsized":"2024-09-21T02:58:49.230350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:50.820554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224842+0000","last_change":"2024-09-21T02:58:22.088436+0000","last_active":"2024-09-21T02:58:49.224842+0000","last_peered":"2024-09-21T02:58:49.224842+0000","last_clean":"2024-09-21T02:58:49.224842+0000","last_became_active":"2024-09-21T02:58:22.087857+0000","last_became_peered":"2024-09-21T02:58:22.087857+0000","last_unstale":"2024-09-21T02:58:49.224842+0000","last_undegraded":"2024-09-21T02:58:49.224842+0000","last_fullsized":"2024-09-21T02:58:49.224842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:40.314833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226720+0000","last_change":"2024-09-21T02:58:15.041490+0000","last_active":"2024-09-21T02:58:49.226720+0000","last_peered":"2024-09-21T02:58:49.226720+0000","last_clean":"2024-09-21T02:58:49.226720+0000","last_became_active":"2024-09-21T02:58:15.041106+0000","last_became_peered":"2024-09-21T02:58:15.041106+0000","last_unstale":"2024-09-21T02:58:49.226720+0000","last_undegraded":"2024-09-21T02:58:49.226720+0000","last_fullsized":"2024-09-21T02:58:49.226720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:57.228254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224682+0000","last_change":"2024-09-21T02:58:15.041375+0000","last_active":"2024-09-21T02:58:49.224682+0000","last_peered":"2024-09-21T02:58:49.224682+0000","last_clean":"2024-09-21T02:58:49.224682+0000","last_became_active":"2024-09-21T02:58:15.041041+0000","last_became_peered":"2024-09-21T02:58:15.041041+0000","last_unstale":"2024-09-21T02:58:49.224682+0000","last_undegraded":"2024-09-21T02:58:49.224682+0000","last_fullsized":"2024-09-21T02:58:49.224682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:49.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224406+0000","last_change":"2024-09-21T02:58:15.036772+0000","last_active":"2024-09-21T02:58:49.224406+0000","last_peered":"2024-09-21T02:58:49.224406+0000","last_clean":"2024-09-21T02:58:49.224406+0000","last_became_active":"2024-09-21T02:58:15.036390+0000","last_became_peered":"2024-09-21T02:58:15.036390+0000","last_unstale":"2024-09-21T02:58:49.224406+0000","last_undegraded":"2024-09-21T02:58:49.224406+0000","last_fullsized":"2024-09-21T02:58:49.224406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:49.169184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980239+0000","last_change":"2024-09-21T02:58:15.035375+0000","last_active":"2024-09-21T02:58:49.980239+0000","last_peered":"2024-09-21T02:58:49.980239+0000","last_clean":"2024-09-21T02:58:49.980239+0000","last_became_active":"2024-09-21T02:58:15.035015+0000","last_became_peered":"2024-09-21T02:58:15.035015+0000","last_unstale":"2024-09-21T02:58:49.980239+0000","last_undegraded":"2024-09-21T02:58:49.980239+0000","last_fullsized":"2024-09-21T02:58:49.980239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:32.980690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435193+0000","last_change":"2024-09-21T02:58:15.046431+0000","last_active":"2024-09-21T02:58:49.435193+0000","last_peered":"2024-09-21T02:58:49.435193+0000","last_clean":"2024-09-21T02:58:49.435193+0000","last_became_active":"2024-09-21T02:58:15.046048+0000","last_became_peered":"2024-09-21T02:58:15.046048+0000","last_unstale":"2024-09-21T02:58:49.435193+0000","last_undegraded":"2024-09-21T02:58:49.435193+0000","last_fullsized":"2024-09-21T02:58:49.435193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:42.079020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227633+0000","last_change":"2024-09-21T02:58:15.043192+0000","last_active":"2024-09-21T02:58:49.227633+0000","last_peered":"2024-09-21T02:58:49.227633+0000","last_clean":"2024-09-21T02:58:49.227633+0000","last_became_active":"2024-09-21T02:58:15.042413+0000","last_became_peered":"2024-09-21T02:58:15.042413+0000","last_unstale":"2024-09-21T02:58:49.227633+0000","last_undegraded":"2024-09-21T02:58:49.227633+0000","last_fullsized":"2024-09-21T02:58:49.227633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:31.491311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225245+0000","last_change":"2024-09-21T02:58:15.040194+0000","last_active":"2024-09-21T02:58:49.225245+0000","last_peered":"2024-09-21T02:58:49.225245+0000","last_clean":"2024-09-21T02:58:49.225245+0000","last_became_active":"2024-09-21T02:58:15.039803+0000","last_became_peered":"2024-09-21T02:58:15.039803+0000","last_unstale":"2024-09-21T02:58:49.225245+0000","last_undegraded":"2024-09-21T02:58:49.225245+0000","last_fullsized":"2024-09-21T02:58:49.225245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:21.357004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228974+0000","last_change":"2024-09-21T02:58:15.043038+0000","last_active":"2024-09-21T02:58:49.228974+0000","last_peered":"2024-09-21T02:58:49.228974+0000","last_clean":"2024-09-21T02:58:49.228974+0000","last_became_active":"2024-09-21T02:58:15.042643+0000","last_became_peered":"2024-09-21T02:58:15.042643+0000","last_unstale":"2024-09-21T02:58:49.228974+0000","last_undegraded":"2024-09-21T02:58:49.228974+0000","last_fullsized":"2024-09-21T02:58:49.228974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:14.639995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748116+0000","last_change":"2024-09-21T02:58:15.037015+0000","last_active":"2024-09-21T02:58:49.748116+0000","last_peered":"2024-09-21T02:58:49.748116+0000","last_clean":"2024-09-21T02:58:49.748116+0000","last_became_active":"2024-09-21T02:58:15.036628+0000","last_became_peered":"2024-09-21T02:58:15.036628+0000","last_unstale":"2024-09-21T02:58:49.748116+0000","last_undegraded":"2024-09-21T02:58:49.748116+0000","last_fullsized":"2024-09-21T02:58:49.748116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:07.823178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228334+0000","last_change":"2024-09-21T02:58:15.041768+0000","last_active":"2024-09-21T02:58:49.228334+0000","last_peered":"2024-09-21T02:58:49.228334+0000","last_clean":"2024-09-21T02:58:49.228334+0000","last_became_active":"2024-09-21T02:58:15.041374+0000","last_became_peered":"2024-09-21T02:58:15.041374+0000","last_unstale":"2024-09-21T02:58:49.228334+0000","last_undegraded":"2024-09-21T02:58:49.228334+0000","last_fullsized":"2024-09-21T02:58:49.228334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:25.145949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227754+0000","last_change":"2024-09-21T02:58:15.047263+0000","last_active":"2024-09-21T02:58:49.227754+0000","last_peered":"2024-09-21T02:58:49.227754+0000","last_clean":"2024-09-21T02:58:49.227754+0000","last_became_active":"2024-09-21T02:58:15.046490+0000","last_became_peered":"2024-09-21T02:58:15.046490+0000","last_unstale":"2024-09-21T02:58:49.227754+0000","last_undegraded":"2024-09-21T02:58:49.227754+0000","last_fullsized":"2024-09-21T02:58:49.227754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:45.413510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435084+0000","last_change":"2024-09-21T02:58:15.034115+0000","last_active":"2024-09-21T02:58:49.435084+0000","last_peered":"2024-09-21T02:58:49.435084+0000","last_clean":"2024-09-21T02:58:49.435084+0000","last_became_active":"2024-09-21T02:58:15.033709+0000","last_became_peered":"2024-09-21T02:58:15.033709+0000","last_unstale":"2024-09-21T02:58:49.435084+0000","last_undegraded":"2024-09-21T02:58:49.435084+0000","last_fullsized":"2024-09-21T02:58:49.435084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:54.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227143+0000","last_change":"2024-09-21T02:58:15.047154+0000","last_active":"2024-09-21T02:58:49.227143+0000","last_peered":"2024-09-21T02:58:49.227143+0000","last_clean":"2024-09-21T02:58:49.227143+0000","last_became_active":"2024-09-21T02:58:15.046777+0000","last_became_peered":"2024-09-21T02:58:15.046777+0000","last_unstale":"2024-09-21T02:58:49.227143+0000","last_undegraded":"2024-09-21T02:58:49.227143+0000","last_fullsized":"2024-09-21T02:58:49.227143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:56.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225136+0000","last_change":"2024-09-21T02:58:15.036867+0000","last_active":"2024-09-21T02:58:49.225136+0000","last_peered":"2024-09-21T02:58:49.225136+0000","last_clean":"2024-09-21T02:58:49.225136+0000","last_became_active":"2024-09-21T02:58:15.036228+0000","last_became_peered":"2024-09-21T02:58:15.036228+0000","last_unstale":"2024-09-21T02:58:49.225136+0000","last_undegraded":"2024-09-21T02:58:49.225136+0000","last_fullsized":"2024-09-21T02:58:49.225136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:11.245917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224017+0000","last_change":"2024-09-21T02:58:15.037311+0000","last_active":"2024-09-21T02:58:49.224017+0000","last_peered":"2024-09-21T02:58:49.224017+0000","last_clean":"2024-09-21T02:58:49.224017+0000","last_became_active":"2024-09-21T02:58:15.036909+0000","last_became_peered":"2024-09-21T02:58:15.036909+0000","last_unstale":"2024-09-21T02:58:49.224017+0000","last_undegraded":"2024-09-21T02:58:49.224017+0000","last_fullsized":"2024-09-21T02:58:49.224017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:35.250000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227739+0000","last_change":"2024-09-21T02:58:15.042678+0000","last_active":"2024-09-21T02:58:49.227739+0000","last_peered":"2024-09-21T02:58:49.227739+0000","last_clean":"2024-09-21T02:58:49.227739+0000","last_became_active":"2024-09-21T02:58:15.042334+0000","last_became_peered":"2024-09-21T02:58:15.042334+0000","last_unstale":"2024-09-21T02:58:49.227739+0000","last_undegraded":"2024-09-21T02:58:49.227739+0000","last_fullsized":"2024-09-21T02:58:49.227739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:09.302354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227472+0000","last_change":"2024-09-21T02:58:15.040741+0000","last_active":"2024-09-21T02:58:49.227472+0000","last_peered":"2024-09-21T02:58:49.227472+0000","last_clean":"2024-09-21T02:58:49.227472+0000","last_became_active":"2024-09-21T02:58:15.040357+0000","last_became_peered":"2024-09-21T02:58:15.040357+0000","last_unstale":"2024-09-21T02:58:49.227472+0000","last_undegraded":"2024-09-21T02:58:49.227472+0000","last_fullsized":"2024-09-21T02:58:49.227472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979623+0000","last_change":"2024-09-21T02:58:15.029780+0000","last_active":"2024-09-21T02:58:49.979623+0000","last_peered":"2024-09-21T02:58:49.979623+0000","last_clean":"2024-09-21T02:58:49.979623+0000","last_became_active":"2024-09-21T02:58:15.029259+0000","last_became_peered":"2024-09-21T02:58:15.029259+0000","last_unstale":"2024-09-21T02:58:49.979623+0000","last_undegraded":"2024-09-21T02:58:49.979623+0000","last_fullsized":"2024-09-21T02:58:49.979623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:35.683337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979618+0000","last_change":"2024-09-21T02:58:15.040557+0000","last_active":"2024-09-21T02:58:49.979618+0000","last_peered":"2024-09-21T02:58:49.979618+0000","last_clean":"2024-09-21T02:58:49.979618+0000","last_became_active":"2024-09-21T02:58:15.040178+0000","last_became_peered":"2024-09-21T02:58:15.040178+0000","last_unstale":"2024-09-21T02:58:49.979618+0000","last_undegraded":"2024-09-21T02:58:49.979618+0000","last_fullsized":"2024-09-21T02:58:49.979618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:50.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435020+0000","last_change":"2024-09-21T02:58:15.041717+0000","last_active":"2024-09-21T02:58:49.435020+0000","last_peered":"2024-09-21T02:58:49.435020+0000","last_clean":"2024-09-21T02:58:49.435020+0000","last_became_active":"2024-09-21T02:58:15.041375+0000","last_became_peered":"2024-09-21T02:58:15.041375+0000","last_unstale":"2024-09-21T02:58:49.435020+0000","last_undegraded":"2024-09-21T02:58:49.435020+0000","last_fullsized":"2024-09-21T02:58:49.435020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:22.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226572+0000","last_change":"2024-09-21T02:58:15.042001+0000","last_active":"2024-09-21T02:58:49.226572+0000","last_peered":"2024-09-21T02:58:49.226572+0000","last_clean":"2024-09-21T02:58:49.226572+0000","last_became_active":"2024-09-21T02:58:15.038585+0000","last_became_peered":"2024-09-21T02:58:15.038585+0000","last_unstale":"2024-09-21T02:58:49.226572+0000","last_undegraded":"2024-09-21T02:58:49.226572+0000","last_fullsized":"2024-09-21T02:58:49.226572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231199+0000","last_change":"2024-09-21T02:58:15.046636+0000","last_active":"2024-09-21T02:58:49.231199+0000","last_peered":"2024-09-21T02:58:49.231199+0000","last_clean":"2024-09-21T02:58:49.231199+0000","last_became_active":"2024-09-21T02:58:15.046103+0000","last_became_peered":"2024-09-21T02:58:15.046103+0000","last_unstale":"2024-09-21T02:58:49.231199+0000","last_undegraded":"2024-09-21T02:58:49.231199+0000","last_fullsized":"2024-09-21T02:58:49.231199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.579641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225214+0000","last_change":"2024-09-21T02:58:15.045461+0000","last_active":"2024-09-21T02:58:49.225214+0000","last_peered":"2024-09-21T02:58:49.225214+0000","last_clean":"2024-09-21T02:58:49.225214+0000","last_became_active":"2024-09-21T02:58:15.045091+0000","last_became_peered":"2024-09-21T02:58:15.045091+0000","last_unstale":"2024-09-21T02:58:49.225214+0000","last_undegraded":"2024-09-21T02:58:49.225214+0000","last_fullsized":"2024-09-21T02:58:49.225214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:33.078860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229199+0000","last_change":"2024-09-21T02:58:15.042454+0000","last_active":"2024-09-21T02:58:49.229199+0000","last_peered":"2024-09-21T02:58:49.229199+0000","last_clean":"2024-09-21T02:58:49.229199+0000","last_became_active":"2024-09-21T02:58:15.042071+0000","last_became_peered":"2024-09-21T02:58:15.042071+0000","last_unstale":"2024-09-21T02:58:49.229199+0000","last_undegraded":"2024-09-21T02:58:49.229199+0000","last_fullsized":"2024-09-21T02:58:49.229199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:09.798110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227985+0000","last_change":"2024-09-21T02:58:15.039238+0000","last_active":"2024-09-21T02:58:49.227985+0000","last_peered":"2024-09-21T02:58:49.227985+0000","last_clean":"2024-09-21T02:58:49.227985+0000","last_became_active":"2024-09-21T02:58:15.037883+0000","last_became_peered":"2024-09-21T02:58:15.037883+0000","last_unstale":"2024-09-21T02:58:49.227985+0000","last_undegraded":"2024-09-21T02:58:49.227985+0000","last_fullsized":"2024-09-21T02:58:49.227985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:13.418696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230871+0000","last_change":"2024-09-21T02:58:15.040236+0000","last_active":"2024-09-21T02:58:49.230871+0000","last_peered":"2024-09-21T02:58:49.230871+0000","last_clean":"2024-09-21T02:58:49.230871+0000","last_became_active":"2024-09-21T02:58:15.039895+0000","last_became_peered":"2024-09-21T02:58:15.039895+0000","last_unstale":"2024-09-21T02:58:49.230871+0000","last_undegraded":"2024-09-21T02:58:49.230871+0000","last_fullsized":"2024-09-21T02:58:49.230871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:48.099127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224435+0000","last_change":"2024-09-21T02:58:15.044804+0000","last_active":"2024-09-21T02:58:49.224435+0000","last_peered":"2024-09-21T02:58:49.224435+0000","last_clean":"2024-09-21T02:58:49.224435+0000","last_became_active":"2024-09-21T02:58:15.044446+0000","last_became_peered":"2024-09-21T02:58:15.044446+0000","last_unstale":"2024-09-21T02:58:49.224435+0000","last_undegraded":"2024-09-21T02:58:49.224435+0000","last_fullsized":"2024-09-21T02:58:49.224435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:37.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230509+0000","last_change":"2024-09-21T02:58:15.034219+0000","last_active":"2024-09-21T02:58:49.230509+0000","last_peered":"2024-09-21T02:58:49.230509+0000","last_clean":"2024-09-21T02:58:49.230509+0000","last_became_active":"2024-09-21T02:58:15.033775+0000","last_became_peered":"2024-09-21T02:58:15.033775+0000","last_unstale":"2024-09-21T02:58:49.230509+0000","last_undegraded":"2024-09-21T02:58:49.230509+0000","last_fullsized":"2024-09-21T02:58:49.230509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:12.534737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231688+0000","last_change":"2024-09-21T02:58:49.231259+0000","last_active":"2024-09-21T02:58:49.231688+0000","last_peered":"2024-09-21T02:58:49.231688+0000","last_clean":"2024-09-21T02:58:49.231688+0000","last_became_active":"2024-09-21T02:58:49.230867+0000","last_became_peered":"2024-09-21T02:58:49.230867+0000","last_unstale":"2024-09-21T02:58:49.231688+0000","last_undegraded":"2024-09-21T02:58:49.231688+0000","last_fullsized":"2024-09-21T02:58:49.231688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:11.163458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979870+0000","last_change":"2024-09-21T02:58:15.037273+0000","last_active":"2024-09-21T02:58:49.979870+0000","last_peered":"2024-09-21T02:58:49.979870+0000","last_clean":"2024-09-21T02:58:49.979870+0000","last_became_active":"2024-09-21T02:58:15.036879+0000","last_became_peered":"2024-09-21T02:58:15.036879+0000","last_unstale":"2024-09-21T02:58:49.979870+0000","last_undegraded":"2024-09-21T02:58:49.979870+0000","last_fullsized":"2024-09-21T02:58:49.979870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:50.721998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980003+0000","last_change":"2024-09-21T02:58:15.035716+0000","last_active":"2024-09-21T02:58:49.980003+0000","last_peered":"2024-09-21T02:58:49.980003+0000","last_clean":"2024-09-21T02:58:49.980003+0000","last_became_active":"2024-09-21T02:58:15.035356+0000","last_became_peered":"2024-09-21T02:58:15.035356+0000","last_unstale":"2024-09-21T02:58:49.980003+0000","last_undegraded":"2024-09-21T02:58:49.980003+0000","last_fullsized":"2024-09-21T02:58:49.980003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227675+0000","last_change":"2024-09-21T02:58:15.041737+0000","last_active":"2024-09-21T02:58:49.227675+0000","last_peered":"2024-09-21T02:58:49.227675+0000","last_clean":"2024-09-21T02:58:49.227675+0000","last_became_active":"2024-09-21T02:58:15.041387+0000","last_became_peered":"2024-09-21T02:58:15.041387+0000","last_unstale":"2024-09-21T02:58:49.227675+0000","last_undegraded":"2024-09-21T02:58:49.227675+0000","last_fullsized":"2024-09-21T02:58:49.227675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.893510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70213,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":352,"num_read_kb":249,"num_write":168,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":210639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281500,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":462290,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972389,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":1116161,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135914,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":466622,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332143,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":462446,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1058355,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659193,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":457702,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":1053552,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":462743,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":457896,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":525174,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":523824,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":459090,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:59:49.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:59:50.240 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:50.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:50 smithi081 ceph-mon[30991]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:50.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:50 smithi164 ceph-mon[34236]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:50.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:50 smithi181 ceph-mon[34096]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 -- 172.21.15.81:0/115284771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 msgr2=0x7f00b410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 --2- 172.21.15.81:0/115284771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b410f520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009ca0 tx=0x7f00ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 -- 172.21.15.81:0/115284771 shutdown_connections 2024-09-21T02:59:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 --2- 172.21.15.81:0/115284771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41083a0 0x7f00b41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 --2- 172.21.15.81:0/115284771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b410f520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 --2- 172.21.15.81:0/115284771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b4102a60 0x7f00b4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 -- 172.21.15.81:0/115284771 >> 172.21.15.81:0/115284771 conn(0x7f00b4079730 msgr2=0x7f00b4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 -- 172.21.15.81:0/115284771 shutdown_connections 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.746+0000 7f00bb82a640 1 -- 172.21.15.81:0/115284771 wait complete. 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 Processor -- start 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 -- start start 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b4102a60 0x7f00b419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41083a0 0x7f00b419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4113960 con 0x7f00b4108cf0 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41137e0 con 0x7f00b4102a60 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.747+0000 7f00bb82a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4113ae0 con 0x7f00b41083a0 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b419fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40680/0 (socket says 172.21.15.81:40680) 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 -- 172.21.15.81:0/4302901 learned_addr learned my addr 172.21.15.81:0/4302901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b95c6640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b4102a60 0x7f00b419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b8dc5640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41083a0 0x7f00b419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 -- 172.21.15.81:0/4302901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41083a0 msgr2=0x7f00b419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41083a0 0x7f00b419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 -- 172.21.15.81:0/4302901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b4102a60 msgr2=0x7f00b419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b4102a60 0x7f00b419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 -- 172.21.15.81:0/4302901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b41a02a0 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00b9dc7640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b419fb70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f00ac005cc0 tx=0x7f00ac032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00aa7fc640 1 -- 172.21.15.81:0/4302901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac032e00 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00aa7fc640 1 -- 172.21.15.81:0/4302901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00ac0044d0 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b41a0530 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00aa7fc640 1 -- 172.21.15.81:0/4302901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac030b70 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.748+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41a6cf0 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.749+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b4102e70 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.751+0000 7f00aa7fc640 1 -- 172.21.15.81:0/4302901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f00ac030d10 con 0x7f00b4108cf0 2024-09-21T02:59:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.751+0000 7f00aa7fc640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f00a00b65a0 0x7f00a00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:50.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.751+0000 7f00b95c6640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f00a00b65a0 0x7f00a00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:50.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.752+0000 7f00aa7fc640 1 -- 172.21.15.81:0/4302901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f00ac108ce0 con 0x7f00b4108cf0 2024-09-21T02:59:50.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.752+0000 7f00b95c6640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f00a00b65a0 0x7f00a00b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f00a40058c0 tx=0x7f00a400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:50.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.755+0000 7f00aa7fc640 1 -- 172.21.15.81:0/4302901 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00ac0cf0d0 con 0x7f00b4108cf0 2024-09-21T02:59:50.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.933+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00b410ab40 con 0x7f00a00b65a0 2024-09-21T02:59:50.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.939+0000 7f00aa7fc640 1 -- 172.21.15.81:0/4302901 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340610 (secure 0 0 0) 0x7f00b410ab40 con 0x7f00a00b65a0 2024-09-21T02:59:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:50.945 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f00a00b65a0 msgr2=0x7f00a00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f00a00b65a0 0x7f00a00b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f00a40058c0 tx=0x7f00a400a4c0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 msgr2=0x7f00b419fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b419fb70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f00ac005cc0 tx=0x7f00ac032a10 comp rx=0 tx=0).stop 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 shutdown_connections 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f00a00b65a0 0x7f00a00b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00b41083a0 0x7f00b419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4108cf0 0x7f00b419fb70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 --2- 172.21.15.81:0/4302901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b4102a60 0x7f00b419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 >> 172.21.15.81:0/4302901 conn(0x7f00b4079730 msgr2=0x7f00b41043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 shutdown_connections 2024-09-21T02:59:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:50.943+0000 7f00bb82a640 1 -- 172.21.15.81:0/4302901 wait complete. 2024-09-21T02:59:51.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:51 smithi164 ceph-mon[34236]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:51 smithi081 ceph-mon[30991]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:51.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:51 smithi181 ceph-mon[34096]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:51.651 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-21T02:59:49.725515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660815,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":433,"num_read_kb":318,"num_write":293,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376920,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564904,"statfs":{"total":1151940427776,"available":1151554461696,"internally_reserved":0,"allocated":11288576,"data_stored":7505855,"data_compressed":389853,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003697"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153188+0000","last_change":"2024-09-21T02:58:13.017321+0000","last_active":"2024-09-21T02:58:51.153188+0000","last_peered":"2024-09-21T02:58:51.153188+0000","last_clean":"2024-09-21T02:58:51.153188+0000","last_became_active":"2024-09-21T02:58:13.017017+0000","last_became_peered":"2024-09-21T02:58:13.017017+0000","last_unstale":"2024-09-21T02:58:51.153188+0000","last_undegraded":"2024-09-21T02:58:51.153188+0000","last_fullsized":"2024-09-21T02:58:51.153188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:11.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228749+0000","last_change":"2024-09-21T02:58:15.043883+0000","last_active":"2024-09-21T02:58:49.228749+0000","last_peered":"2024-09-21T02:58:49.228749+0000","last_clean":"2024-09-21T02:58:49.228749+0000","last_became_active":"2024-09-21T02:58:15.043551+0000","last_became_peered":"2024-09-21T02:58:15.043551+0000","last_unstale":"2024-09-21T02:58:49.228749+0000","last_undegraded":"2024-09-21T02:58:49.228749+0000","last_fullsized":"2024-09-21T02:58:49.228749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:40.867181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224252+0000","last_change":"2024-09-21T02:58:22.084562+0000","last_active":"2024-09-21T02:58:49.224252+0000","last_peered":"2024-09-21T02:58:49.224252+0000","last_clean":"2024-09-21T02:58:49.224252+0000","last_became_active":"2024-09-21T02:58:22.084145+0000","last_became_peered":"2024-09-21T02:58:22.084145+0000","last_unstale":"2024-09-21T02:58:49.224252+0000","last_undegraded":"2024-09-21T02:58:49.224252+0000","last_fullsized":"2024-09-21T02:58:49.224252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:56.402375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229202+0000","last_change":"2024-09-21T02:58:13.553479+0000","last_active":"2024-09-21T02:58:49.229202+0000","last_peered":"2024-09-21T02:58:49.229202+0000","last_clean":"2024-09-21T02:58:49.229202+0000","last_became_active":"2024-09-21T02:58:13.553117+0000","last_became_peered":"2024-09-21T02:58:13.553117+0000","last_unstale":"2024-09-21T02:58:49.229202+0000","last_undegraded":"2024-09-21T02:58:49.229202+0000","last_fullsized":"2024-09-21T02:58:49.229202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:34.301361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980234+0000","last_change":"2024-09-21T02:58:15.041724+0000","last_active":"2024-09-21T02:58:49.980234+0000","last_peered":"2024-09-21T02:58:49.980234+0000","last_clean":"2024-09-21T02:58:49.980234+0000","last_became_active":"2024-09-21T02:58:15.041355+0000","last_became_peered":"2024-09-21T02:58:15.041355+0000","last_unstale":"2024-09-21T02:58:49.980234+0000","last_undegraded":"2024-09-21T02:58:49.980234+0000","last_fullsized":"2024-09-21T02:58:49.980234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:19.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226270+0000","last_change":"2024-09-21T02:58:22.085004+0000","last_active":"2024-09-21T02:58:49.226270+0000","last_peered":"2024-09-21T02:58:49.226270+0000","last_clean":"2024-09-21T02:58:49.226270+0000","last_became_active":"2024-09-21T02:58:22.084622+0000","last_became_peered":"2024-09-21T02:58:22.084622+0000","last_unstale":"2024-09-21T02:58:49.226270+0000","last_undegraded":"2024-09-21T02:58:49.226270+0000","last_fullsized":"2024-09-21T02:58:49.226270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.303286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152223+0000","last_change":"2024-09-21T02:58:49.237002+0000","last_active":"2024-09-21T02:58:51.152223+0000","last_peered":"2024-09-21T02:58:51.152223+0000","last_clean":"2024-09-21T02:58:51.152223+0000","last_became_active":"2024-09-21T02:58:49.233219+0000","last_became_peered":"2024-09-21T02:58:49.233219+0000","last_unstale":"2024-09-21T02:58:51.152223+0000","last_undegraded":"2024-09-21T02:58:51.152223+0000","last_fullsized":"2024-09-21T02:58:51.152223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:38.409153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228358+0000","last_change":"2024-09-21T02:58:15.051658+0000","last_active":"2024-09-21T02:58:49.228358+0000","last_peered":"2024-09-21T02:58:49.228358+0000","last_clean":"2024-09-21T02:58:49.228358+0000","last_became_active":"2024-09-21T02:58:15.048345+0000","last_became_peered":"2024-09-21T02:58:15.048345+0000","last_unstale":"2024-09-21T02:58:49.228358+0000","last_undegraded":"2024-09-21T02:58:49.228358+0000","last_fullsized":"2024-09-21T02:58:49.228358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:36.069051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.750150+0000","last_change":"2024-09-21T02:58:49.750028+0000","last_active":"2024-09-21T02:58:49.750150+0000","last_peered":"2024-09-21T02:58:49.750150+0000","last_clean":"2024-09-21T02:58:49.750150+0000","last_became_active":"2024-09-21T02:58:49.749587+0000","last_became_peered":"2024-09-21T02:58:49.749587+0000","last_unstale":"2024-09-21T02:58:49.750150+0000","last_undegraded":"2024-09-21T02:58:49.750150+0000","last_fullsized":"2024-09-21T02:58:49.750150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:33.018490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230873+0000","last_change":"2024-09-21T02:58:13.020762+0000","last_active":"2024-09-21T02:58:49.230873+0000","last_peered":"2024-09-21T02:58:49.230873+0000","last_clean":"2024-09-21T02:58:49.230873+0000","last_became_active":"2024-09-21T02:58:13.020263+0000","last_became_peered":"2024-09-21T02:58:13.020263+0000","last_unstale":"2024-09-21T02:58:49.230873+0000","last_undegraded":"2024-09-21T02:58:49.230873+0000","last_fullsized":"2024-09-21T02:58:49.230873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:14.490179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748543+0000","last_change":"2024-09-21T02:58:15.048732+0000","last_active":"2024-09-21T02:58:49.748543+0000","last_peered":"2024-09-21T02:58:49.748543+0000","last_clean":"2024-09-21T02:58:49.748543+0000","last_became_active":"2024-09-21T02:58:15.048393+0000","last_became_peered":"2024-09-21T02:58:15.048393+0000","last_unstale":"2024-09-21T02:58:49.748543+0000","last_undegraded":"2024-09-21T02:58:49.748543+0000","last_fullsized":"2024-09-21T02:58:49.748543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:07.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225897+0000","last_change":"2024-09-21T02:58:22.087072+0000","last_active":"2024-09-21T02:58:49.225897+0000","last_peered":"2024-09-21T02:58:49.225897+0000","last_clean":"2024-09-21T02:58:49.225897+0000","last_became_active":"2024-09-21T02:58:22.086695+0000","last_became_peered":"2024-09-21T02:58:22.086695+0000","last_unstale":"2024-09-21T02:58:49.225897+0000","last_undegraded":"2024-09-21T02:58:49.225897+0000","last_fullsized":"2024-09-21T02:58:49.225897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:18.592656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230870+0000","last_change":"2024-09-21T02:58:15.043756+0000","last_active":"2024-09-21T02:58:49.230870+0000","last_peered":"2024-09-21T02:58:49.230870+0000","last_clean":"2024-09-21T02:58:49.230870+0000","last_became_active":"2024-09-21T02:58:15.043415+0000","last_became_peered":"2024-09-21T02:58:15.043415+0000","last_unstale":"2024-09-21T02:58:49.230870+0000","last_undegraded":"2024-09-21T02:58:49.230870+0000","last_fullsized":"2024-09-21T02:58:49.230870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:53.655906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147581+0000","last_change":"2024-09-21T02:58:13.017054+0000","last_active":"2024-09-21T02:58:50.147581+0000","last_peered":"2024-09-21T02:58:50.147581+0000","last_clean":"2024-09-21T02:58:50.147581+0000","last_became_active":"2024-09-21T02:58:13.016636+0000","last_became_peered":"2024-09-21T02:58:13.016636+0000","last_unstale":"2024-09-21T02:58:50.147581+0000","last_undegraded":"2024-09-21T02:58:50.147581+0000","last_fullsized":"2024-09-21T02:58:50.147581+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:27.941501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226537+0000","last_change":"2024-09-21T02:58:22.229949+0000","last_active":"2024-09-21T02:58:49.226537+0000","last_peered":"2024-09-21T02:58:49.226537+0000","last_clean":"2024-09-21T02:58:49.226537+0000","last_became_active":"2024-09-21T02:58:22.229490+0000","last_became_peered":"2024-09-21T02:58:22.229490+0000","last_unstale":"2024-09-21T02:58:49.226537+0000","last_undegraded":"2024-09-21T02:58:49.226537+0000","last_fullsized":"2024-09-21T02:58:49.226537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:25.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228272+0000","last_change":"2024-09-21T02:58:15.040559+0000","last_active":"2024-09-21T02:58:49.228272+0000","last_peered":"2024-09-21T02:58:49.228272+0000","last_clean":"2024-09-21T02:58:49.228272+0000","last_became_active":"2024-09-21T02:58:15.040220+0000","last_became_peered":"2024-09-21T02:58:15.040220+0000","last_unstale":"2024-09-21T02:58:49.228272+0000","last_undegraded":"2024-09-21T02:58:49.228272+0000","last_fullsized":"2024-09-21T02:58:49.228272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:55.853966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224522+0000","last_change":"2024-09-21T02:58:13.017985+0000","last_active":"2024-09-21T02:58:49.224522+0000","last_peered":"2024-09-21T02:58:49.224522+0000","last_clean":"2024-09-21T02:58:49.224522+0000","last_became_active":"2024-09-21T02:58:13.017583+0000","last_became_peered":"2024-09-21T02:58:13.017583+0000","last_unstale":"2024-09-21T02:58:49.224522+0000","last_undegraded":"2024-09-21T02:58:49.224522+0000","last_fullsized":"2024-09-21T02:58:49.224522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.917960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226338+0000","last_change":"2024-09-21T02:58:22.077294+0000","last_active":"2024-09-21T02:58:49.226338+0000","last_peered":"2024-09-21T02:58:49.226338+0000","last_clean":"2024-09-21T02:58:49.226338+0000","last_became_active":"2024-09-21T02:58:22.076884+0000","last_became_peered":"2024-09-21T02:58:22.076884+0000","last_unstale":"2024-09-21T02:58:49.226338+0000","last_undegraded":"2024-09-21T02:58:49.226338+0000","last_fullsized":"2024-09-21T02:58:49.226338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:00.045383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226825+0000","last_change":"2024-09-21T02:58:15.045160+0000","last_active":"2024-09-21T02:58:49.226825+0000","last_peered":"2024-09-21T02:58:49.226825+0000","last_clean":"2024-09-21T02:58:49.226825+0000","last_became_active":"2024-09-21T02:58:15.044814+0000","last_became_peered":"2024-09-21T02:58:15.044814+0000","last_unstale":"2024-09-21T02:58:49.226825+0000","last_undegraded":"2024-09-21T02:58:49.226825+0000","last_fullsized":"2024-09-21T02:58:49.226825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:13.325320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146734+0000","last_change":"2024-09-21T02:58:13.011081+0000","last_active":"2024-09-21T02:58:50.146734+0000","last_peered":"2024-09-21T02:58:50.146734+0000","last_clean":"2024-09-21T02:58:50.146734+0000","last_became_active":"2024-09-21T02:58:13.010682+0000","last_became_peered":"2024-09-21T02:58:13.010682+0000","last_unstale":"2024-09-21T02:58:50.146734+0000","last_undegraded":"2024-09-21T02:58:50.146734+0000","last_fullsized":"2024-09-21T02:58:50.146734+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224126+0000","last_change":"2024-09-21T02:58:22.083449+0000","last_active":"2024-09-21T02:58:49.224126+0000","last_peered":"2024-09-21T02:58:49.224126+0000","last_clean":"2024-09-21T02:58:49.224126+0000","last_became_active":"2024-09-21T02:58:22.082996+0000","last_became_peered":"2024-09-21T02:58:22.082996+0000","last_unstale":"2024-09-21T02:58:49.224126+0000","last_undegraded":"2024-09-21T02:58:49.224126+0000","last_fullsized":"2024-09-21T02:58:49.224126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:21.667824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230242+0000","last_change":"2024-09-21T02:58:15.039458+0000","last_active":"2024-09-21T02:58:49.230242+0000","last_peered":"2024-09-21T02:58:49.230242+0000","last_clean":"2024-09-21T02:58:49.230242+0000","last_became_active":"2024-09-21T02:58:15.039082+0000","last_became_peered":"2024-09-21T02:58:15.039082+0000","last_unstale":"2024-09-21T02:58:49.230242+0000","last_undegraded":"2024-09-21T02:58:49.230242+0000","last_fullsized":"2024-09-21T02:58:49.230242+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:37.102212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147255+0000","last_change":"2024-09-21T02:58:49.982108+0000","last_active":"2024-09-21T02:58:50.147255+0000","last_peered":"2024-09-21T02:58:50.147255+0000","last_clean":"2024-09-21T02:58:50.147255+0000","last_became_active":"2024-09-21T02:58:49.981462+0000","last_became_peered":"2024-09-21T02:58:49.981462+0000","last_unstale":"2024-09-21T02:58:50.147255+0000","last_undegraded":"2024-09-21T02:58:50.147255+0000","last_fullsized":"2024-09-21T02:58:50.147255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:17.624627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226847+0000","last_change":"2024-09-21T02:58:22.231082+0000","last_active":"2024-09-21T02:58:49.226847+0000","last_peered":"2024-09-21T02:58:49.226847+0000","last_clean":"2024-09-21T02:58:49.226847+0000","last_became_active":"2024-09-21T02:58:22.229781+0000","last_became_peered":"2024-09-21T02:58:22.229781+0000","last_unstale":"2024-09-21T02:58:49.226847+0000","last_undegraded":"2024-09-21T02:58:49.226847+0000","last_fullsized":"2024-09-21T02:58:49.226847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:14.964809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980043+0000","last_change":"2024-09-21T02:58:15.033111+0000","last_active":"2024-09-21T02:58:49.980043+0000","last_peered":"2024-09-21T02:58:49.980043+0000","last_clean":"2024-09-21T02:58:49.980043+0000","last_became_active":"2024-09-21T02:58:15.032738+0000","last_became_peered":"2024-09-21T02:58:15.032738+0000","last_unstale":"2024-09-21T02:58:49.980043+0000","last_undegraded":"2024-09-21T02:58:49.980043+0000","last_fullsized":"2024-09-21T02:58:49.980043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:31.209451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147323+0000","last_change":"2024-09-21T02:58:13.229717+0000","last_active":"2024-09-21T02:58:50.147323+0000","last_peered":"2024-09-21T02:58:50.147323+0000","last_clean":"2024-09-21T02:58:50.147323+0000","last_became_active":"2024-09-21T02:58:13.229376+0000","last_became_peered":"2024-09-21T02:58:13.229376+0000","last_unstale":"2024-09-21T02:58:50.147323+0000","last_undegraded":"2024-09-21T02:58:50.147323+0000","last_fullsized":"2024-09-21T02:58:50.147323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:05.436044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224447+0000","last_change":"2024-09-21T02:58:22.081140+0000","last_active":"2024-09-21T02:58:49.224447+0000","last_peered":"2024-09-21T02:58:49.224447+0000","last_clean":"2024-09-21T02:58:49.224447+0000","last_became_active":"2024-09-21T02:58:22.080670+0000","last_became_peered":"2024-09-21T02:58:22.080670+0000","last_unstale":"2024-09-21T02:58:49.224447+0000","last_undegraded":"2024-09-21T02:58:49.224447+0000","last_fullsized":"2024-09-21T02:58:49.224447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:43.078241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228985+0000","last_change":"2024-09-21T02:58:15.035927+0000","last_active":"2024-09-21T02:58:49.228985+0000","last_peered":"2024-09-21T02:58:49.228985+0000","last_clean":"2024-09-21T02:58:49.228985+0000","last_became_active":"2024-09-21T02:58:15.035529+0000","last_became_peered":"2024-09-21T02:58:15.035529+0000","last_unstale":"2024-09-21T02:58:49.228985+0000","last_undegraded":"2024-09-21T02:58:49.228985+0000","last_fullsized":"2024-09-21T02:58:49.228985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:07.046836+0000","last_change":"2024-09-21T02:58:13.016489+0000","last_active":"2024-09-21T02:59:07.046836+0000","last_peered":"2024-09-21T02:59:07.046836+0000","last_clean":"2024-09-21T02:59:07.046836+0000","last_became_active":"2024-09-21T02:58:13.016176+0000","last_became_peered":"2024-09-21T02:58:13.016176+0000","last_unstale":"2024-09-21T02:59:07.046836+0000","last_undegraded":"2024-09-21T02:59:07.046836+0000","last_fullsized":"2024-09-21T02:59:07.046836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:54.908933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227852+0000","last_change":"2024-09-21T02:58:22.229868+0000","last_active":"2024-09-21T02:58:49.227852+0000","last_peered":"2024-09-21T02:58:49.227852+0000","last_clean":"2024-09-21T02:58:49.227852+0000","last_became_active":"2024-09-21T02:58:22.229318+0000","last_became_peered":"2024-09-21T02:58:22.229318+0000","last_unstale":"2024-09-21T02:58:49.227852+0000","last_undegraded":"2024-09-21T02:58:49.227852+0000","last_fullsized":"2024-09-21T02:58:49.227852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:06.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435282+0000","last_change":"2024-09-21T02:58:15.037953+0000","last_active":"2024-09-21T02:58:49.435282+0000","last_peered":"2024-09-21T02:58:49.435282+0000","last_clean":"2024-09-21T02:58:49.435282+0000","last_became_active":"2024-09-21T02:58:15.036934+0000","last_became_peered":"2024-09-21T02:58:15.036934+0000","last_unstale":"2024-09-21T02:58:49.435282+0000","last_undegraded":"2024-09-21T02:58:49.435282+0000","last_fullsized":"2024-09-21T02:58:49.435282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:35.118295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146197+0000","last_change":"2024-09-21T02:58:13.553861+0000","last_active":"2024-09-21T02:58:50.146197+0000","last_peered":"2024-09-21T02:58:50.146197+0000","last_clean":"2024-09-21T02:58:50.146197+0000","last_became_active":"2024-09-21T02:58:13.553016+0000","last_became_peered":"2024-09-21T02:58:13.553016+0000","last_unstale":"2024-09-21T02:58:50.146197+0000","last_undegraded":"2024-09-21T02:58:50.146197+0000","last_fullsized":"2024-09-21T02:58:50.146197+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227008+0000","last_change":"2024-09-21T02:58:22.087306+0000","last_active":"2024-09-21T02:58:49.227008+0000","last_peered":"2024-09-21T02:58:49.227008+0000","last_clean":"2024-09-21T02:58:49.227008+0000","last_became_active":"2024-09-21T02:58:22.086800+0000","last_became_peered":"2024-09-21T02:58:22.086800+0000","last_unstale":"2024-09-21T02:58:49.227008+0000","last_undegraded":"2024-09-21T02:58:49.227008+0000","last_fullsized":"2024-09-21T02:58:49.227008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:28.652990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224469+0000","last_change":"2024-09-21T02:58:15.038383+0000","last_active":"2024-09-21T02:58:49.224469+0000","last_peered":"2024-09-21T02:58:49.224469+0000","last_clean":"2024-09-21T02:58:49.224469+0000","last_became_active":"2024-09-21T02:58:15.037878+0000","last_became_peered":"2024-09-21T02:58:15.037878+0000","last_unstale":"2024-09-21T02:58:49.224469+0000","last_undegraded":"2024-09-21T02:58:49.224469+0000","last_fullsized":"2024-09-21T02:58:49.224469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:14.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223874+0000","last_change":"2024-09-21T02:58:13.555218+0000","last_active":"2024-09-21T02:58:49.223874+0000","last_peered":"2024-09-21T02:58:49.223874+0000","last_clean":"2024-09-21T02:58:49.223874+0000","last_became_active":"2024-09-21T02:58:13.554831+0000","last_became_peered":"2024-09-21T02:58:13.554831+0000","last_unstale":"2024-09-21T02:58:49.223874+0000","last_undegraded":"2024-09-21T02:58:49.223874+0000","last_fullsized":"2024-09-21T02:58:49.223874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:32.659118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230124+0000","last_change":"2024-09-21T02:58:22.229673+0000","last_active":"2024-09-21T02:58:49.230124+0000","last_peered":"2024-09-21T02:58:49.230124+0000","last_clean":"2024-09-21T02:58:49.230124+0000","last_became_active":"2024-09-21T02:58:22.229034+0000","last_became_peered":"2024-09-21T02:58:22.229034+0000","last_unstale":"2024-09-21T02:58:49.230124+0000","last_undegraded":"2024-09-21T02:58:49.230124+0000","last_fullsized":"2024-09-21T02:58:49.230124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:26.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.981818+0000","last_change":"2024-09-21T02:58:49.981660+0000","last_active":"2024-09-21T02:58:49.981818+0000","last_peered":"2024-09-21T02:58:49.981818+0000","last_clean":"2024-09-21T02:58:49.981818+0000","last_became_active":"2024-09-21T02:58:49.980972+0000","last_became_peered":"2024-09-21T02:58:49.980972+0000","last_unstale":"2024-09-21T02:58:49.981818+0000","last_undegraded":"2024-09-21T02:58:49.981818+0000","last_fullsized":"2024-09-21T02:58:49.981818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:26.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231087+0000","last_change":"2024-09-21T02:58:13.012751+0000","last_active":"2024-09-21T02:58:49.231087+0000","last_peered":"2024-09-21T02:58:49.231087+0000","last_clean":"2024-09-21T02:58:49.231087+0000","last_became_active":"2024-09-21T02:58:13.012341+0000","last_became_peered":"2024-09-21T02:58:13.012341+0000","last_unstale":"2024-09-21T02:58:49.231087+0000","last_undegraded":"2024-09-21T02:58:49.231087+0000","last_fullsized":"2024-09-21T02:58:49.231087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435050+0000","last_change":"2024-09-21T02:58:22.084620+0000","last_active":"2024-09-21T02:58:49.435050+0000","last_peered":"2024-09-21T02:58:49.435050+0000","last_clean":"2024-09-21T02:58:49.435050+0000","last_became_active":"2024-09-21T02:58:22.083935+0000","last_became_peered":"2024-09-21T02:58:22.083935+0000","last_unstale":"2024-09-21T02:58:49.435050+0000","last_undegraded":"2024-09-21T02:58:49.435050+0000","last_fullsized":"2024-09-21T02:58:49.435050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:37.033928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748547+0000","last_change":"2024-09-21T02:58:15.046935+0000","last_active":"2024-09-21T02:58:49.748547+0000","last_peered":"2024-09-21T02:58:49.748547+0000","last_clean":"2024-09-21T02:58:49.748547+0000","last_became_active":"2024-09-21T02:58:15.046572+0000","last_became_peered":"2024-09-21T02:58:15.046572+0000","last_unstale":"2024-09-21T02:58:49.748547+0000","last_undegraded":"2024-09-21T02:58:49.748547+0000","last_fullsized":"2024-09-21T02:58:49.748547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.942643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:47.288183+0000","last_change":"2024-09-21T02:58:13.553337+0000","last_active":"2024-09-21T02:59:47.288183+0000","last_peered":"2024-09-21T02:59:47.288183+0000","last_clean":"2024-09-21T02:59:47.288183+0000","last_became_active":"2024-09-21T02:58:13.552873+0000","last_became_peered":"2024-09-21T02:58:13.552873+0000","last_unstale":"2024-09-21T02:59:47.288183+0000","last_undegraded":"2024-09-21T02:59:47.288183+0000","last_fullsized":"2024-09-21T02:59:47.288183+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:42.800873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435228+0000","last_change":"2024-09-21T02:58:22.230102+0000","last_active":"2024-09-21T02:58:49.435228+0000","last_peered":"2024-09-21T02:58:49.435228+0000","last_clean":"2024-09-21T02:58:49.435228+0000","last_became_active":"2024-09-21T02:58:22.229643+0000","last_became_peered":"2024-09-21T02:58:22.229643+0000","last_unstale":"2024-09-21T02:58:49.435228+0000","last_undegraded":"2024-09-21T02:58:49.435228+0000","last_fullsized":"2024-09-21T02:58:49.435228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.396292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434776+0000","last_change":"2024-09-21T02:58:15.043484+0000","last_active":"2024-09-21T02:58:49.434776+0000","last_peered":"2024-09-21T02:58:49.434776+0000","last_clean":"2024-09-21T02:58:49.434776+0000","last_became_active":"2024-09-21T02:58:15.042663+0000","last_became_peered":"2024-09-21T02:58:15.042663+0000","last_unstale":"2024-09-21T02:58:49.434776+0000","last_undegraded":"2024-09-21T02:58:49.434776+0000","last_fullsized":"2024-09-21T02:58:49.434776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:42.937814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.151290+0000","last_change":"2024-09-21T02:58:13.018109+0000","last_active":"2024-09-21T02:58:51.151290+0000","last_peered":"2024-09-21T02:58:51.151290+0000","last_clean":"2024-09-21T02:58:51.151290+0000","last_became_active":"2024-09-21T02:58:13.017761+0000","last_became_peered":"2024-09-21T02:58:13.017761+0000","last_unstale":"2024-09-21T02:58:51.151290+0000","last_undegraded":"2024-09-21T02:58:51.151290+0000","last_fullsized":"2024-09-21T02:58:51.151290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:12.613051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748710+0000","last_change":"2024-09-21T02:58:22.230520+0000","last_active":"2024-09-21T02:58:49.748710+0000","last_peered":"2024-09-21T02:58:49.748710+0000","last_clean":"2024-09-21T02:58:49.748710+0000","last_became_active":"2024-09-21T02:58:22.229999+0000","last_became_peered":"2024-09-21T02:58:22.229999+0000","last_unstale":"2024-09-21T02:58:49.748710+0000","last_undegraded":"2024-09-21T02:58:49.748710+0000","last_fullsized":"2024-09-21T02:58:49.748710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:12.899892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228426+0000","last_change":"2024-09-21T02:58:15.040357+0000","last_active":"2024-09-21T02:58:49.228426+0000","last_peered":"2024-09-21T02:58:49.228426+0000","last_clean":"2024-09-21T02:58:49.228426+0000","last_became_active":"2024-09-21T02:58:15.040026+0000","last_became_peered":"2024-09-21T02:58:15.040026+0000","last_unstale":"2024-09-21T02:58:49.228426+0000","last_undegraded":"2024-09-21T02:58:49.228426+0000","last_fullsized":"2024-09-21T02:58:49.228426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.216541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.151538+0000","last_change":"2024-09-21T02:58:13.014816+0000","last_active":"2024-09-21T02:58:52.151538+0000","last_peered":"2024-09-21T02:58:52.151538+0000","last_clean":"2024-09-21T02:58:52.151538+0000","last_became_active":"2024-09-21T02:58:13.013918+0000","last_became_peered":"2024-09-21T02:58:13.013918+0000","last_unstale":"2024-09-21T02:58:52.151538+0000","last_undegraded":"2024-09-21T02:58:52.151538+0000","last_fullsized":"2024-09-21T02:58:52.151538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:20.892671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230777+0000","last_change":"2024-09-21T02:57:01.191389+0000","last_active":"2024-09-21T02:58:49.230777+0000","last_peered":"2024-09-21T02:58:49.230777+0000","last_clean":"2024-09-21T02:58:49.230777+0000","last_became_active":"2024-09-21T02:57:01.185686+0000","last_became_peered":"2024-09-21T02:57:01.185686+0000","last_unstale":"2024-09-21T02:58:49.230777+0000","last_undegraded":"2024-09-21T02:58:49.230777+0000","last_fullsized":"2024-09-21T02:58:49.230777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_clean_scrub_stamp":"2024-09-21T02:53:36.647024+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.275496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231134+0000","last_change":"2024-09-21T02:58:22.081891+0000","last_active":"2024-09-21T02:58:49.231134+0000","last_peered":"2024-09-21T02:58:49.231134+0000","last_clean":"2024-09-21T02:58:49.231134+0000","last_became_active":"2024-09-21T02:58:22.081435+0000","last_became_peered":"2024-09-21T02:58:22.081435+0000","last_unstale":"2024-09-21T02:58:49.231134+0000","last_undegraded":"2024-09-21T02:58:49.231134+0000","last_fullsized":"2024-09-21T02:58:49.231134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:51.161690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231223+0000","last_change":"2024-09-21T02:58:15.045013+0000","last_active":"2024-09-21T02:58:49.231223+0000","last_peered":"2024-09-21T02:58:49.231223+0000","last_clean":"2024-09-21T02:58:49.231223+0000","last_became_active":"2024-09-21T02:58:15.044650+0000","last_became_peered":"2024-09-21T02:58:15.044650+0000","last_unstale":"2024-09-21T02:58:49.231223+0000","last_undegraded":"2024-09-21T02:58:49.231223+0000","last_fullsized":"2024-09-21T02:58:49.231223+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:39.087982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153469+0000","last_change":"2024-09-21T02:58:13.553468+0000","last_active":"2024-09-21T02:58:51.153469+0000","last_peered":"2024-09-21T02:58:51.153469+0000","last_clean":"2024-09-21T02:58:51.153469+0000","last_became_active":"2024-09-21T02:58:13.552965+0000","last_became_peered":"2024-09-21T02:58:13.552965+0000","last_unstale":"2024-09-21T02:58:51.153469+0000","last_undegraded":"2024-09-21T02:58:51.153469+0000","last_fullsized":"2024-09-21T02:58:51.153469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:35.224581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227364+0000","last_change":"2024-09-21T02:58:22.086994+0000","last_active":"2024-09-21T02:58:49.227364+0000","last_peered":"2024-09-21T02:58:49.227364+0000","last_clean":"2024-09-21T02:58:49.227364+0000","last_became_active":"2024-09-21T02:58:22.086506+0000","last_became_peered":"2024-09-21T02:58:22.086506+0000","last_unstale":"2024-09-21T02:58:49.227364+0000","last_undegraded":"2024-09-21T02:58:49.227364+0000","last_fullsized":"2024-09-21T02:58:49.227364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:09.102495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230976+0000","last_change":"2024-09-21T02:58:15.040224+0000","last_active":"2024-09-21T02:58:49.230976+0000","last_peered":"2024-09-21T02:58:49.230976+0000","last_clean":"2024-09-21T02:58:49.230976+0000","last_became_active":"2024-09-21T02:58:15.039115+0000","last_became_peered":"2024-09-21T02:58:15.039115+0000","last_unstale":"2024-09-21T02:58:49.230976+0000","last_undegraded":"2024-09-21T02:58:49.230976+0000","last_fullsized":"2024-09-21T02:58:49.230976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:35.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748956+0000","last_change":"2024-09-21T02:58:13.021526+0000","last_active":"2024-09-21T02:58:49.748956+0000","last_peered":"2024-09-21T02:58:49.748956+0000","last_clean":"2024-09-21T02:58:49.748956+0000","last_became_active":"2024-09-21T02:58:13.020521+0000","last_became_peered":"2024-09-21T02:58:13.020521+0000","last_unstale":"2024-09-21T02:58:49.748956+0000","last_undegraded":"2024-09-21T02:58:49.748956+0000","last_fullsized":"2024-09-21T02:58:49.748956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:08.645141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980132+0000","last_change":"2024-09-21T02:58:22.077862+0000","last_active":"2024-09-21T02:58:49.980132+0000","last_peered":"2024-09-21T02:58:49.980132+0000","last_clean":"2024-09-21T02:58:49.980132+0000","last_became_active":"2024-09-21T02:58:22.077410+0000","last_became_peered":"2024-09-21T02:58:22.077410+0000","last_unstale":"2024-09-21T02:58:49.980132+0000","last_undegraded":"2024-09-21T02:58:49.980132+0000","last_fullsized":"2024-09-21T02:58:49.980132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:06.549842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231212+0000","last_change":"2024-09-21T02:58:15.037775+0000","last_active":"2024-09-21T02:58:49.231212+0000","last_peered":"2024-09-21T02:58:49.231212+0000","last_clean":"2024-09-21T02:58:49.231212+0000","last_became_active":"2024-09-21T02:58:15.037036+0000","last_became_peered":"2024-09-21T02:58:15.037036+0000","last_unstale":"2024-09-21T02:58:49.231212+0000","last_undegraded":"2024-09-21T02:58:49.231212+0000","last_fullsized":"2024-09-21T02:58:49.231212+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:58.289785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435249+0000","last_change":"2024-09-21T02:58:13.015046+0000","last_active":"2024-09-21T02:58:49.435249+0000","last_peered":"2024-09-21T02:58:49.435249+0000","last_clean":"2024-09-21T02:58:49.435249+0000","last_became_active":"2024-09-21T02:58:13.014643+0000","last_became_peered":"2024-09-21T02:58:13.014643+0000","last_unstale":"2024-09-21T02:58:49.435249+0000","last_undegraded":"2024-09-21T02:58:49.435249+0000","last_fullsized":"2024-09-21T02:58:49.435249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:54.913187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.747869+0000","last_change":"2024-09-21T02:58:22.085805+0000","last_active":"2024-09-21T02:58:49.747869+0000","last_peered":"2024-09-21T02:58:49.747869+0000","last_clean":"2024-09-21T02:58:49.747869+0000","last_became_active":"2024-09-21T02:58:22.084752+0000","last_became_peered":"2024-09-21T02:58:22.084752+0000","last_unstale":"2024-09-21T02:58:49.747869+0000","last_undegraded":"2024-09-21T02:58:49.747869+0000","last_fullsized":"2024-09-21T02:58:49.747869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:39.357089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227424+0000","last_change":"2024-09-21T02:58:15.046643+0000","last_active":"2024-09-21T02:58:49.227424+0000","last_peered":"2024-09-21T02:58:49.227424+0000","last_clean":"2024-09-21T02:58:49.227424+0000","last_became_active":"2024-09-21T02:58:15.046278+0000","last_became_peered":"2024-09-21T02:58:15.046278+0000","last_unstale":"2024-09-21T02:58:49.227424+0000","last_undegraded":"2024-09-21T02:58:49.227424+0000","last_fullsized":"2024-09-21T02:58:49.227424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.648084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.147510+0000","last_change":"2024-09-21T02:58:13.022176+0000","last_active":"2024-09-21T02:58:52.147510+0000","last_peered":"2024-09-21T02:58:52.147510+0000","last_clean":"2024-09-21T02:58:52.147510+0000","last_became_active":"2024-09-21T02:58:13.020122+0000","last_became_peered":"2024-09-21T02:58:13.020122+0000","last_unstale":"2024-09-21T02:58:52.147510+0000","last_undegraded":"2024-09-21T02:58:52.147510+0000","last_fullsized":"2024-09-21T02:58:52.147510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:12.346056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748354+0000","last_change":"2024-09-21T02:58:22.084221+0000","last_active":"2024-09-21T02:58:49.748354+0000","last_peered":"2024-09-21T02:58:49.748354+0000","last_clean":"2024-09-21T02:58:49.748354+0000","last_became_active":"2024-09-21T02:58:22.083793+0000","last_became_peered":"2024-09-21T02:58:22.083793+0000","last_unstale":"2024-09-21T02:58:49.748354+0000","last_undegraded":"2024-09-21T02:58:49.748354+0000","last_fullsized":"2024-09-21T02:58:49.748354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:13.043641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233959+0000","last_change":"2024-09-21T02:58:49.233440+0000","last_active":"2024-09-21T02:58:49.233959+0000","last_peered":"2024-09-21T02:58:49.233959+0000","last_clean":"2024-09-21T02:58:49.233959+0000","last_became_active":"2024-09-21T02:58:49.232996+0000","last_became_peered":"2024-09-21T02:58:49.232996+0000","last_unstale":"2024-09-21T02:58:49.233959+0000","last_undegraded":"2024-09-21T02:58:49.233959+0000","last_fullsized":"2024-09-21T02:58:49.233959+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:13.181861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.154616+0000","last_change":"2024-09-21T02:58:13.553866+0000","last_active":"2024-09-21T02:58:51.154616+0000","last_peered":"2024-09-21T02:58:51.154616+0000","last_clean":"2024-09-21T02:58:51.154616+0000","last_became_active":"2024-09-21T02:58:13.553001+0000","last_became_peered":"2024-09-21T02:58:13.553001+0000","last_unstale":"2024-09-21T02:58:51.154616+0000","last_undegraded":"2024-09-21T02:58:51.154616+0000","last_fullsized":"2024-09-21T02:58:51.154616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:43.995773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435231+0000","last_change":"2024-09-21T02:58:22.090253+0000","last_active":"2024-09-21T02:58:49.435231+0000","last_peered":"2024-09-21T02:58:49.435231+0000","last_clean":"2024-09-21T02:58:49.435231+0000","last_became_active":"2024-09-21T02:58:22.089818+0000","last_became_peered":"2024-09-21T02:58:22.089818+0000","last_unstale":"2024-09-21T02:58:49.435231+0000","last_undegraded":"2024-09-21T02:58:49.435231+0000","last_fullsized":"2024-09-21T02:58:49.435231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:09.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230280+0000","last_change":"2024-09-21T02:58:15.042479+0000","last_active":"2024-09-21T02:58:49.230280+0000","last_peered":"2024-09-21T02:58:49.230280+0000","last_clean":"2024-09-21T02:58:49.230280+0000","last_became_active":"2024-09-21T02:58:15.042087+0000","last_became_peered":"2024-09-21T02:58:15.042087+0000","last_unstale":"2024-09-21T02:58:49.230280+0000","last_undegraded":"2024-09-21T02:58:49.230280+0000","last_fullsized":"2024-09-21T02:58:49.230280+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.427736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:45.284796+0000","last_change":"2024-09-21T02:58:13.012559+0000","last_active":"2024-09-21T02:59:45.284796+0000","last_peered":"2024-09-21T02:59:45.284796+0000","last_clean":"2024-09-21T02:59:45.284796+0000","last_became_active":"2024-09-21T02:58:13.011062+0000","last_became_peered":"2024-09-21T02:58:13.011062+0000","last_unstale":"2024-09-21T02:59:45.284796+0000","last_undegraded":"2024-09-21T02:59:45.284796+0000","last_fullsized":"2024-09-21T02:59:45.284796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:17.839898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224241+0000","last_change":"2024-09-21T02:58:22.081196+0000","last_active":"2024-09-21T02:58:49.224241+0000","last_peered":"2024-09-21T02:58:49.224241+0000","last_clean":"2024-09-21T02:58:49.224241+0000","last_became_active":"2024-09-21T02:58:22.080787+0000","last_became_peered":"2024-09-21T02:58:22.080787+0000","last_unstale":"2024-09-21T02:58:49.224241+0000","last_undegraded":"2024-09-21T02:58:49.224241+0000","last_fullsized":"2024-09-21T02:58:49.224241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.283112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230702+0000","last_change":"2024-09-21T02:58:15.046322+0000","last_active":"2024-09-21T02:58:49.230702+0000","last_peered":"2024-09-21T02:58:49.230702+0000","last_clean":"2024-09-21T02:58:49.230702+0000","last_became_active":"2024-09-21T02:58:15.045936+0000","last_became_peered":"2024-09-21T02:58:15.045936+0000","last_unstale":"2024-09-21T02:58:49.230702+0000","last_undegraded":"2024-09-21T02:58:49.230702+0000","last_fullsized":"2024-09-21T02:58:49.230702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:08.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145891+0000","last_change":"2024-09-21T02:58:13.022277+0000","last_active":"2024-09-21T02:58:50.145891+0000","last_peered":"2024-09-21T02:58:50.145891+0000","last_clean":"2024-09-21T02:58:50.145891+0000","last_became_active":"2024-09-21T02:58:13.021901+0000","last_became_peered":"2024-09-21T02:58:13.021901+0000","last_unstale":"2024-09-21T02:58:50.145891+0000","last_undegraded":"2024-09-21T02:58:50.145891+0000","last_fullsized":"2024-09-21T02:58:50.145891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:01.029435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226991+0000","last_change":"2024-09-21T02:58:22.088951+0000","last_active":"2024-09-21T02:58:49.226991+0000","last_peered":"2024-09-21T02:58:49.226991+0000","last_clean":"2024-09-21T02:58:49.226991+0000","last_became_active":"2024-09-21T02:58:22.088427+0000","last_became_peered":"2024-09-21T02:58:22.088427+0000","last_unstale":"2024-09-21T02:58:49.226991+0000","last_undegraded":"2024-09-21T02:58:49.226991+0000","last_fullsized":"2024-09-21T02:58:49.226991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:52.700517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.434868+0000","last_change":"2024-09-21T02:58:15.038390+0000","last_active":"2024-09-21T02:58:49.434868+0000","last_peered":"2024-09-21T02:58:49.434868+0000","last_clean":"2024-09-21T02:58:49.434868+0000","last_became_active":"2024-09-21T02:58:15.037368+0000","last_became_peered":"2024-09-21T02:58:15.037368+0000","last_unstale":"2024-09-21T02:58:49.434868+0000","last_undegraded":"2024-09-21T02:58:49.434868+0000","last_fullsized":"2024-09-21T02:58:49.434868+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:54.736444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152969+0000","last_change":"2024-09-21T02:58:13.013246+0000","last_active":"2024-09-21T02:58:51.152969+0000","last_peered":"2024-09-21T02:58:51.152969+0000","last_clean":"2024-09-21T02:58:51.152969+0000","last_became_active":"2024-09-21T02:58:13.012830+0000","last_became_peered":"2024-09-21T02:58:13.012830+0000","last_unstale":"2024-09-21T02:58:51.152969+0000","last_undegraded":"2024-09-21T02:58:51.152969+0000","last_fullsized":"2024-09-21T02:58:51.152969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:31.406565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748517+0000","last_change":"2024-09-21T02:58:22.086799+0000","last_active":"2024-09-21T02:58:49.748517+0000","last_peered":"2024-09-21T02:58:49.748517+0000","last_clean":"2024-09-21T02:58:49.748517+0000","last_became_active":"2024-09-21T02:58:22.086395+0000","last_became_peered":"2024-09-21T02:58:22.086395+0000","last_unstale":"2024-09-21T02:58:49.748517+0000","last_undegraded":"2024-09-21T02:58:49.748517+0000","last_fullsized":"2024-09-21T02:58:49.748517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:38.985072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230971+0000","last_change":"2024-09-21T02:58:15.037346+0000","last_active":"2024-09-21T02:58:49.230971+0000","last_peered":"2024-09-21T02:58:49.230971+0000","last_clean":"2024-09-21T02:58:49.230971+0000","last_became_active":"2024-09-21T02:58:15.036984+0000","last_became_peered":"2024-09-21T02:58:15.036984+0000","last_unstale":"2024-09-21T02:58:49.230971+0000","last_undegraded":"2024-09-21T02:58:49.230971+0000","last_fullsized":"2024-09-21T02:58:49.230971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:43.856844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":184,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:45.251331+0000","last_change":"2024-09-21T02:58:13.018287+0000","last_active":"2024-09-21T02:59:45.251331+0000","last_peered":"2024-09-21T02:59:45.251331+0000","last_clean":"2024-09-21T02:59:45.251331+0000","last_became_active":"2024-09-21T02:58:13.017908+0000","last_became_peered":"2024-09-21T02:58:13.017908+0000","last_unstale":"2024-09-21T02:59:45.251331+0000","last_undegraded":"2024-09-21T02:59:45.251331+0000","last_fullsized":"2024-09-21T02:59:45.251331+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:30.422946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":124,"num_write":33,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223420+0000","last_change":"2024-09-21T02:58:22.078106+0000","last_active":"2024-09-21T02:58:49.223420+0000","last_peered":"2024-09-21T02:58:49.223420+0000","last_clean":"2024-09-21T02:58:49.223420+0000","last_became_active":"2024-09-21T02:58:22.077675+0000","last_became_peered":"2024-09-21T02:58:22.077675+0000","last_unstale":"2024-09-21T02:58:49.223420+0000","last_undegraded":"2024-09-21T02:58:49.223420+0000","last_fullsized":"2024-09-21T02:58:49.223420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:08.965865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228496+0000","last_change":"2024-09-21T02:58:15.045911+0000","last_active":"2024-09-21T02:58:49.228496+0000","last_peered":"2024-09-21T02:58:49.228496+0000","last_clean":"2024-09-21T02:58:49.228496+0000","last_became_active":"2024-09-21T02:58:15.045506+0000","last_became_peered":"2024-09-21T02:58:15.045506+0000","last_unstale":"2024-09-21T02:58:49.228496+0000","last_undegraded":"2024-09-21T02:58:49.228496+0000","last_fullsized":"2024-09-21T02:58:49.228496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.982730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.144087+0000","last_change":"2024-09-21T02:58:13.555132+0000","last_active":"2024-09-21T02:58:50.144087+0000","last_peered":"2024-09-21T02:58:50.144087+0000","last_clean":"2024-09-21T02:58:50.144087+0000","last_became_active":"2024-09-21T02:58:13.554582+0000","last_became_peered":"2024-09-21T02:58:13.554582+0000","last_unstale":"2024-09-21T02:58:50.144087+0000","last_undegraded":"2024-09-21T02:58:50.144087+0000","last_fullsized":"2024-09-21T02:58:50.144087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:56.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.234599+0000","last_change":"2024-09-21T02:58:49.234443+0000","last_active":"2024-09-21T02:58:49.234599+0000","last_peered":"2024-09-21T02:58:49.234599+0000","last_clean":"2024-09-21T02:58:49.234599+0000","last_became_active":"2024-09-21T02:58:49.233758+0000","last_became_peered":"2024-09-21T02:58:49.233758+0000","last_unstale":"2024-09-21T02:58:49.234599+0000","last_undegraded":"2024-09-21T02:58:49.234599+0000","last_fullsized":"2024-09-21T02:58:49.234599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:06.821726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980321+0000","last_change":"2024-09-21T02:58:15.033598+0000","last_active":"2024-09-21T02:58:49.980321+0000","last_peered":"2024-09-21T02:58:49.980321+0000","last_clean":"2024-09-21T02:58:49.980321+0000","last_became_active":"2024-09-21T02:58:15.033268+0000","last_became_peered":"2024-09-21T02:58:15.033268+0000","last_unstale":"2024-09-21T02:58:49.980321+0000","last_undegraded":"2024-09-21T02:58:49.980321+0000","last_fullsized":"2024-09-21T02:58:49.980321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:25.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145942+0000","last_change":"2024-09-21T02:58:13.018159+0000","last_active":"2024-09-21T02:58:50.145942+0000","last_peered":"2024-09-21T02:58:50.145942+0000","last_clean":"2024-09-21T02:58:50.145942+0000","last_became_active":"2024-09-21T02:58:13.017263+0000","last_became_peered":"2024-09-21T02:58:13.017263+0000","last_unstale":"2024-09-21T02:58:50.145942+0000","last_undegraded":"2024-09-21T02:58:50.145942+0000","last_fullsized":"2024-09-21T02:58:50.145942+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:47.981435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.982319+0000","last_change":"2024-09-21T02:58:49.981593+0000","last_active":"2024-09-21T02:58:49.982319+0000","last_peered":"2024-09-21T02:58:49.982319+0000","last_clean":"2024-09-21T02:58:49.982319+0000","last_became_active":"2024-09-21T02:58:49.980890+0000","last_became_peered":"2024-09-21T02:58:49.980890+0000","last_unstale":"2024-09-21T02:58:49.982319+0000","last_undegraded":"2024-09-21T02:58:49.982319+0000","last_fullsized":"2024-09-21T02:58:49.982319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:59.251327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229390+0000","last_change":"2024-09-21T02:58:15.049561+0000","last_active":"2024-09-21T02:58:49.229390+0000","last_peered":"2024-09-21T02:58:49.229390+0000","last_clean":"2024-09-21T02:58:49.229390+0000","last_became_active":"2024-09-21T02:58:15.049205+0000","last_became_peered":"2024-09-21T02:58:15.049205+0000","last_unstale":"2024-09-21T02:58:49.229390+0000","last_undegraded":"2024-09-21T02:58:49.229390+0000","last_fullsized":"2024-09-21T02:58:49.229390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:56.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:44.238615+0000","last_change":"2024-09-21T02:58:13.018964+0000","last_active":"2024-09-21T02:59:44.238615+0000","last_peered":"2024-09-21T02:59:44.238615+0000","last_clean":"2024-09-21T02:59:44.238615+0000","last_became_active":"2024-09-21T02:58:13.017420+0000","last_became_peered":"2024-09-21T02:58:13.017420+0000","last_unstale":"2024-09-21T02:59:44.238615+0000","last_undegraded":"2024-09-21T02:59:44.238615+0000","last_fullsized":"2024-09-21T02:59:44.238615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233600+0000","last_change":"2024-09-21T02:58:49.233486+0000","last_active":"2024-09-21T02:58:49.233600+0000","last_peered":"2024-09-21T02:58:49.233600+0000","last_clean":"2024-09-21T02:58:49.233600+0000","last_became_active":"2024-09-21T02:58:49.232940+0000","last_became_peered":"2024-09-21T02:58:49.232940+0000","last_unstale":"2024-09-21T02:58:49.233600+0000","last_undegraded":"2024-09-21T02:58:49.233600+0000","last_fullsized":"2024-09-21T02:58:49.233600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:19.283141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979738+0000","last_change":"2024-09-21T02:58:22.085163+0000","last_active":"2024-09-21T02:58:49.979738+0000","last_peered":"2024-09-21T02:58:49.979738+0000","last_clean":"2024-09-21T02:58:49.979738+0000","last_became_active":"2024-09-21T02:58:22.084768+0000","last_became_peered":"2024-09-21T02:58:22.084768+0000","last_unstale":"2024-09-21T02:58:49.979738+0000","last_undegraded":"2024-09-21T02:58:49.979738+0000","last_fullsized":"2024-09-21T02:58:49.979738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:46.892421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223405+0000","last_change":"2024-09-21T02:58:15.035051+0000","last_active":"2024-09-21T02:58:49.223405+0000","last_peered":"2024-09-21T02:58:49.223405+0000","last_clean":"2024-09-21T02:58:49.223405+0000","last_became_active":"2024-09-21T02:58:15.034692+0000","last_became_peered":"2024-09-21T02:58:15.034692+0000","last_unstale":"2024-09-21T02:58:49.223405+0000","last_undegraded":"2024-09-21T02:58:49.223405+0000","last_fullsized":"2024-09-21T02:58:49.223405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:14.605154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748786+0000","last_change":"2024-09-21T02:58:13.018102+0000","last_active":"2024-09-21T02:58:49.748786+0000","last_peered":"2024-09-21T02:58:49.748786+0000","last_clean":"2024-09-21T02:58:49.748786+0000","last_became_active":"2024-09-21T02:58:13.017537+0000","last_became_peered":"2024-09-21T02:58:13.017537+0000","last_unstale":"2024-09-21T02:58:49.748786+0000","last_undegraded":"2024-09-21T02:58:49.748786+0000","last_fullsized":"2024-09-21T02:58:49.748786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:40.096326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227422+0000","last_change":"2024-09-21T02:58:22.084362+0000","last_active":"2024-09-21T02:58:49.227422+0000","last_peered":"2024-09-21T02:58:49.227422+0000","last_clean":"2024-09-21T02:58:49.227422+0000","last_became_active":"2024-09-21T02:58:22.083895+0000","last_became_peered":"2024-09-21T02:58:22.083895+0000","last_unstale":"2024-09-21T02:58:49.227422+0000","last_undegraded":"2024-09-21T02:58:49.227422+0000","last_fullsized":"2024-09-21T02:58:49.227422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:54.101588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227989+0000","last_change":"2024-09-21T02:58:15.034768+0000","last_active":"2024-09-21T02:58:49.227989+0000","last_peered":"2024-09-21T02:58:49.227989+0000","last_clean":"2024-09-21T02:58:49.227989+0000","last_became_active":"2024-09-21T02:58:15.034420+0000","last_became_peered":"2024-09-21T02:58:15.034420+0000","last_unstale":"2024-09-21T02:58:49.227989+0000","last_undegraded":"2024-09-21T02:58:49.227989+0000","last_fullsized":"2024-09-21T02:58:49.227989+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:25.750158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152269+0000","last_change":"2024-09-21T02:58:13.015026+0000","last_active":"2024-09-21T02:58:51.152269+0000","last_peered":"2024-09-21T02:58:51.152269+0000","last_clean":"2024-09-21T02:58:51.152269+0000","last_became_active":"2024-09-21T02:58:13.014668+0000","last_became_peered":"2024-09-21T02:58:13.014668+0000","last_unstale":"2024-09-21T02:58:51.152269+0000","last_undegraded":"2024-09-21T02:58:51.152269+0000","last_fullsized":"2024-09-21T02:58:51.152269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:20.117518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153234+0000","last_change":"2024-09-21T02:58:13.018044+0000","last_active":"2024-09-21T02:58:51.153234+0000","last_peered":"2024-09-21T02:58:51.153234+0000","last_clean":"2024-09-21T02:58:51.153234+0000","last_became_active":"2024-09-21T02:58:13.017628+0000","last_became_peered":"2024-09-21T02:58:13.017628+0000","last_unstale":"2024-09-21T02:58:51.153234+0000","last_undegraded":"2024-09-21T02:58:51.153234+0000","last_fullsized":"2024-09-21T02:58:51.153234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:38.749379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748507+0000","last_change":"2024-09-21T02:58:15.048160+0000","last_active":"2024-09-21T02:58:49.748507+0000","last_peered":"2024-09-21T02:58:49.748507+0000","last_clean":"2024-09-21T02:58:49.748507+0000","last_became_active":"2024-09-21T02:58:15.046371+0000","last_became_peered":"2024-09-21T02:58:15.046371+0000","last_unstale":"2024-09-21T02:58:49.748507+0000","last_undegraded":"2024-09-21T02:58:49.748507+0000","last_fullsized":"2024-09-21T02:58:49.748507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:49.386799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224497+0000","last_change":"2024-09-21T02:58:22.089918+0000","last_active":"2024-09-21T02:58:49.224497+0000","last_peered":"2024-09-21T02:58:49.224497+0000","last_clean":"2024-09-21T02:58:49.224497+0000","last_became_active":"2024-09-21T02:58:22.089457+0000","last_became_peered":"2024-09-21T02:58:22.089457+0000","last_unstale":"2024-09-21T02:58:49.224497+0000","last_undegraded":"2024-09-21T02:58:49.224497+0000","last_fullsized":"2024-09-21T02:58:49.224497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:28.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:59:45.240912+0000","last_change":"2024-09-21T02:58:13.021192+0000","last_active":"2024-09-21T02:59:45.240912+0000","last_peered":"2024-09-21T02:59:45.240912+0000","last_clean":"2024-09-21T02:59:45.240912+0000","last_became_active":"2024-09-21T02:58:13.020746+0000","last_became_peered":"2024-09-21T02:58:13.020746+0000","last_unstale":"2024-09-21T02:59:45.240912+0000","last_undegraded":"2024-09-21T02:59:45.240912+0000","last_fullsized":"2024-09-21T02:59:45.240912+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:13.260225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230350+0000","last_change":"2024-09-21T02:58:15.038375+0000","last_active":"2024-09-21T02:58:49.230350+0000","last_peered":"2024-09-21T02:58:49.230350+0000","last_clean":"2024-09-21T02:58:49.230350+0000","last_became_active":"2024-09-21T02:58:15.038011+0000","last_became_peered":"2024-09-21T02:58:15.038011+0000","last_unstale":"2024-09-21T02:58:49.230350+0000","last_undegraded":"2024-09-21T02:58:49.230350+0000","last_fullsized":"2024-09-21T02:58:49.230350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:50.820554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224842+0000","last_change":"2024-09-21T02:58:22.088436+0000","last_active":"2024-09-21T02:58:49.224842+0000","last_peered":"2024-09-21T02:58:49.224842+0000","last_clean":"2024-09-21T02:58:49.224842+0000","last_became_active":"2024-09-21T02:58:22.087857+0000","last_became_peered":"2024-09-21T02:58:22.087857+0000","last_unstale":"2024-09-21T02:58:49.224842+0000","last_undegraded":"2024-09-21T02:58:49.224842+0000","last_fullsized":"2024-09-21T02:58:49.224842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:40.314833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226720+0000","last_change":"2024-09-21T02:58:15.041490+0000","last_active":"2024-09-21T02:58:49.226720+0000","last_peered":"2024-09-21T02:58:49.226720+0000","last_clean":"2024-09-21T02:58:49.226720+0000","last_became_active":"2024-09-21T02:58:15.041106+0000","last_became_peered":"2024-09-21T02:58:15.041106+0000","last_unstale":"2024-09-21T02:58:49.226720+0000","last_undegraded":"2024-09-21T02:58:49.226720+0000","last_fullsized":"2024-09-21T02:58:49.226720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:57.228254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224682+0000","last_change":"2024-09-21T02:58:15.041375+0000","last_active":"2024-09-21T02:58:49.224682+0000","last_peered":"2024-09-21T02:58:49.224682+0000","last_clean":"2024-09-21T02:58:49.224682+0000","last_became_active":"2024-09-21T02:58:15.041041+0000","last_became_peered":"2024-09-21T02:58:15.041041+0000","last_unstale":"2024-09-21T02:58:49.224682+0000","last_undegraded":"2024-09-21T02:58:49.224682+0000","last_fullsized":"2024-09-21T02:58:49.224682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:49.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224406+0000","last_change":"2024-09-21T02:58:15.036772+0000","last_active":"2024-09-21T02:58:49.224406+0000","last_peered":"2024-09-21T02:58:49.224406+0000","last_clean":"2024-09-21T02:58:49.224406+0000","last_became_active":"2024-09-21T02:58:15.036390+0000","last_became_peered":"2024-09-21T02:58:15.036390+0000","last_unstale":"2024-09-21T02:58:49.224406+0000","last_undegraded":"2024-09-21T02:58:49.224406+0000","last_fullsized":"2024-09-21T02:58:49.224406+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:49.169184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980239+0000","last_change":"2024-09-21T02:58:15.035375+0000","last_active":"2024-09-21T02:58:49.980239+0000","last_peered":"2024-09-21T02:58:49.980239+0000","last_clean":"2024-09-21T02:58:49.980239+0000","last_became_active":"2024-09-21T02:58:15.035015+0000","last_became_peered":"2024-09-21T02:58:15.035015+0000","last_unstale":"2024-09-21T02:58:49.980239+0000","last_undegraded":"2024-09-21T02:58:49.980239+0000","last_fullsized":"2024-09-21T02:58:49.980239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:32.980690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435193+0000","last_change":"2024-09-21T02:58:15.046431+0000","last_active":"2024-09-21T02:58:49.435193+0000","last_peered":"2024-09-21T02:58:49.435193+0000","last_clean":"2024-09-21T02:58:49.435193+0000","last_became_active":"2024-09-21T02:58:15.046048+0000","last_became_peered":"2024-09-21T02:58:15.046048+0000","last_unstale":"2024-09-21T02:58:49.435193+0000","last_undegraded":"2024-09-21T02:58:49.435193+0000","last_fullsized":"2024-09-21T02:58:49.435193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:42.079020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227633+0000","last_change":"2024-09-21T02:58:15.043192+0000","last_active":"2024-09-21T02:58:49.227633+0000","last_peered":"2024-09-21T02:58:49.227633+0000","last_clean":"2024-09-21T02:58:49.227633+0000","last_became_active":"2024-09-21T02:58:15.042413+0000","last_became_peered":"2024-09-21T02:58:15.042413+0000","last_unstale":"2024-09-21T02:58:49.227633+0000","last_undegraded":"2024-09-21T02:58:49.227633+0000","last_fullsized":"2024-09-21T02:58:49.227633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:31.491311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225245+0000","last_change":"2024-09-21T02:58:15.040194+0000","last_active":"2024-09-21T02:58:49.225245+0000","last_peered":"2024-09-21T02:58:49.225245+0000","last_clean":"2024-09-21T02:58:49.225245+0000","last_became_active":"2024-09-21T02:58:15.039803+0000","last_became_peered":"2024-09-21T02:58:15.039803+0000","last_unstale":"2024-09-21T02:58:49.225245+0000","last_undegraded":"2024-09-21T02:58:49.225245+0000","last_fullsized":"2024-09-21T02:58:49.225245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:21.357004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228974+0000","last_change":"2024-09-21T02:58:15.043038+0000","last_active":"2024-09-21T02:58:49.228974+0000","last_peered":"2024-09-21T02:58:49.228974+0000","last_clean":"2024-09-21T02:58:49.228974+0000","last_became_active":"2024-09-21T02:58:15.042643+0000","last_became_peered":"2024-09-21T02:58:15.042643+0000","last_unstale":"2024-09-21T02:58:49.228974+0000","last_undegraded":"2024-09-21T02:58:49.228974+0000","last_fullsized":"2024-09-21T02:58:49.228974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:14.639995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748116+0000","last_change":"2024-09-21T02:58:15.037015+0000","last_active":"2024-09-21T02:58:49.748116+0000","last_peered":"2024-09-21T02:58:49.748116+0000","last_clean":"2024-09-21T02:58:49.748116+0000","last_became_active":"2024-09-21T02:58:15.036628+0000","last_became_peered":"2024-09-21T02:58:15.036628+0000","last_unstale":"2024-09-21T02:58:49.748116+0000","last_undegraded":"2024-09-21T02:58:49.748116+0000","last_fullsized":"2024-09-21T02:58:49.748116+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:07.823178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.228334+0000","last_change":"2024-09-21T02:58:15.041768+0000","last_active":"2024-09-21T02:58:49.228334+0000","last_peered":"2024-09-21T02:58:49.228334+0000","last_clean":"2024-09-21T02:58:49.228334+0000","last_became_active":"2024-09-21T02:58:15.041374+0000","last_became_peered":"2024-09-21T02:58:15.041374+0000","last_unstale":"2024-09-21T02:58:49.228334+0000","last_undegraded":"2024-09-21T02:58:49.228334+0000","last_fullsized":"2024-09-21T02:58:49.228334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:25.145949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227754+0000","last_change":"2024-09-21T02:58:15.047263+0000","last_active":"2024-09-21T02:58:49.227754+0000","last_peered":"2024-09-21T02:58:49.227754+0000","last_clean":"2024-09-21T02:58:49.227754+0000","last_became_active":"2024-09-21T02:58:15.046490+0000","last_became_peered":"2024-09-21T02:58:15.046490+0000","last_unstale":"2024-09-21T02:58:49.227754+0000","last_undegraded":"2024-09-21T02:58:49.227754+0000","last_fullsized":"2024-09-21T02:58:49.227754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:45.413510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435084+0000","last_change":"2024-09-21T02:58:15.034115+0000","last_active":"2024-09-21T02:58:49.435084+0000","last_peered":"2024-09-21T02:58:49.435084+0000","last_clean":"2024-09-21T02:58:49.435084+0000","last_became_active":"2024-09-21T02:58:15.033709+0000","last_became_peered":"2024-09-21T02:58:15.033709+0000","last_unstale":"2024-09-21T02:58:49.435084+0000","last_undegraded":"2024-09-21T02:58:49.435084+0000","last_fullsized":"2024-09-21T02:58:49.435084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:54.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227143+0000","last_change":"2024-09-21T02:58:15.047154+0000","last_active":"2024-09-21T02:58:49.227143+0000","last_peered":"2024-09-21T02:58:49.227143+0000","last_clean":"2024-09-21T02:58:49.227143+0000","last_became_active":"2024-09-21T02:58:15.046777+0000","last_became_peered":"2024-09-21T02:58:15.046777+0000","last_unstale":"2024-09-21T02:58:49.227143+0000","last_undegraded":"2024-09-21T02:58:49.227143+0000","last_fullsized":"2024-09-21T02:58:49.227143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:56.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225136+0000","last_change":"2024-09-21T02:58:15.036867+0000","last_active":"2024-09-21T02:58:49.225136+0000","last_peered":"2024-09-21T02:58:49.225136+0000","last_clean":"2024-09-21T02:58:49.225136+0000","last_became_active":"2024-09-21T02:58:15.036228+0000","last_became_peered":"2024-09-21T02:58:15.036228+0000","last_unstale":"2024-09-21T02:58:49.225136+0000","last_undegraded":"2024-09-21T02:58:49.225136+0000","last_fullsized":"2024-09-21T02:58:49.225136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:11.245917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224017+0000","last_change":"2024-09-21T02:58:15.037311+0000","last_active":"2024-09-21T02:58:49.224017+0000","last_peered":"2024-09-21T02:58:49.224017+0000","last_clean":"2024-09-21T02:58:49.224017+0000","last_became_active":"2024-09-21T02:58:15.036909+0000","last_became_peered":"2024-09-21T02:58:15.036909+0000","last_unstale":"2024-09-21T02:58:49.224017+0000","last_undegraded":"2024-09-21T02:58:49.224017+0000","last_fullsized":"2024-09-21T02:58:49.224017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:35.250000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227739+0000","last_change":"2024-09-21T02:58:15.042678+0000","last_active":"2024-09-21T02:58:49.227739+0000","last_peered":"2024-09-21T02:58:49.227739+0000","last_clean":"2024-09-21T02:58:49.227739+0000","last_became_active":"2024-09-21T02:58:15.042334+0000","last_became_peered":"2024-09-21T02:58:15.042334+0000","last_unstale":"2024-09-21T02:58:49.227739+0000","last_undegraded":"2024-09-21T02:58:49.227739+0000","last_fullsized":"2024-09-21T02:58:49.227739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:09.302354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227472+0000","last_change":"2024-09-21T02:58:15.040741+0000","last_active":"2024-09-21T02:58:49.227472+0000","last_peered":"2024-09-21T02:58:49.227472+0000","last_clean":"2024-09-21T02:58:49.227472+0000","last_became_active":"2024-09-21T02:58:15.040357+0000","last_became_peered":"2024-09-21T02:58:15.040357+0000","last_unstale":"2024-09-21T02:58:49.227472+0000","last_undegraded":"2024-09-21T02:58:49.227472+0000","last_fullsized":"2024-09-21T02:58:49.227472+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979623+0000","last_change":"2024-09-21T02:58:15.029780+0000","last_active":"2024-09-21T02:58:49.979623+0000","last_peered":"2024-09-21T02:58:49.979623+0000","last_clean":"2024-09-21T02:58:49.979623+0000","last_became_active":"2024-09-21T02:58:15.029259+0000","last_became_peered":"2024-09-21T02:58:15.029259+0000","last_unstale":"2024-09-21T02:58:49.979623+0000","last_undegraded":"2024-09-21T02:58:49.979623+0000","last_fullsized":"2024-09-21T02:58:49.979623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:35.683337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979618+0000","last_change":"2024-09-21T02:58:15.040557+0000","last_active":"2024-09-21T02:58:49.979618+0000","last_peered":"2024-09-21T02:58:49.979618+0000","last_clean":"2024-09-21T02:58:49.979618+0000","last_became_active":"2024-09-21T02:58:15.040178+0000","last_became_peered":"2024-09-21T02:58:15.040178+0000","last_unstale":"2024-09-21T02:58:49.979618+0000","last_undegraded":"2024-09-21T02:58:49.979618+0000","last_fullsized":"2024-09-21T02:58:49.979618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:50.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435020+0000","last_change":"2024-09-21T02:58:15.041717+0000","last_active":"2024-09-21T02:58:49.435020+0000","last_peered":"2024-09-21T02:58:49.435020+0000","last_clean":"2024-09-21T02:58:49.435020+0000","last_became_active":"2024-09-21T02:58:15.041375+0000","last_became_peered":"2024-09-21T02:58:15.041375+0000","last_unstale":"2024-09-21T02:58:49.435020+0000","last_undegraded":"2024-09-21T02:58:49.435020+0000","last_fullsized":"2024-09-21T02:58:49.435020+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:22.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226572+0000","last_change":"2024-09-21T02:58:15.042001+0000","last_active":"2024-09-21T02:58:49.226572+0000","last_peered":"2024-09-21T02:58:49.226572+0000","last_clean":"2024-09-21T02:58:49.226572+0000","last_became_active":"2024-09-21T02:58:15.038585+0000","last_became_peered":"2024-09-21T02:58:15.038585+0000","last_unstale":"2024-09-21T02:58:49.226572+0000","last_undegraded":"2024-09-21T02:58:49.226572+0000","last_fullsized":"2024-09-21T02:58:49.226572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231199+0000","last_change":"2024-09-21T02:58:15.046636+0000","last_active":"2024-09-21T02:58:49.231199+0000","last_peered":"2024-09-21T02:58:49.231199+0000","last_clean":"2024-09-21T02:58:49.231199+0000","last_became_active":"2024-09-21T02:58:15.046103+0000","last_became_peered":"2024-09-21T02:58:15.046103+0000","last_unstale":"2024-09-21T02:58:49.231199+0000","last_undegraded":"2024-09-21T02:58:49.231199+0000","last_fullsized":"2024-09-21T02:58:49.231199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.579641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225214+0000","last_change":"2024-09-21T02:58:15.045461+0000","last_active":"2024-09-21T02:58:49.225214+0000","last_peered":"2024-09-21T02:58:49.225214+0000","last_clean":"2024-09-21T02:58:49.225214+0000","last_became_active":"2024-09-21T02:58:15.045091+0000","last_became_peered":"2024-09-21T02:58:15.045091+0000","last_unstale":"2024-09-21T02:58:49.225214+0000","last_undegraded":"2024-09-21T02:58:49.225214+0000","last_fullsized":"2024-09-21T02:58:49.225214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:33.078860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.229199+0000","last_change":"2024-09-21T02:58:15.042454+0000","last_active":"2024-09-21T02:58:49.229199+0000","last_peered":"2024-09-21T02:58:49.229199+0000","last_clean":"2024-09-21T02:58:49.229199+0000","last_became_active":"2024-09-21T02:58:15.042071+0000","last_became_peered":"2024-09-21T02:58:15.042071+0000","last_unstale":"2024-09-21T02:58:49.229199+0000","last_undegraded":"2024-09-21T02:58:49.229199+0000","last_fullsized":"2024-09-21T02:58:49.229199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:09.798110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227985+0000","last_change":"2024-09-21T02:58:15.039238+0000","last_active":"2024-09-21T02:58:49.227985+0000","last_peered":"2024-09-21T02:58:49.227985+0000","last_clean":"2024-09-21T02:58:49.227985+0000","last_became_active":"2024-09-21T02:58:15.037883+0000","last_became_peered":"2024-09-21T02:58:15.037883+0000","last_unstale":"2024-09-21T02:58:49.227985+0000","last_undegraded":"2024-09-21T02:58:49.227985+0000","last_fullsized":"2024-09-21T02:58:49.227985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:13.418696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230871+0000","last_change":"2024-09-21T02:58:15.040236+0000","last_active":"2024-09-21T02:58:49.230871+0000","last_peered":"2024-09-21T02:58:49.230871+0000","last_clean":"2024-09-21T02:58:49.230871+0000","last_became_active":"2024-09-21T02:58:15.039895+0000","last_became_peered":"2024-09-21T02:58:15.039895+0000","last_unstale":"2024-09-21T02:58:49.230871+0000","last_undegraded":"2024-09-21T02:58:49.230871+0000","last_fullsized":"2024-09-21T02:58:49.230871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:48.099127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224435+0000","last_change":"2024-09-21T02:58:15.044804+0000","last_active":"2024-09-21T02:58:49.224435+0000","last_peered":"2024-09-21T02:58:49.224435+0000","last_clean":"2024-09-21T02:58:49.224435+0000","last_became_active":"2024-09-21T02:58:15.044446+0000","last_became_peered":"2024-09-21T02:58:15.044446+0000","last_unstale":"2024-09-21T02:58:49.224435+0000","last_undegraded":"2024-09-21T02:58:49.224435+0000","last_fullsized":"2024-09-21T02:58:49.224435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:37.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230509+0000","last_change":"2024-09-21T02:58:15.034219+0000","last_active":"2024-09-21T02:58:49.230509+0000","last_peered":"2024-09-21T02:58:49.230509+0000","last_clean":"2024-09-21T02:58:49.230509+0000","last_became_active":"2024-09-21T02:58:15.033775+0000","last_became_peered":"2024-09-21T02:58:15.033775+0000","last_unstale":"2024-09-21T02:58:49.230509+0000","last_undegraded":"2024-09-21T02:58:49.230509+0000","last_fullsized":"2024-09-21T02:58:49.230509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:12.534737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.231688+0000","last_change":"2024-09-21T02:58:49.231259+0000","last_active":"2024-09-21T02:58:49.231688+0000","last_peered":"2024-09-21T02:58:49.231688+0000","last_clean":"2024-09-21T02:58:49.231688+0000","last_became_active":"2024-09-21T02:58:49.230867+0000","last_became_peered":"2024-09-21T02:58:49.230867+0000","last_unstale":"2024-09-21T02:58:49.231688+0000","last_undegraded":"2024-09-21T02:58:49.231688+0000","last_fullsized":"2024-09-21T02:58:49.231688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:11.163458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979870+0000","last_change":"2024-09-21T02:58:15.037273+0000","last_active":"2024-09-21T02:58:49.979870+0000","last_peered":"2024-09-21T02:58:49.979870+0000","last_clean":"2024-09-21T02:58:49.979870+0000","last_became_active":"2024-09-21T02:58:15.036879+0000","last_became_peered":"2024-09-21T02:58:15.036879+0000","last_unstale":"2024-09-21T02:58:49.979870+0000","last_undegraded":"2024-09-21T02:58:49.979870+0000","last_fullsized":"2024-09-21T02:58:49.979870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:50.721998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980003+0000","last_change":"2024-09-21T02:58:15.035716+0000","last_active":"2024-09-21T02:58:49.980003+0000","last_peered":"2024-09-21T02:58:49.980003+0000","last_clean":"2024-09-21T02:58:49.980003+0000","last_became_active":"2024-09-21T02:58:15.035356+0000","last_became_peered":"2024-09-21T02:58:15.035356+0000","last_unstale":"2024-09-21T02:58:49.980003+0000","last_undegraded":"2024-09-21T02:58:49.980003+0000","last_fullsized":"2024-09-21T02:58:49.980003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227675+0000","last_change":"2024-09-21T02:58:15.041737+0000","last_active":"2024-09-21T02:58:49.227675+0000","last_peered":"2024-09-21T02:58:49.227675+0000","last_clean":"2024-09-21T02:58:49.227675+0000","last_became_active":"2024-09-21T02:58:15.041387+0000","last_became_peered":"2024-09-21T02:58:15.041387+0000","last_unstale":"2024-09-21T02:58:49.227675+0000","last_undegraded":"2024-09-21T02:58:49.227675+0000","last_fullsized":"2024-09-21T02:58:49.227675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.893510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70213,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":357,"num_read_kb":254,"num_write":168,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":210639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281500,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":462290,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972389,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":1116161,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135915,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":466622,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332144,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":462446,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1058355,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659194,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":892928,"data_stored":457702,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":1053552,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":462743,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":457896,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":525174,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":523824,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":459090,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:59:51.655 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:59:51.656 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T02:59:51.656 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T02:59:51.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T02:59:51.903 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:52.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:52 smithi081 ceph-mon[30991]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:52.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:52 smithi164 ceph-mon[34236]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:52.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.446+0000 7f41545fe640 1 -- 172.21.15.81:0/2357225231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c102a80 msgr2=0x7f414c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:52.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 --2- 172.21.15.81:0/2357225231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c102a80 0x7f414c102e90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4148009900 tx=0x7f414802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:52.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 -- 172.21.15.81:0/2357225231 shutdown_connections 2024-09-21T02:59:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 --2- 172.21.15.81:0/2357225231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f414c108d10 0x7f414c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 --2- 172.21.15.81:0/2357225231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414c1083c0 0x7f414c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 --2- 172.21.15.81:0/2357225231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c102a80 0x7f414c102e90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 -- 172.21.15.81:0/2357225231 >> 172.21.15.81:0/2357225231 conn(0x7f414c079740 msgr2=0x7f414c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 -- 172.21.15.81:0/2357225231 shutdown_connections 2024-09-21T02:59:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 -- 172.21.15.81:0/2357225231 wait complete. 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 Processor -- start 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.447+0000 7f41545fe640 1 -- start start 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f41545fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f414c102a80 0x7f414c19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f41545fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414c1083c0 0x7f414c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f41545fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c108d10 0x7f414c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f41545fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f414c112910 con 0x7f414c108d10 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f41545fe640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f414c112790 con 0x7f414c1083c0 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f41545fe640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f414c112a90 con 0x7f414c102a80 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c108d10 0x7f414c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c108d10 0x7f414c19bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55628/0 (socket says 172.21.15.81:55628) 2024-09-21T02:59:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 -- 172.21.15.81:0/1813245186 learned_addr learned my addr 172.21.15.81:0/1813245186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f415239a640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f414c102a80 0x7f414c19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4151b99640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414c1083c0 0x7f414c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 -- 172.21.15.81:0/1813245186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f414c102a80 msgr2=0x7f414c19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f414c102a80 0x7f414c19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 -- 172.21.15.81:0/1813245186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414c1083c0 msgr2=0x7f414c19b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414c1083c0 0x7f414c19b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4152b9b640 1 -- 172.21.15.81:0/1813245186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c1a65d0 con 0x7f414c108d10 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.448+0000 7f4151b99640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414c1083c0 0x7f414c19b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.449+0000 7f4152b9b640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c108d10 0x7f414c19bdc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f414400b970 tx=0x7f414400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.449+0000 7f41437fe640 1 -- 172.21.15.81:0/1813245186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4144019070 con 0x7f414c108d10 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.449+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c1a68c0 con 0x7f414c108d10 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.449+0000 7f41437fe640 1 -- 172.21.15.81:0/1813245186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4144014440 con 0x7f414c108d10 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.449+0000 7f41437fe640 1 -- 172.21.15.81:0/1813245186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41440075d0 con 0x7f414c108d10 2024-09-21T02:59:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.449+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c1a6ed0 con 0x7f414c108d10 2024-09-21T02:59:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.450+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414c103d00 con 0x7f414c108d10 2024-09-21T02:59:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.451+0000 7f41437fe640 1 -- 172.21.15.81:0/1813245186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f414401c070 con 0x7f414c108d10 2024-09-21T02:59:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.452+0000 7f41437fe640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41380b65d0 0x7f41380b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.452+0000 7f415239a640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41380b65d0 0x7f41380b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:52.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.452+0000 7f41437fe640 1 -- 172.21.15.81:0/1813245186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f41440e70e0 con 0x7f414c108d10 2024-09-21T02:59:52.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.453+0000 7f415239a640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41380b65d0 0x7f41380b8ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f414c06c6a0 tx=0x7f41480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:52.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.455+0000 7f41437fe640 1 -- 172.21.15.81:0/1813245186 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41440b18b0 con 0x7f414c108d10 2024-09-21T02:59:52.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:52 smithi181 ceph-mon[34096]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:59:52.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.668+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f414c102f10 con 0x7f414c108d10 2024-09-21T02:59:52.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.669+0000 7f41437fe640 1 -- 172.21.15.81:0/1813245186 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f41440b67f0 con 0x7f414c108d10 2024-09-21T02:59:52.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:52.671 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41380b65d0 msgr2=0x7f41380b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41380b65d0 0x7f41380b8ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f414c06c6a0 tx=0x7f41480058d0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c108d10 msgr2=0x7f414c19bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c108d10 0x7f414c19bdc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f414400b970 tx=0x7f414400be30 comp rx=0 tx=0).stop 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 shutdown_connections 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41380b65d0 0x7f41380b8ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414c108d10 0x7f414c19bdc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f414c1083c0 0x7f414c19b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 --2- 172.21.15.81:0/1813245186 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f414c102a80 0x7f414c19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 >> 172.21.15.81:0/1813245186 conn(0x7f414c079740 msgr2=0x7f414c101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 shutdown_connections 2024-09-21T02:59:52.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:52.672+0000 7f41545fe640 1 -- 172.21.15.81:0/1813245186 wait complete. 2024-09-21T02:59:53.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:53 smithi164 ceph-mon[34236]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T02:59:53.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:53 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1813245186' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:59:53.483 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:53 smithi081 ceph-mon[30991]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T02:59:53.484 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:53 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1813245186' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:59:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:53 smithi181 ceph-mon[34096]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T02:59:53.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:53 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1813245186' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:59:53.511 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T02:59:53.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:59:53.758 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 -- 172.21.15.81:0/2755364067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf84102a60 msgr2=0x7faf84102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 --2- 172.21.15.81:0/2755364067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf84102a60 0x7faf84102e70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf74009900 tx=0x7faf7402a410 comp rx=0 tx=0).stop 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 -- 172.21.15.81:0/2755364067 shutdown_connections 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 --2- 172.21.15.81:0/2755364067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf841083a0 0x7faf841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 --2- 172.21.15.81:0/2755364067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf84108cf0 0x7faf8410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 --2- 172.21.15.81:0/2755364067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf84102a60 0x7faf84102e70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 -- 172.21.15.81:0/2755364067 >> 172.21.15.81:0/2755364067 conn(0x7faf84079730 msgr2=0x7faf84079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 -- 172.21.15.81:0/2755364067 shutdown_connections 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.251+0000 7faf89c6c640 1 -- 172.21.15.81:0/2755364067 wait complete. 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 Processor -- start 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 -- start start 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf84102a60 0x7faf8419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf841083a0 0x7faf8419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf84108cf0 0x7faf8419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf84113930 con 0x7faf841083a0 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faf841137b0 con 0x7faf84102a60 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf89c6c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7faf84113ab0 con 0x7faf84108cf0 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf841083a0 0x7faf8419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf841083a0 0x7faf8419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55644/0 (socket says 172.21.15.81:55644) 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.252+0000 7faf7bfff640 1 -- 172.21.15.81:0/737308777 learned_addr learned my addr 172.21.15.81:0/737308777 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf837fe640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf84102a60 0x7faf8419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf7bfff640 1 -- 172.21.15.81:0/737308777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf84108cf0 msgr2=0x7faf8419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf7bfff640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf84108cf0 0x7faf8419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf7bfff640 1 -- 172.21.15.81:0/737308777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf84102a60 msgr2=0x7faf8419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf7bfff640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf84102a60 0x7faf8419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf7bfff640 1 -- 172.21.15.81:0/737308777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf841a0310 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf7bfff640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf841083a0 0x7faf8419a940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00d740 tx=0x7faf6c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf817fa640 1 -- 172.21.15.81:0/737308777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c017070 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf817fa640 1 -- 172.21.15.81:0/737308777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf6c00de50 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf841a0600 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf817fa640 1 -- 172.21.15.81:0/737308777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c004c60 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.253+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf841a6d60 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.254+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf84102e70 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.256+0000 7faf817fa640 1 -- 172.21.15.81:0/737308777 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7faf6c004e00 con 0x7faf841083a0 2024-09-21T02:59:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.256+0000 7faf817fa640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7faf700b65a0 0x7faf700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.257+0000 7faf837fe640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7faf700b65a0 0x7faf700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.257+0000 7faf817fa640 1 -- 172.21.15.81:0/737308777 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7faf6c0e7650 con 0x7faf841083a0 2024-09-21T02:59:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.257+0000 7faf837fe640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7faf700b65a0 0x7faf700b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf74005f70 tx=0x7faf74000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.260+0000 7faf817fa640 1 -- 172.21.15.81:0/737308777 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf6c0ada40 con 0x7faf841083a0 2024-09-21T02:59:54.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.474+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf8419b4d0 con 0x7faf841083a0 2024-09-21T02:59:54.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.475+0000 7faf817fa640 1 -- 172.21.15.81:0/737308777 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7faf8419b4d0 con 0x7faf841083a0 2024-09-21T02:59:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:54.479 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-21T02:58:54:243506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:53.899125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T02:59:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-21T02:59:54.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7faf700b65a0 msgr2=0x7faf700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7faf700b65a0 0x7faf700b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf74005f70 tx=0x7faf74000bc0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf841083a0 msgr2=0x7faf8419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf841083a0 0x7faf8419a940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00d740 tx=0x7faf6c00dc00 comp rx=0 tx=0).stop 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 shutdown_connections 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7faf700b65a0 0x7faf700b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faf84108cf0 0x7faf8419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf841083a0 0x7faf8419a940 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 --2- 172.21.15.81:0/737308777 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf84102a60 0x7faf8419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:54.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 >> 172.21.15.81:0/737308777 conn(0x7faf84079730 msgr2=0x7faf84101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:54.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 shutdown_connections 2024-09-21T02:59:54.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:54.477+0000 7faf89c6c640 1 -- 172.21.15.81:0/737308777 wait complete. 2024-09-21T02:59:55.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:59:55.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:55 smithi081 ceph-mon[30991]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:55.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:55 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/737308777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:55.408 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:55.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:55 smithi164 ceph-mon[34236]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:55.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:55 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/737308777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:55.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:55 smithi181 ceph-mon[34096]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:59:55.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:55 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/737308777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/3847998988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d441094a0 msgr2=0x7f7d441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/3847998988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d441094a0 0x7f7d441098b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009900 tx=0x7f7d3802a410 comp rx=0 tx=0).stop 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/3847998988 shutdown_connections 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/3847998988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d44109df0 0x7f7d44110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/3847998988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d441094a0 0x7f7d441098b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/3847998988 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d44103b60 0x7f7d44103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/3847998988 >> 172.21.15.81:0/3847998988 conn(0x7f7d4407b850 msgr2=0x7f7d4407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/3847998988 shutdown_connections 2024-09-21T02:59:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.986+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/3847998988 wait complete. 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 Processor -- start 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 -- start start 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d44103b60 0x7f7d4419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d441094a0 0x7f7d4419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d44109df0 0x7f7d4419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d44113960 con 0x7f7d44109df0 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7d441137e0 con 0x7f7d441094a0 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d4a4ab640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7d44113ae0 con 0x7f7d44103b60 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d48a48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d44109df0 0x7f7d4419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d48a48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d44109df0 0x7f7d4419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55666/0 (socket says 172.21.15.81:55666) 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d48a48640 1 -- 172.21.15.81:0/1765753953 learned_addr learned my addr 172.21.15.81:0/1765753953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.987+0000 7f7d43fff640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d44103b60 0x7f7d4419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d437fe640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d441094a0 0x7f7d4419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d48a48640 1 -- 172.21.15.81:0/1765753953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d44103b60 msgr2=0x7f7d4419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d48a48640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d44103b60 0x7f7d4419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d48a48640 1 -- 172.21.15.81:0/1765753953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d441094a0 msgr2=0x7f7d4419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d48a48640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d441094a0 0x7f7d4419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d48a48640 1 -- 172.21.15.81:0/1765753953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d441a03a0 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d48a48640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d44109df0 0x7f7d4419fc70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009fd0 tx=0x7f7d3c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d417fa640 1 -- 172.21.15.81:0/1765753953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c017070 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d441a0690 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d441a6df0 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d417fa640 1 -- 172.21.15.81:0/1765753953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d3c003e00 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.988+0000 7f7d417fa640 1 -- 172.21.15.81:0/1765753953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c010460 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.989+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d44104de0 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.991+0000 7f7d417fa640 1 -- 172.21.15.81:0/1765753953 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7d3c003970 con 0x7f7d44109df0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.991+0000 7f7d417fa640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7d2c0b65a0 0x7f7d2c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.991+0000 7f7d43fff640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7d2c0b65a0 0x7f7d2c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.991+0000 7f7d417fa640 1 -- 172.21.15.81:0/1765753953 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f7d3c0e78a0 con 0x7f7d44109df0 2024-09-21T02:59:56.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.992+0000 7f7d43fff640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7d2c0b65a0 0x7f7d2c0b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d34005d00 tx=0x7f7d3400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:56.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:55.994+0000 7f7d417fa640 1 -- 172.21.15.81:0/1765753953 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d3c0adc90 con 0x7f7d44109df0 2024-09-21T02:59:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.208+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d4410bbc0 con 0x7f7d44109df0 2024-09-21T02:59:56.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.209+0000 7f7d417fa640 1 -- 172.21.15.81:0/1765753953 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7f7d3c0b2070 con 0x7f7d44109df0 2024-09-21T02:59:56.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:56.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-21T02:58:54:243506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:53.899125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T02:59:56.211 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7d2c0b65a0 msgr2=0x7f7d2c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7d2c0b65a0 0x7f7d2c0b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d34005d00 tx=0x7f7d3400b410 comp rx=0 tx=0).stop 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d44109df0 msgr2=0x7f7d4419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d44109df0 0x7f7d4419fc70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009fd0 tx=0x7f7d3c00b260 comp rx=0 tx=0).stop 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 shutdown_connections 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7d2c0b65a0 0x7f7d2c0b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d44109df0 0x7f7d4419fc70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d441094a0 0x7f7d4419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.211+0000 7f7d4a4ab640 1 --2- 172.21.15.81:0/1765753953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7d44103b60 0x7f7d4419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:56.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.212+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 >> 172.21.15.81:0/1765753953 conn(0x7f7d4407b850 msgr2=0x7f7d441055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:56.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.212+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 shutdown_connections 2024-09-21T02:59:56.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:56.212+0000 7f7d4a4ab640 1 -- 172.21.15.81:0/1765753953 wait complete. 2024-09-21T02:59:56.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:59:57.147 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:57.435 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:57 smithi081 ceph-mon[30991]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:57.436 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:57 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1765753953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:57.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:57 smithi181 ceph-mon[34096]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:57.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:57 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1765753953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:57.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:57 smithi164 ceph-mon[34236]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T02:59:57.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:57 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1765753953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:59:57.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 -- 172.21.15.81:0/4131443219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a0109df0 msgr2=0x7f37a0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 --2- 172.21.15.81:0/4131443219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a0109df0 0x7f37a0110620 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3798009ca0 tx=0x7f379802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 -- 172.21.15.81:0/4131443219 shutdown_connections 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 --2- 172.21.15.81:0/4131443219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a0109df0 0x7f37a0110620 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 --2- 172.21.15.81:0/4131443219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37a01094a0 0x7f37a01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 --2- 172.21.15.81:0/4131443219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37a0103b60 0x7f37a0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 -- 172.21.15.81:0/4131443219 >> 172.21.15.81:0/4131443219 conn(0x7f37a007b850 msgr2=0x7f37a007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 -- 172.21.15.81:0/4131443219 shutdown_connections 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.662+0000 7f37a50bc640 1 -- 172.21.15.81:0/4131443219 wait complete. 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.663+0000 7f37a50bc640 1 Processor -- start 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f37a50bc640 1 -- start start 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f37a50bc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37a0103b60 0x7f37a019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:57.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f37a50bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a01094a0 0x7f37a019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f37a50bc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37a0109df0 0x7f37a019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f37a50bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37a01139b0 con 0x7f37a01094a0 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f37a50bc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f37a0113830 con 0x7f37a0103b60 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f37a50bc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f37a0113b30 con 0x7f37a0109df0 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a01094a0 0x7f37a019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a01094a0 0x7f37a019a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55680/0 (socket says 172.21.15.81:55680) 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 -- 172.21.15.81:0/716707569 learned_addr learned my addr 172.21.15.81:0/716707569 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379ed9d640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37a0103b60 0x7f37a019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379f59e640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37a0109df0 0x7f37a019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 -- 172.21.15.81:0/716707569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37a0109df0 msgr2=0x7f37a019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37a0109df0 0x7f37a019fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 -- 172.21.15.81:0/716707569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37a0103b60 msgr2=0x7f37a019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:57.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37a0103b60 0x7f37a019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.664+0000 7f379e59c640 1 -- 172.21.15.81:0/716707569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a01a02d0 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.665+0000 7f379e59c640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a01094a0 0x7f37a019a900 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f379400d740 tx=0x7f379400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.665+0000 7f3787fff640 1 -- 172.21.15.81:0/716707569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3794017070 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.665+0000 7f3787fff640 1 -- 172.21.15.81:0/716707569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f379400de50 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.665+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a01a05c0 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.665+0000 7f3787fff640 1 -- 172.21.15.81:0/716707569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379400f620 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.665+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a01a6d20 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.666+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a0103f70 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.667+0000 7f3787fff640 1 -- 172.21.15.81:0/716707569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f379401a070 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.668+0000 7f3787fff640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f37880b65a0 0x7f37880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.668+0000 7f379ed9d640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f37880b65a0 0x7f37880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.668+0000 7f3787fff640 1 -- 172.21.15.81:0/716707569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f37940e71d0 con 0x7f37a01094a0 2024-09-21T02:59:57.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.669+0000 7f379ed9d640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f37880b65a0 0x7f37880b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3790005fd0 tx=0x7f379000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:57.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.671+0000 7f3787fff640 1 -- 172.21.15.81:0/716707569 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37940ad5c0 con 0x7f37a01094a0 2024-09-21T02:59:57.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.852+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37a019b490 con 0x7f37a01094a0 2024-09-21T02:59:57.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.854+0000 7f3787fff640 1 -- 172.21.15.81:0/716707569 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7f37a019b490 con 0x7f37a01094a0 2024-09-21T02:59:57.856 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:59:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f37880b65a0 msgr2=0x7f37880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f37880b65a0 0x7f37880b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3790005fd0 tx=0x7f379000b390 comp rx=0 tx=0).stop 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a01094a0 msgr2=0x7f37a019a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a01094a0 0x7f37a019a900 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f379400d740 tx=0x7f379400dc00 comp rx=0 tx=0).stop 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 shutdown_connections 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f37880b65a0 0x7f37880b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f37a0109df0 0x7f37a019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37a01094a0 0x7f37a019a900 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 --2- 172.21.15.81:0/716707569 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37a0103b60 0x7f37a019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 >> 172.21.15.81:0/716707569 conn(0x7f37a007b850 msgr2=0x7f37a01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 shutdown_connections 2024-09-21T02:59:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:57.856+0000 7f37a50bc640 1 -- 172.21.15.81:0/716707569 wait complete. 2024-09-21T02:59:58.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:58 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/716707569' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:58.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:58 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/716707569' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:58.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:59:58.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:58 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/716707569' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:59:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:59:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.299+0000 7f269ed29640 1 -- 172.21.15.81:0/304168946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2698109df0 msgr2=0x7f2698110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.299+0000 7f269ed29640 1 --2- 172.21.15.81:0/304168946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2698109df0 0x7f2698110620 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2690009ca0 tx=0x7f269002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.299+0000 7f269ed29640 1 -- 172.21.15.81:0/304168946 shutdown_connections 2024-09-21T02:59:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.299+0000 7f269ed29640 1 --2- 172.21.15.81:0/304168946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2698109df0 0x7f2698110620 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.299+0000 7f269ed29640 1 --2- 172.21.15.81:0/304168946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26981094a0 0x7f26981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.299+0000 7f269ed29640 1 --2- 172.21.15.81:0/304168946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2698103b60 0x7f2698103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.299+0000 7f269ed29640 1 -- 172.21.15.81:0/304168946 >> 172.21.15.81:0/304168946 conn(0x7f269807b850 msgr2=0x7f269807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.300+0000 7f269ed29640 1 -- 172.21.15.81:0/304168946 shutdown_connections 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.300+0000 7f269ed29640 1 -- 172.21.15.81:0/304168946 wait complete. 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.300+0000 7f269ed29640 1 Processor -- start 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.300+0000 7f269ed29640 1 -- start start 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.300+0000 7f269ed29640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2698103b60 0x7f269819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269ed29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26981094a0 0x7f269819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269ed29640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2698109df0 0x7f269819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269ed29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26981139b0 con 0x7f26981094a0 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269ed29640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2698113830 con 0x7f2698109df0 2024-09-21T02:59:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269ed29640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2698113b30 con 0x7f2698103b60 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26981094a0 0x7f269819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26981094a0 0x7f269819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55706/0 (socket says 172.21.15.81:55706) 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 -- 172.21.15.81:0/1955115787 learned_addr learned my addr 172.21.15.81:0/1955115787 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269cac5640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2698103b60 0x7f269819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269d2c6640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2698109df0 0x7f269819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 -- 172.21.15.81:0/1955115787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2698103b60 msgr2=0x7f269819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2698103b60 0x7f269819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 -- 172.21.15.81:0/1955115787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2698109df0 msgr2=0x7f269819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2698109df0 0x7f269819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 -- 172.21.15.81:0/1955115787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26981a0430 con 0x7f26981094a0 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269d2c6640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2698109df0 0x7f269819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:59:59.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2697fff640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26981094a0 0x7f269819aa60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f268000d740 tx=0x7f268000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2695ffb640 1 -- 172.21.15.81:0/1955115787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680017070 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2695ffb640 1 -- 172.21.15.81:0/1955115787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f268000de50 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26981a0720 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.301+0000 7f2695ffb640 1 -- 172.21.15.81:0/1955115787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268000f620 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.302+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26981a6e80 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.303+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2698103f70 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.304+0000 7f2695ffb640 1 -- 172.21.15.81:0/1955115787 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f268001a070 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.305+0000 7f2695ffb640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26840b6620 0x7f26840b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.306+0000 7f269cac5640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26840b6620 0x7f26840b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.306+0000 7f2695ffb640 1 -- 172.21.15.81:0/1955115787 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f26800e70f0 con 0x7f26981094a0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.306+0000 7f269cac5640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26840b6620 0x7f26840b8b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f26880058c0 tx=0x7f268800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:59:59.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.309+0000 7f2695ffb640 1 -- 172.21.15.81:0/1955115787 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26800ad560 con 0x7f26981094a0 2024-09-21T02:59:59.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 02:59:59 smithi181 ceph-mon[34096]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.521+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f269819b5f0 con 0x7f26981094a0 2024-09-21T02:59:59.522 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 02:59:59 smithi081 ceph-mon[30991]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:59:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.522+0000 7f2695ffb640 1 -- 172.21.15.81:0/1955115787 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7f269819b5f0 con 0x7f26981094a0 2024-09-21T02:59:59.523 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T02:59:59.523 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-21T02:58:54:243506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:53.899125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T02:59:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26840b6620 msgr2=0x7f26840b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26840b6620 0x7f26840b8b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f26880058c0 tx=0x7f268800a250 comp rx=0 tx=0).stop 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26981094a0 msgr2=0x7f269819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26981094a0 0x7f269819aa60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f268000d740 tx=0x7f268000dc00 comp rx=0 tx=0).stop 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 shutdown_connections 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f26840b6620 0x7f26840b8b30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2698109df0 0x7f269819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26981094a0 0x7f269819aa60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 --2- 172.21.15.81:0/1955115787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2698103b60 0x7f269819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:59:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 >> 172.21.15.81:0/1955115787 conn(0x7f269807b850 msgr2=0x7f2698105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:59:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 shutdown_connections 2024-09-21T02:59:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T02:59:59.524+0000 7f269ed29640 1 -- 172.21.15.81:0/1955115787 wait complete. 2024-09-21T02:59:59.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 02:59:59 smithi164 ceph-mon[34236]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:00:00.299 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:00 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1955115787' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:00.299 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:00 smithi081 ceph-mon[30991]: overall HEALTH_OK 2024-09-21T03:00:00.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:58:15.629942+0000', 'modified': '2024-09-21T02:58:53.899125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24599, 'mds_1': 24572, 'mds_2': 24568}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24547': {'gid': 24547, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/3990133631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 3990133631}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 3990133631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24551': {'gid': 24551, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.164:6835/1947556688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1947556688}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 1947556688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24553': {'gid': 24553, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/3046788185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3046788185}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3046788185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.181:6839/1458541171', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 1458541171}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 1458541171}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24572': {'gid': 24572, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.164:6837/3749524162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6836', 'nonce': 3749524162}, {'type': 'v1', 'addr': '172.21.15.164:6837', 'nonce': 3749524162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.164:6839/399869191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6838', 'nonce': 399869191}, {'type': 'v1', 'addr': '172.21.15.164:6839', 'nonce': 399869191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24599, 'qdb_cluster': [24568, 24572, 24599]} 2024-09-21T03:00:00.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T03:00:00.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T03:00:00.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:00 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1955115787' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:00.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:00 smithi181 ceph-mon[34096]: overall HEALTH_OK 2024-09-21T03:00:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:00.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:00 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1955115787' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:00.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:00 smithi164 ceph-mon[34236]: overall HEALTH_OK 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 -- 172.21.15.81:0/3494984732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 msgr2=0x7fea4c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 --2- 172.21.15.81:0/3494984732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c102e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009900 tx=0x7fea3c02a410 comp rx=0 tx=0).stop 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 -- 172.21.15.81:0/3494984732 shutdown_connections 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 --2- 172.21.15.81:0/3494984732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea4c1083a0 0x7fea4c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 --2- 172.21.15.81:0/3494984732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea4c108cf0 0x7fea4c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 --2- 172.21.15.81:0/3494984732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c102e70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 -- 172.21.15.81:0/3494984732 >> 172.21.15.81:0/3494984732 conn(0x7fea4c079730 msgr2=0x7fea4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:01.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 -- 172.21.15.81:0/3494984732 shutdown_connections 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.100+0000 7fea53e7b640 1 -- 172.21.15.81:0/3494984732 wait complete. 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 Processor -- start 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 -- start start 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea4c1083a0 0x7fea4c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea4c108cf0 0x7fea4c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c112870 con 0x7fea4c102a60 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c1126f0 con 0x7fea4c108cf0 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea53e7b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c1129f0 con 0x7fea4c1083a0 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea51c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea51c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55726/0 (socket says 172.21.15.81:55726) 2024-09-21T03:00:01.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.101+0000 7fea51c17640 1 -- 172.21.15.81:0/478386116 learned_addr learned my addr 172.21.15.81:0/478386116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea52418640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea4c108cf0 0x7fea4c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea51416640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea4c1083a0 0x7fea4c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea51c17640 1 -- 172.21.15.81:0/478386116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea4c1083a0 msgr2=0x7fea4c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea51c17640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea4c1083a0 0x7fea4c19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea51c17640 1 -- 172.21.15.81:0/478386116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea4c108cf0 msgr2=0x7fea4c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea51c17640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea4c108cf0 0x7fea4c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea51c17640 1 -- 172.21.15.81:0/478386116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c1a03c0 con 0x7fea4c102a60 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea52418640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea4c108cf0 0x7fea4c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea51c17640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c19a450 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009230 tx=0x7fea3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea42ffd640 1 -- 172.21.15.81:0/478386116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c03f030 con 0x7fea4c102a60 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4c1a0650 con 0x7fea4c102a60 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea42ffd640 1 -- 172.21.15.81:0/478386116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea3c003a80 con 0x7fea4c102a60 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea42ffd640 1 -- 172.21.15.81:0/478386116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c035070 con 0x7fea4c102a60 2024-09-21T03:00:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.102+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea4c1a6e10 con 0x7fea4c102a60 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 Processor -- start 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 -- start start 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea42ffd640 1 -- 172.21.15.81:0/478386116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fea3c042030 con 0x7fea4c102a60 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381720f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x563381721440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381721980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563381698c10 con 0x56338135a280 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563381688040 con 0x56338137af60 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56338168be50 con 0x5633813520a0 2024-09-21T03:00:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.105+0000 7fea51416640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381721980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381721980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55728/0 (socket says 172.21.15.81:55728) 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 -- 172.21.15.81:0/811710732 learned_addr learned my addr 172.21.15.81:0/811710732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea52418640 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381720f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51c17640 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x563381721440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 -- 172.21.15.81:0/811710732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 msgr2=0x563381721440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x563381721440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 -- 172.21.15.81:0/811710732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 msgr2=0x563381720f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381720f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 -- 172.21.15.81:0/811710732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633813e6540 con 0x56338135a280 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51c17640 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x563381721440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea51416640 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381721980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fea4800a8b0 tx=0x7fea4800ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ff677595c65af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea37fff640 1 -- 172.21.15.81:0/811710732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48015070 con 0x56338135a280 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea42ffd640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fea380b65a0 0x7fea380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea37fff640 1 -- 172.21.15.81:0/811710732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea480113f0 con 0x56338135a280 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea37fff640 1 -- 172.21.15.81:0/811710732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea480185c0 con 0x56338135a280 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea52418640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fea380b65a0 0x7fea380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.106+0000 7fea42ffd640 1 -- 172.21.15.81:0/478386116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fea3c107df0 con 0x7fea4c102a60 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 -- 172.21.15.81:0/811710732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 msgr2=0x563381721980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381721980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fea4800a8b0 tx=0x7fea4800ad70 comp rx=0 tx=0).stop 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea52418640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fea380b65a0 0x7fea380b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fea44005fd0 tx=0x7fea44009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 -- 172.21.15.81:0/811710732 shutdown_connections 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x563381721440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381721980 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/811710732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381720f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 -- 172.21.15.81:0/811710732 >> 172.21.15.81:0/811710732 conn(0x56338136f350 msgr2=0x56338171edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 -- 172.21.15.81:0/811710732 shutdown_connections 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.107+0000 7fea5a3ef740 1 -- 172.21.15.81:0/811710732 wait complete. 2024-09-21T03:00:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 -- start start 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 Processor -- start 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633813520a0 0x56338172c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338135a280 0x56338172cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338137af60 0x563381738a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5633814e95f0 con 0x5633813520a0 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563381623010 con 0x56338135a280 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56338172f6e0 con 0x56338137af60 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea5a3ef740 10 client.0 _ll_register_callbacks cb 0x563381682340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea51c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633813520a0 0x56338172c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea51c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633813520a0 0x56338172c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55740/0 (socket says 172.21.15.81:55740) 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.108+0000 7fea51c17640 1 -- 172.21.15.81:0/1392416240 learned_addr learned my addr 172.21.15.81:0/1392416240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea52418640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338137af60 0x563381738a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51416640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338135a280 0x56338172cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51c17640 1 -- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338137af60 msgr2=0x563381738a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51c17640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338137af60 0x563381738a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51c17640 1 -- 172.21.15.81:0/1392416240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338135a280 msgr2=0x56338172cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51c17640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338135a280 0x56338172cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51c17640 1 -- 172.21.15.81:0/1392416240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563381650a00 con 0x5633813520a0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51416640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338135a280 0x56338172cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea51c17640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633813520a0 0x56338172c9f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0cd7e0 tx=0x7fea3c0c9a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbee3507d825318 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea357fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea357fa640 1 -- 172.21.15.81:0/1392416240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c049030 con 0x5633813520a0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea357fa640 1 -- 172.21.15.81:0/1392416240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fea3c0c9d50 con 0x5633813520a0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea480113f0 con 0x5633813520a0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea357fa640 1 -- 172.21.15.81:0/1392416240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea3c0cd250 con 0x5633813520a0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea5a3ef740 10 client.15249 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56338173b650 con 0x5633813520a0 2024-09-21T03:00:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea357fa640 1 -- 172.21.15.81:0/1392416240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea480113f0 con 0x5633813520a0 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.109+0000 7fea357fa640 1 -- 172.21.15.81:0/1392416240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fea3c10a0d0 con 0x5633813520a0 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea5a3ef740 10 client.15249 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea5a3ef740 10 client.15249 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea5a3ef740 20 client.15249 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x5633813398e0 0x56338173f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea5a3ef740 4 client.15249 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 --> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56338169ab60 con 0x5633813398e0 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea51416640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x5633813398e0 0x56338173f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea51416640 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x5633813398e0 0x56338173f0e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11593af7acf8057d server_cookie=7f26d3411f55601b in_seq=0 out_seq=0 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.110+0000 7fea357fa640 10 client.15249 ms_handle_connect on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.111+0000 7fea357fa640 1 -- 172.21.15.81:0/1392416240 <== mds.2 v2:172.21.15.181:6838/1458541171 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56338169ab60 con 0x5633813398e0 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.111+0000 7fea357fa640 10 client.15249 handle_command_reply: tid=0 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.111+0000 7fea5a3ef740 1 client.15249 shutdown 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.111+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633813520a0 msgr2=0x56338172c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.111+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633813520a0 0x56338172c9f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0cd7e0 tx=0x7fea3c0c9a40 comp rx=0 tx=0).stop 2024-09-21T03:00:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 shutdown_connections 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x5633813398e0 0x56338173f0e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338137af60 0x563381738a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338135a280 0x56338172cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/1392416240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5633813520a0 0x56338172c9f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea357fa640 0 client.15249 ms_handle_reset on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 >> 172.21.15.81:0/1392416240 conn(0x56338136f350 msgr2=0x563381724090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 shutdown_connections 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 1 -- 172.21.15.81:0/1392416240 wait complete. 2024-09-21T03:00:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.112+0000 7fea5a3ef740 20 client.15249 trim_cache size 0 max 16384 2024-09-21T03:00:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 Processor -- start 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 -- start start 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5633813520a0 0x56338172c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338135a280 0x56338172cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338137af60 0x5633817279a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56338173d420 con 0x56338137af60 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56338173daf0 con 0x5633813520a0 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56338173e1c0 con 0x56338135a280 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea52418640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338137af60 0x5633817279a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea52418640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338137af60 0x5633817279a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55748/0 (socket says 172.21.15.81:55748) 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.130+0000 7fea52418640 1 -- 172.21.15.81:0/2359533690 learned_addr learned my addr 172.21.15.81:0/2359533690 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea51c17640 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5633813520a0 0x56338172c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea51416640 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338135a280 0x56338172cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea52418640 1 -- 172.21.15.81:0/2359533690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338135a280 msgr2=0x56338172cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea52418640 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338135a280 0x56338172cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea52418640 1 -- 172.21.15.81:0/2359533690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5633813520a0 msgr2=0x56338172c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea52418640 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5633813520a0 0x56338172c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea52418640 1 -- 172.21.15.81:0/2359533690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563381723d60 con 0x56338137af60 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea52418640 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338137af60 0x5633817279a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea44011740 tx=0x7fea44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bf05c04b2a9708 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea377fe640 1 -- 172.21.15.81:0/2359533690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44029640 con 0x56338137af60 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea377fe640 1 -- 172.21.15.81:0/2359533690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea4401f8a0 con 0x56338137af60 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.131+0000 7fea377fe640 1 -- 172.21.15.81:0/2359533690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44028750 con 0x56338137af60 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 -- 172.21.15.81:0/2359533690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338137af60 msgr2=0x5633817279a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338137af60 0x5633817279a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea44011740 tx=0x7fea44016000 comp rx=0 tx=0).stop 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 -- 172.21.15.81:0/2359533690 shutdown_connections 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56338135a280 0x56338172cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338137af60 0x5633817279a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/2359533690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5633813520a0 0x56338172c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 -- 172.21.15.81:0/2359533690 >> 172.21.15.81:0/2359533690 conn(0x56338136f350 msgr2=0x56338173c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 -- 172.21.15.81:0/2359533690 shutdown_connections 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.132+0000 7fea5a3ef740 1 -- 172.21.15.81:0/2359533690 wait complete. 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 -- start start 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 Processor -- start 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x5633817477e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381747dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381740e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56338173ef60 con 0x56338135a280 2024-09-21T03:00:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56338173e890 con 0x56338137af60 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56338173f630 con 0x5633813520a0 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea5a3ef740 10 client.0 _ll_register_callbacks cb 0x7fea3c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea51416640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381747dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea51416640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381747dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55760/0 (socket says 172.21.15.81:55760) 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea51416640 1 -- 172.21.15.81:0/3759872587 learned_addr learned my addr 172.21.15.81:0/3759872587 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea52418640 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381740e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.133+0000 7fea51c17640 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x5633817477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea51416640 1 -- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 msgr2=0x5633817477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea51416640 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x5633817477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea51416640 1 -- 172.21.15.81:0/3759872587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 msgr2=0x563381740e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea51416640 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381740e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea51416640 1 -- 172.21.15.81:0/3759872587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633817415d0 con 0x56338135a280 2024-09-21T03:00:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea51416640 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381747dc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fea48011e50 tx=0x7fea4800a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6f0ad9d4aa24a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea357fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea357fa640 1 -- 172.21.15.81:0/3759872587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48032060 con 0x56338135a280 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea357fa640 1 -- 172.21.15.81:0/3759872587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fea4800cd20 con 0x56338135a280 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea4401f8a0 con 0x56338135a280 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea357fa640 1 -- 172.21.15.81:0/3759872587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea48039050 con 0x56338135a280 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea5a3ef740 10 client.15255 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563381746fe0 con 0x56338135a280 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea357fa640 1 -- 172.21.15.81:0/3759872587 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea4401f8a0 con 0x56338135a280 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.134+0000 7fea357fa640 1 -- 172.21.15.81:0/3759872587 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fea48026620 con 0x56338135a280 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea5a3ef740 10 client.15255 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea5a3ef740 10 client.15255 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea5a3ef740 20 client.15255 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x56338130ec90 0x5633817ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea5a3ef740 4 client.15255 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 --> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] -- command(tid 0: {"prefix": "status"}) -- 0x563381696610 con 0x56338130ec90 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea51c17640 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x56338130ec90 0x5633817ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea357fa640 10 client.15255 ms_handle_connect on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.135+0000 7fea51c17640 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x56338130ec90 0x5633817ad730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77f03bd11a0f00af server_cookie=c38a5847512d3296 in_seq=0 out_seq=0 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea357fa640 1 -- 172.21.15.81:0/3759872587 <== mds.2 v2:172.21.15.181:6838/1458541171 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563381696610 con 0x56338130ec90 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea357fa640 10 client.15255 handle_command_reply: tid=0 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 client.15255 shutdown 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 msgr2=0x563381747dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381747dc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fea48011e50 tx=0x7fea4800a230 comp rx=0 tx=0).stop 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 shutdown_connections 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x56338130ec90 0x5633817ad730 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56338137af60 0x563381740e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56338135a280 0x563381747dc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 --2- 172.21.15.81:0/3759872587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5633813520a0 0x5633817477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea357fa640 0 client.15255 ms_handle_reset on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 >> 172.21.15.81:0/3759872587 conn(0x56338136f350 msgr2=0x56338172c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 shutdown_connections 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 1 -- 172.21.15.81:0/3759872587 wait complete. 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea5a3ef740 20 client.15255 trim_cache size 0 max 16384 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-21T03:00:01.149 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24568, 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 69.993940426999998, 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 24, 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 124.635811739 2024-09-21T03:00:01.150 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fea380b65a0 msgr2=0x7fea380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea53e7b640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fea380b65a0 0x7fea380b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fea44005fd0 tx=0x7fea44009800 comp rx=0 tx=0).stop 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 msgr2=0x7fea4c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.136+0000 7fea53e7b640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c19a450 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009230 tx=0x7fea3c004270 comp rx=0 tx=0).stop 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 shutdown_connections 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fea380b65a0 0x7fea380b8ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fea4c1083a0 0x7fea4c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fea4c108cf0 0x7fea4c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 --2- 172.21.15.81:0/478386116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c102a60 0x7fea4c19a450 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 >> 172.21.15.81:0/478386116 conn(0x7fea4c079730 msgr2=0x7fea4c106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 shutdown_connections 2024-09-21T03:00:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:01.137+0000 7fea53e7b640 1 -- 172.21.15.81:0/478386116 wait complete. 2024-09-21T03:00:01.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:01 smithi081 ceph-mon[30991]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:01.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:01 smithi181 ceph-mon[34096]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:01.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:01 smithi164 ceph-mon[34236]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:01.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T03:00:02.219 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 -- 172.21.15.81:0/1189784067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1524109df0 msgr2=0x7f1524110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 --2- 172.21.15.81:0/1189784067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1524109df0 0x7f1524110620 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f151c009900 tx=0x7f151c02a410 comp rx=0 tx=0).stop 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 -- 172.21.15.81:0/1189784067 shutdown_connections 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 --2- 172.21.15.81:0/1189784067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1524109df0 0x7f1524110620 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 --2- 172.21.15.81:0/1189784067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15241094a0 0x7f15241098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 --2- 172.21.15.81:0/1189784067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1524103b60 0x7f1524103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 -- 172.21.15.81:0/1189784067 >> 172.21.15.81:0/1189784067 conn(0x7f152407b850 msgr2=0x7f152407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 -- 172.21.15.81:0/1189784067 shutdown_connections 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.676+0000 7f152b339640 1 -- 172.21.15.81:0/1189784067 wait complete. 2024-09-21T03:00:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.677+0000 7f152b339640 1 Processor -- start 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.677+0000 7f152b339640 1 -- start start 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1524103b60 0x7f152419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15241094a0 0x7f152419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1524109df0 0x7f152419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113960 con 0x7f15241094a0 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f15241137e0 con 0x7f1524109df0 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113ae0 con 0x7f1524103b60 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15241094a0 0x7f152419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15241094a0 0x7f152419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53116/0 (socket says 172.21.15.81:53116) 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 -- 172.21.15.81:0/1571955408 learned_addr learned my addr 172.21.15.81:0/1571955408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15298d6640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1524109df0 0x7f152419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15290d5640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1524103b60 0x7f152419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 -- 172.21.15.81:0/1571955408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1524103b60 msgr2=0x7f152419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1524103b60 0x7f152419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 -- 172.21.15.81:0/1571955408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1524109df0 msgr2=0x7f152419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1524109df0 0x7f152419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 -- 172.21.15.81:0/1571955408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15241a02e0 con 0x7f15241094a0 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f15288d4640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15241094a0 0x7f152419a910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f151400c970 tx=0x7f151400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f151a7fc640 1 -- 172.21.15.81:0/1571955408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514007bb0 con 0x7f15241094a0 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15241a05d0 con 0x7f15241094a0 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f151a7fc640 1 -- 172.21.15.81:0/1571955408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1514007d50 con 0x7f15241094a0 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f151a7fc640 1 -- 172.21.15.81:0/1571955408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514004d40 con 0x7f15241094a0 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.678+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15241a6d30 con 0x7f15241094a0 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 Processor -- start 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 -- start start 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x56164496ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164496f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164496f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616448e6c10 con 0x5616445a8280 2024-09-21T03:00:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5616448d6040 con 0x5616445a00a0 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f15318ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5616448d9e50 con 0x5616445c8f60 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.681+0000 7f151a7fc640 1 -- 172.21.15.81:0/1571955408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f151400f450 con 0x7f15241094a0 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164496f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164496f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:33870/0 (socket says 172.21.15.81:33870) 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 -- 172.21.15.81:0/1669298785 learned_addr learned my addr 172.21.15.81:0/1669298785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15298d6640 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x56164496ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15288d4640 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164496f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 -- 172.21.15.81:0/1669298785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 msgr2=0x56164496ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x56164496ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 -- 172.21.15.81:0/1669298785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 msgr2=0x56164496f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164496f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 -- 172.21.15.81:0/1669298785 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561644634540 con 0x5616445a00a0 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15288d4640 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164496f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f15290d5640 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164496f440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f152000ae90 tx=0x7f152000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e940586dd9dd598b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:02.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.682+0000 7f151a7fc640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15100b65a0 0x7f15100b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f150f7fe640 1 -- 172.21.15.81:0/1669298785 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520011850 con 0x5616445a00a0 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f15298d6640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15100b65a0 0x7f15100b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f150f7fe640 1 -- 172.21.15.81:0/1669298785 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f152001a480 con 0x5616445a00a0 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f150f7fe640 1 -- 172.21.15.81:0/1669298785 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520010630 con 0x5616445a00a0 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f151a7fc640 1 -- 172.21.15.81:0/1571955408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f15140e7590 con 0x7f15241094a0 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f15318ad740 1 -- 172.21.15.81:0/1669298785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 msgr2=0x56164496f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f15298d6640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15100b65a0 0x7f15100b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f151c005ab0 tx=0x7f151c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.683+0000 7f15318ad740 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164496f440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f152000ae90 tx=0x7f152000f730 comp rx=0 tx=0).stop 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 -- 172.21.15.81:0/1669298785 shutdown_connections 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164496f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164496f440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 --2- 172.21.15.81:0/1669298785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x56164496ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 -- 172.21.15.81:0/1669298785 >> 172.21.15.81:0/1669298785 conn(0x5616445bd350 msgr2=0x56164496cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 -- 172.21.15.81:0/1669298785 shutdown_connections 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 -- 172.21.15.81:0/1669298785 wait complete. 2024-09-21T03:00:02.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 -- start start 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 Processor -- start 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.684+0000 7f15318ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15318ad740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445c8f60 0x56164498ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15318ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616447375f0 con 0x5616445a8280 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15318ad740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561644871010 con 0x5616445c8f60 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15318ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5616449819e0 con 0x5616445a00a0 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15318ad740 10 client.0 _ll_register_callbacks cb 0x5616448d0340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15298d6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445c8f60 0x56164498ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53126/0 (socket says 172.21.15.81:53126) 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 -- 172.21.15.81:0/2916971447 learned_addr learned my addr 172.21.15.81:0/2916971447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15290d5640 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 -- 172.21.15.81:0/2916971447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 msgr2=0x56164497edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 -- 172.21.15.81:0/2916971447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445c8f60 msgr2=0x56164498ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445c8f60 0x56164498ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 -- 172.21.15.81:0/2916971447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56164489ea00 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15288d4640 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15140aa4f0 tx=0x7f15140b6bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cb774c4cdf6634 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f150cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f150cff9640 1 -- 172.21.15.81:0/2916971447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151401d040 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f150cff9640 1 -- 172.21.15.81:0/2916971447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f15140ac160 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f152001a480 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.685+0000 7f150cff9640 1 -- 172.21.15.81:0/2916971447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f15140a98d0 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 10 client.15267 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56164498d970 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f150cff9640 1 -- 172.21.15.81:0/2916971447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f152001a480 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f150cff9640 1 -- 172.21.15.81:0/2916971447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f15140b2ef0 con 0x5616445a8280 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 10 client.15267 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:02.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 10 client.15267 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 20 client.15267 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x5616445878e0 0x5616449913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 4 client.15267 mds_command: new command op to 24572 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 --> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616448e8b60 con 0x5616445878e0 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.686+0000 7f15290d5640 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x5616445878e0 0x5616449913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.687+0000 7f150cff9640 10 client.15267 ms_handle_connect on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.687+0000 7f15290d5640 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x5616445878e0 0x5616449913c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd6c34c3204b2119 server_cookie=15b0b3b5310a2ade in_seq=0 out_seq=0 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f150cff9640 1 -- 172.21.15.81:0/2916971447 <== mds.1 v2:172.21.15.164:6836/3749524162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616448e8b60 con 0x5616445878e0 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f150cff9640 10 client.15267 handle_command_reply: tid=0 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 client.15267 shutdown 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 msgr2=0x56164497f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15140aa4f0 tx=0x7f15140b6bd0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 shutdown_connections 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x5616445878e0 0x5616449913c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445c8f60 0x56164498ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 --2- 172.21.15.81:0/2916971447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 >> 172.21.15.81:0/2916971447 conn(0x5616445bd350 msgr2=0x56164496b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f150cff9640 0 client.15267 ms_handle_reset on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 shutdown_connections 2024-09-21T03:00:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 1 -- 172.21.15.81:0/2916971447 wait complete. 2024-09-21T03:00:02.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.688+0000 7f15318ad740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T03:00:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 Processor -- start 2024-09-21T03:00:02.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 -- start start 2024-09-21T03:00:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x561644979d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56164498f700 con 0x5616445a8280 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56164498fdd0 con 0x5616445a00a0 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15318ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5616449904a0 con 0x5616445c8f60 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53130/0 (socket says 172.21.15.81:53130) 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 -- 172.21.15.81:0/4293474181 learned_addr learned my addr 172.21.15.81:0/4293474181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15290d5640 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15298d6640 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x561644979d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 -- 172.21.15.81:0/4293474181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 msgr2=0x561644979d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x561644979d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 -- 172.21.15.81:0/4293474181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 msgr2=0x56164497edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.706+0000 7f15288d4640 1 -- 172.21.15.81:0/4293474181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561644971d30 con 0x5616445a8280 2024-09-21T03:00:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.707+0000 7f15288d4640 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15140e5180 tx=0x7f1514004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7398d91e214adb7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.707+0000 7f150effd640 1 -- 172.21.15.81:0/4293474181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151401d040 con 0x5616445a8280 2024-09-21T03:00:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.707+0000 7f150effd640 1 -- 172.21.15.81:0/4293474181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15140ad980 con 0x5616445a8280 2024-09-21T03:00:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.707+0000 7f150effd640 1 -- 172.21.15.81:0/4293474181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140ac9f0 con 0x5616445a8280 2024-09-21T03:00:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 -- 172.21.15.81:0/4293474181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 msgr2=0x56164497f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15140e5180 tx=0x7f1514004740 comp rx=0 tx=0).stop 2024-09-21T03:00:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 -- 172.21.15.81:0/4293474181 shutdown_connections 2024-09-21T03:00:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445c8f60 0x561644979d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445a8280 0x56164497f2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 --2- 172.21.15.81:0/4293474181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a00a0 0x56164497edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 -- 172.21.15.81:0/4293474181 >> 172.21.15.81:0/4293474181 conn(0x5616445bd350 msgr2=0x56164498ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 -- 172.21.15.81:0/4293474181 shutdown_connections 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 -- 172.21.15.81:0/4293474181 wait complete. 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 -- start start 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.708+0000 7f15318ad740 1 Processor -- start 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15318ad740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x561644999e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15318ad740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a8280 0x5616449932c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15318ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445c8f60 0x561644993800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15318ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561644991240 con 0x5616445c8f60 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15318ad740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561644990b70 con 0x5616445a8280 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15318ad740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561644991910 con 0x5616445a00a0 2024-09-21T03:00:02.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15318ad740 10 client.0 _ll_register_callbacks cb 0x7f15140ed220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445c8f60 0x561644993800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445c8f60 0x561644993800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53132/0 (socket says 172.21.15.81:53132) 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 -- 172.21.15.81:0/106746918 learned_addr learned my addr 172.21.15.81:0/106746918 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15290d5640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x561644999e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15288d4640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a8280 0x5616449932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 -- 172.21.15.81:0/106746918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 msgr2=0x561644999e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x561644999e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 -- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a8280 msgr2=0x5616449932c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a8280 0x5616449932c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 -- 172.21.15.81:0/106746918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561644993f70 con 0x5616445c8f60 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15288d4640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a8280 0x5616449932c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f15298d6640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445c8f60 0x561644993800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f151c009230 tx=0x7f151c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0db084b14a7c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.709+0000 7f150cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f150cff9640 1 -- 172.21.15.81:0/106746918 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c035040 con 0x5616445c8f60 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f150cff9640 1 -- 172.21.15.81:0/106746918 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f151c03dba0 con 0x5616445c8f60 2024-09-21T03:00:02.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15140ad980 con 0x5616445c8f60 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f150cff9640 1 -- 172.21.15.81:0/106746918 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f151c03dda0 con 0x5616445c8f60 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 10 client.15273 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616449fc890 con 0x5616445c8f60 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f150cff9640 1 -- 172.21.15.81:0/106746918 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15140ad980 con 0x5616445c8f60 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f150cff9640 1 -- 172.21.15.81:0/106746918 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f151c052070 con 0x5616445c8f60 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 10 client.15273 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 10 client.15273 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 20 client.15273 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x56164455cc90 0x561644a000d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 4 client.15273 mds_command: new command op to 24572 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.710+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 --> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] -- command(tid 0: {"prefix": "status"}) -- 0x5616448e4610 con 0x56164455cc90 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15290d5640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x56164455cc90 0x561644a000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f150cff9640 10 client.15273 ms_handle_connect on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15290d5640 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x56164455cc90 0x561644a000d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fdf3e40a3635212a server_cookie=630443f6ce047690 in_seq=0 out_seq=0 2024-09-21T03:00:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f150cff9640 1 -- 172.21.15.81:0/106746918 <== mds.1 v2:172.21.15.164:6836/3749524162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5616448e4610 con 0x56164455cc90 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f150cff9640 10 client.15273 handle_command_reply: tid=0 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 client.15273 shutdown 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445c8f60 msgr2=0x561644993800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445c8f60 0x561644993800 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f151c009230 tx=0x7f151c009260 comp rx=0 tx=0).stop 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 shutdown_connections 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x56164455cc90 0x561644a000d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616445c8f60 0x561644993800 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616445a8280 0x5616449932c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f150cff9640 0 client.15273 ms_handle_reset on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.711+0000 7f15318ad740 1 --2- 172.21.15.81:0/106746918 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616445a00a0 0x561644999e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 >> 172.21.15.81:0/106746918 conn(0x5616445bd350 msgr2=0x561644979d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 shutdown_connections 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f15318ad740 1 -- 172.21.15.81:0/106746918 wait complete. 2024-09-21T03:00:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f15318ad740 20 client.15273 trim_cache size 0 max 16384 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24572, 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 72.578607000000005, 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 24, 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 128.774472729 2024-09-21T03:00:02.718 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15100b65a0 msgr2=0x7f15100b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15100b65a0 0x7f15100b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f151c005ab0 tx=0x7f151c005a20 comp rx=0 tx=0).stop 2024-09-21T03:00:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15241094a0 msgr2=0x7f152419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15241094a0 0x7f152419a910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f151400c970 tx=0x7f151400ce30 comp rx=0 tx=0).stop 2024-09-21T03:00:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 shutdown_connections 2024-09-21T03:00:02.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15100b65a0 0x7f15100b8ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1524109df0 0x7f152419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15241094a0 0x7f152419a910 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 --2- 172.21.15.81:0/1571955408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1524103b60 0x7f152419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 >> 172.21.15.81:0/1571955408 conn(0x7f152407b850 msgr2=0x7f15241054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.712+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 shutdown_connections 2024-09-21T03:00:02.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:02.713+0000 7f152b339640 1 -- 172.21.15.81:0/1571955408 wait complete. 2024-09-21T03:00:03.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:03 smithi081 ceph-mon[30991]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:00:03.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:03 smithi181 ceph-mon[34096]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:00:03.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:00:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:03 smithi164 ceph-mon[34236]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:00:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 -- 172.21.15.81:0/2693605801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 msgr2=0x7f5768110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 --2- 172.21.15.81:0/2693605801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768110620 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5760009ca0 tx=0x7f576002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 -- 172.21.15.81:0/2693605801 shutdown_connections 2024-09-21T03:00:04.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 --2- 172.21.15.81:0/2693605801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57681094a0 0x7f57681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 --2- 172.21.15.81:0/2693605801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768110620 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 --2- 172.21.15.81:0/2693605801 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5768103b60 0x7f5768103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 -- 172.21.15.81:0/2693605801 >> 172.21.15.81:0/2693605801 conn(0x7f576807b850 msgr2=0x7f576807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 -- 172.21.15.81:0/2693605801 shutdown_connections 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.271+0000 7f576e2c1640 1 -- 172.21.15.81:0/2693605801 wait complete. 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 Processor -- start 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 -- start start 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5768103b60 0x7f5768075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57681094a0 0x7f5768075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57681139a0 con 0x7f5768109df0 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5768113820 con 0x7f5768103b60 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576e2c1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5768113b20 con 0x7f57681094a0 2024-09-21T03:00:04.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.272+0000 7f576c85e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53156/0 (socket says 172.21.15.81:53156) 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 -- 172.21.15.81:0/4003338136 learned_addr learned my addr 172.21.15.81:0/4003338136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f575ffff640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57681094a0 0x7f5768075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f5767fff640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5768103b60 0x7f5768075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 -- 172.21.15.81:0/4003338136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57681094a0 msgr2=0x7f5768075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57681094a0 0x7f5768075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 -- 172.21.15.81:0/4003338136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5768103b60 msgr2=0x7f5768075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5768103b60 0x7f5768075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 -- 172.21.15.81:0/4003338136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57681a8640 con 0x7f5768109df0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576c85e640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768076190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5760006010 tx=0x7f5760003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f5765ffb640 1 -- 172.21.15.81:0/4003338136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760004240 con 0x7f5768109df0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f5765ffb640 1 -- 172.21.15.81:0/4003338136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57600305e0 con 0x7f5768109df0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57681a88d0 con 0x7f5768109df0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f5765ffb640 1 -- 172.21.15.81:0/4003338136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576003b660 con 0x7f5768109df0 2024-09-21T03:00:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.273+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57681a8e60 con 0x7f5768109df0 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 Processor -- start 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5765ffb640 1 -- 172.21.15.81:0/4003338136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5760030790 con 0x7f5768109df0 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 -- start start 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2af92f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af93440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af93980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559b2af0ac10 con 0x559b2abcc280 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x559b2aefa040 con 0x559b2abecf60 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f5774835740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b2aefde50 con 0x559b2abc40a0 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.276+0000 7f575ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af93980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af93980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53164/0 (socket says 172.21.15.81:53164) 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 -- 172.21.15.81:0/2903495916 learned_addr learned my addr 172.21.15.81:0/2903495916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:04.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f5767fff640 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af93440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2af92f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 -- 172.21.15.81:0/2903495916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 msgr2=0x559b2af93440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af93440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f5765ffb640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57540b6620 0x7f57540b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 -- 172.21.15.81:0/2903495916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 msgr2=0x559b2af92f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2af92f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 -- 172.21.15.81:0/2903495916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2ac58540 con 0x559b2abcc280 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f5767fff640 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af93440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f576c85e640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57540b6620 0x7f57540b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575ffff640 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af93980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5750009330 tx=0x7f57500094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dc33c43428029f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f5765ffb640 1 -- 172.21.15.81:0/4003338136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5760108b70 con 0x7f5768109df0 2024-09-21T03:00:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575e7fc640 1 -- 172.21.15.81:0/2903495916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750017e60 con 0x559b2abcc280 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.277+0000 7f575e7fc640 1 -- 172.21.15.81:0/2903495916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f575001d070 con 0x559b2abcc280 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f576c85e640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57540b6620 0x7f57540b8b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57600cae30 tx=0x7f576009b560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f575e7fc640 1 -- 172.21.15.81:0/2903495916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750018840 con 0x559b2abcc280 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 -- 172.21.15.81:0/2903495916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 msgr2=0x559b2af93980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af93980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5750009330 tx=0x7f57500094d0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 -- 172.21.15.81:0/2903495916 shutdown_connections 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af93440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af93980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 --2- 172.21.15.81:0/2903495916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2af92f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 -- 172.21.15.81:0/2903495916 >> 172.21.15.81:0/2903495916 conn(0x559b2abe1350 msgr2=0x559b2af90df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 -- 172.21.15.81:0/2903495916 shutdown_connections 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.278+0000 7f5774835740 1 -- 172.21.15.81:0/2903495916 wait complete. 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 -- start start 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 Processor -- start 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af9ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af9efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2afaa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559b2ad5b5f0 con 0x559b2abcc280 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x559b2ae95010 con 0x559b2abecf60 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b2afa1680 con 0x559b2abc40a0 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5774835740 10 client.0 _ll_register_callbacks cb 0x559b2aef4340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.279+0000 7f5767fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af9efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af9efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53178/0 (socket says 172.21.15.81:53178) 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 -- 172.21.15.81:0/1695405241 learned_addr learned my addr 172.21.15.81:0/1695405241 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f575ffff640 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2afaa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f575ffff640 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af9ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 -- 172.21.15.81:0/1695405241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 msgr2=0x559b2af9ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af9ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 -- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 msgr2=0x559b2afaa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2afaa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 -- 172.21.15.81:0/1695405241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2aec2a00 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5767fff640 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af9efc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f575800ce70 tx=0x7f57580039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3345b3017d82de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f57477fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f57477fe640 1 -- 172.21.15.81:0/1695405241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57580119d0 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f57477fe640 1 -- 172.21.15.81:0/1695405241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5758011b70 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f575001d070 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f57477fe640 1 -- 172.21.15.81:0/1695405241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5758011d70 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5774835740 10 client.15285 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.280+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b2afad6f0 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f57477fe640 1 -- 172.21.15.81:0/1695405241 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f575001d070 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f57477fe640 1 -- 172.21.15.81:0/1695405241 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f5758018070 con 0x559b2abcc280 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f5774835740 10 client.15285 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f5774835740 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:00:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f5774835740 20 client.15285 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f5774835740 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abab8e0 0x559b2afb11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f5774835740 4 client.15285 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b2af0cb60 con 0x559b2abab8e0 2024-09-21T03:00:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.281+0000 7f575ffff640 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abab8e0 0x559b2afb11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.282+0000 7f57477fe640 10 client.15285 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.282+0000 7f575ffff640 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abab8e0 0x559b2afb11e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b9fa25d2c3c2c1c server_cookie=59f707c4ea6370d3 in_seq=0 out_seq=0 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.282+0000 7f57477fe640 1 -- 172.21.15.81:0/1695405241 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b2af0cb60 con 0x559b2abab8e0 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.282+0000 7f57477fe640 10 client.15285 handle_command_reply: tid=0 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.282+0000 7f5774835740 1 client.15285 shutdown 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.282+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 msgr2=0x559b2af9efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.282+0000 7f5774835740 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af9efc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f575800ce70 tx=0x7f57580039c0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 shutdown_connections 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abab8e0 0x559b2afb11e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f57477fe640 0 client.15285 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:04.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abecf60 0x559b2afaa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af9efc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 --2- 172.21.15.81:0/1695405241 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af9ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 >> 172.21.15.81:0/1695405241 conn(0x559b2abe1350 msgr2=0x559b2af96090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:04.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 shutdown_connections 2024-09-21T03:00:04.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 1 -- 172.21.15.81:0/1695405241 wait complete. 2024-09-21T03:00:04.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.283+0000 7f5774835740 20 client.15285 trim_cache size 0 max 16384 2024-09-21T03:00:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 Processor -- start 2024-09-21T03:00:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 -- start start 2024-09-21T03:00:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abab8e0 0x559b2afaa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af99aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af99fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559b2afaf520 con 0x559b2abcc280 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x559b2afafbf0 con 0x559b2abab8e0 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5774835740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b2afb02c0 con 0x559b2abc40a0 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af99fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af99fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53190/0 (socket says 172.21.15.81:53190) 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 -- 172.21.15.81:0/4006651115 learned_addr learned my addr 172.21.15.81:0/4006651115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f5767fff640 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af99aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abab8e0 0x559b2afaa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 -- 172.21.15.81:0/4006651115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 msgr2=0x559b2af99aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af99aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 -- 172.21.15.81:0/4006651115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abab8e0 msgr2=0x559b2afaa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abab8e0 0x559b2afaa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.301+0000 7f575ffff640 1 -- 172.21.15.81:0/4006651115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2af9cd80 con 0x559b2abcc280 2024-09-21T03:00:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.302+0000 7f575ffff640 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af99fe0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57500176d0 tx=0x7f5750009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19490136aab9da7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.302+0000 7f575dffb640 1 -- 172.21.15.81:0/4006651115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750017e60 con 0x559b2abcc280 2024-09-21T03:00:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.302+0000 7f575dffb640 1 -- 172.21.15.81:0/4006651115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f575001d070 con 0x559b2abcc280 2024-09-21T03:00:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.302+0000 7f575dffb640 1 -- 172.21.15.81:0/4006651115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750018990 con 0x559b2abcc280 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.302+0000 7f5774835740 1 -- 172.21.15.81:0/4006651115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 msgr2=0x559b2af99fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.302+0000 7f5774835740 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af99fe0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57500176d0 tx=0x7f5750009950 comp rx=0 tx=0).stop 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 -- 172.21.15.81:0/4006651115 shutdown_connections 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abc40a0 0x559b2af99aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2af99fe0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 --2- 172.21.15.81:0/4006651115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abab8e0 0x559b2afaa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 -- 172.21.15.81:0/4006651115 >> 172.21.15.81:0/4006651115 conn(0x559b2abe1350 msgr2=0x559b2af98d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 -- 172.21.15.81:0/4006651115 shutdown_connections 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 -- 172.21.15.81:0/4006651115 wait complete. 2024-09-21T03:00:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 -- start start 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 Processor -- start 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.303+0000 7f5774835740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abab8e0 0x559b2afb9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5774835740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abc40a0 0x559b2afb3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5774835740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2afb35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5774835740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559b2afb1060 con 0x559b2abcc280 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5774835740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x559b2afb0990 con 0x559b2abc40a0 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5774835740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x559b2afb1730 con 0x559b2abab8e0 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5774835740 10 client.0 _ll_register_callbacks cb 0x7f5758004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2afb35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2afb35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53200/0 (socket says 172.21.15.81:53200) 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 -- 172.21.15.81:0/1348236521 learned_addr learned my addr 172.21.15.81:0/1348236521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5767fff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abc40a0 0x559b2afb3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abab8e0 0x559b2afb9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 -- 172.21.15.81:0/1348236521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abab8e0 msgr2=0x559b2afb9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abab8e0 0x559b2afb9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 -- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abc40a0 msgr2=0x559b2afb3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abc40a0 0x559b2afb3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 -- 172.21.15.81:0/1348236521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2afb3ba0 con 0x559b2abcc280 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5767fff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abc40a0 0x559b2afb3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f575ffff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2afb35b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5750018670 tx=0x7f5750033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae88941a57584de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f57477fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f57477fe640 1 -- 172.21.15.81:0/1348236521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750015970 con 0x559b2abcc280 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f57477fe640 1 -- 172.21.15.81:0/1348236521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5750015b10 con 0x559b2abcc280 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.304+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f575001d070 con 0x559b2abcc280 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f57477fe640 1 -- 172.21.15.81:0/1348236521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5750015d50 con 0x559b2abcc280 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 10 client.15291 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:04.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b2afb94b0 con 0x559b2abcc280 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f57477fe640 1 -- 172.21.15.81:0/1348236521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f575001d070 con 0x559b2abcc280 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f57477fe640 1 -- 172.21.15.81:0/1348236521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f5750024790 con 0x559b2abcc280 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 10 client.15291 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 20 client.15291 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abecf60 0x559b2b01f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 4 client.15291 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "status"}) -- 0x559b2af08610 con 0x559b2abecf60 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.305+0000 7f5767fff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abecf60 0x559b2b01f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f57477fe640 10 client.15291 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5767fff640 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abecf60 0x559b2b01f4b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2978564b90f24229 server_cookie=aedaaa28f04aeb66 in_seq=0 out_seq=0 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f57477fe640 1 -- 172.21.15.81:0/1348236521 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559b2af08610 con 0x559b2abecf60 2024-09-21T03:00:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f57477fe640 10 client.15291 handle_command_reply: tid=0 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 client.15291 shutdown 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 msgr2=0x559b2afb35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2afb35b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5750018670 tx=0x7f5750033040 comp rx=0 tx=0).stop 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 shutdown_connections 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x559b2abecf60 0x559b2b01f4b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b2abcc280 0x559b2afb35b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x559b2abc40a0 0x559b2afb3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f57477fe640 0 client.15291 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 --2- 172.21.15.81:0/1348236521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b2abab8e0 0x559b2afb9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.306+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 >> 172.21.15.81:0/1348236521 conn(0x559b2abe1350 msgr2=0x559b2af9ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 shutdown_connections 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f5774835740 1 -- 172.21.15.81:0/1348236521 wait complete. 2024-09-21T03:00:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f5774835740 20 client.15291 trim_cache size 0 max 16384 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24599, 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 108.273106443, 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 24, 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:04.314 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 119.071458835 2024-09-21T03:00:04.315 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57540b6620 msgr2=0x7f57540b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57540b6620 0x7f57540b8b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57600cae30 tx=0x7f576009b560 comp rx=0 tx=0).stop 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 msgr2=0x7f5768076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768076190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5760006010 tx=0x7f5760003c90 comp rx=0 tx=0).stop 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 shutdown_connections 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57540b6620 0x7f57540b8b30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57681094a0 0x7f5768075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5768109df0 0x7f5768076190 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 --2- 172.21.15.81:0/4003338136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5768103b60 0x7f5768075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 >> 172.21.15.81:0/4003338136 conn(0x7f576807b850 msgr2=0x7f57681075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 shutdown_connections 2024-09-21T03:00:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:04.307+0000 7f576e2c1640 1 -- 172.21.15.81:0/4003338136 wait complete. 2024-09-21T03:00:05.119 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T03:00:05.120 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:00:05.132 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T03:00:05.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T03:00:05.386 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:05.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:05 smithi181 ceph-mon[34096]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:05.507 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:05 smithi081 ceph-mon[30991]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:05.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:05 smithi164 ceph-mon[34236]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:05.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 -- 172.21.15.81:0/4122098427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9548102670 msgr2=0x7f9548102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:05.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 --2- 172.21.15.81:0/4122098427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9548102670 0x7f9548102ae0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9538009900 tx=0x7f953802a480 comp rx=0 tx=0).stop 2024-09-21T03:00:05.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 -- 172.21.15.81:0/4122098427 shutdown_connections 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 --2- 172.21.15.81:0/4122098427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103700 0x7f9548103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 --2- 172.21.15.81:0/4122098427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95481040a0 0x7f954810aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 --2- 172.21.15.81:0/4122098427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9548102670 0x7f9548102ae0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 -- 172.21.15.81:0/4122098427 >> 172.21.15.81:0/4122098427 conn(0x7f95480fdfe0 msgr2=0x7f9548100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 -- 172.21.15.81:0/4122098427 shutdown_connections 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.902+0000 7f954c98a640 1 -- 172.21.15.81:0/4122098427 wait complete. 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 Processor -- start 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 -- start start 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9548102670 0x7f9548197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:05.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103700 0x7f9548198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95481040a0 0x7f9548198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f954810d0c0 con 0x7f95481040a0 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f954810cf40 con 0x7f9548102670 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.903+0000 7f954c98a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f954810d240 con 0x7f9548103700 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95481040a0 0x7f9548198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95481040a0 0x7f9548198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53226/0 (socket says 172.21.15.81:53226) 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 -- 172.21.15.81:0/2164947152 learned_addr learned my addr 172.21.15.81:0/2164947152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f954659c640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9548102670 0x7f9548197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9545d9b640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103700 0x7f9548198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 -- 172.21.15.81:0/2164947152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103700 msgr2=0x7f9548198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103700 0x7f9548198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 -- 172.21.15.81:0/2164947152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9548102670 msgr2=0x7f9548197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9548102670 0x7f9548197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 -- 172.21.15.81:0/2164947152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9548199740 con 0x7f95481040a0 2024-09-21T03:00:05.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f9546d9d640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95481040a0 0x7f9548198fb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f954000cce0 tx=0x7f954000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f95377fe640 1 -- 172.21.15.81:0/2164947152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954000f450 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f95377fe640 1 -- 172.21.15.81:0/2164947152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f954000fa80 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.904+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9548199a30 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.905+0000 7f95377fe640 1 -- 172.21.15.81:0/2164947152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540018ad0 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.905+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954819fff0 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.906+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9548109850 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.907+0000 7f95377fe640 1 -- 172.21.15.81:0/2164947152 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f954000f5f0 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.908+0000 7f95377fe640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f95300b87b0 0x7f95300bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.908+0000 7f954659c640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f95300b87b0 0x7f95300bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.908+0000 7f95377fe640 1 -- 172.21.15.81:0/2164947152 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f95400e8050 con 0x7f95481040a0 2024-09-21T03:00:05.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.908+0000 7f954659c640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f95300b87b0 0x7f95300bacc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f95380057c0 tx=0x7f9538000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:05.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:05.911+0000 7f95377fe640 1 -- 172.21.15.81:0/2164947152 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9540014030 con 0x7f95481040a0 2024-09-21T03:00:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.107+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9548063800 con 0x7f95300b87b0 2024-09-21T03:00:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.108+0000 7f95377fe640 1 -- 172.21.15.81:0/2164947152 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9548063800 con 0x7f95300b87b0 2024-09-21T03:00:06.109 INFO:teuthology.orchestra.run.smithi081.stdout:Backend: cephadm 2024-09-21T03:00:06.109 INFO:teuthology.orchestra.run.smithi081.stdout:Available: Yes 2024-09-21T03:00:06.109 INFO:teuthology.orchestra.run.smithi081.stdout:Paused: No 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f95300b87b0 msgr2=0x7f95300bacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f95300b87b0 0x7f95300bacc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f95380057c0 tx=0x7f9538000bc0 comp rx=0 tx=0).stop 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95481040a0 msgr2=0x7f9548198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95481040a0 0x7f9548198fb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f954000cce0 tx=0x7f954000a620 comp rx=0 tx=0).stop 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 shutdown_connections 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f95300b87b0 0x7f95300bacc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9548103700 0x7f9548198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95481040a0 0x7f9548198fb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 --2- 172.21.15.81:0/2164947152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9548102670 0x7f9548197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 >> 172.21.15.81:0/2164947152 conn(0x7f95480fdfe0 msgr2=0x7f9548106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 shutdown_connections 2024-09-21T03:00:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:06.110+0000 7f954c98a640 1 -- 172.21.15.81:0/2164947152 wait complete. 2024-09-21T03:00:06.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T03:00:07.000 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:07.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:07 smithi081 ceph-mon[30991]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:00:07.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:07 smithi081 ceph-mon[30991]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 -- 172.21.15.81:0/356645778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d41040a0 msgr2=0x7f68d410aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:07.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 --2- 172.21.15.81:0/356645778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d41040a0 0x7f68d410aa40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009ca0 tx=0x7f68cc02a950 comp rx=0 tx=0).stop 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 -- 172.21.15.81:0/356645778 shutdown_connections 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 --2- 172.21.15.81:0/356645778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d41040a0 0x7f68d410aa40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 --2- 172.21.15.81:0/356645778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d4103700 0x7f68d4103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 --2- 172.21.15.81:0/356645778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68d4102670 0x7f68d4102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 -- 172.21.15.81:0/356645778 >> 172.21.15.81:0/356645778 conn(0x7f68d40fdfe0 msgr2=0x7f68d4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 -- 172.21.15.81:0/356645778 shutdown_connections 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.483+0000 7f68d8b92640 1 -- 172.21.15.81:0/356645778 wait complete. 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.484+0000 7f68d8b92640 1 Processor -- start 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.484+0000 7f68d8b92640 1 -- start start 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d8b92640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d4102670 0x7f68d406c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d8b92640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d4103700 0x7f68d419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d8b92640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68d41040a0 0x7f68d41a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d8b92640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410e150 con 0x7f68d4103700 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d8b92640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410dfd0 con 0x7f68d4102670 2024-09-21T03:00:07.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d8b92640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f68d410e2d0 con 0x7f68d41040a0 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d4103700 0x7f68d419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d4103700 0x7f68d419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53248/0 (socket says 172.21.15.81:53248) 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 -- 172.21.15.81:0/514500522 learned_addr learned my addr 172.21.15.81:0/514500522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d259c640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d4102670 0x7f68d406c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d2d9d640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68d41040a0 0x7f68d41a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 -- 172.21.15.81:0/514500522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68d41040a0 msgr2=0x7f68d41a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68d41040a0 0x7f68d41a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 -- 172.21.15.81:0/514500522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d4102670 msgr2=0x7f68d406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d4102670 0x7f68d406c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d1d9b640 1 -- 172.21.15.81:0/514500522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d41a1950 con 0x7f68d4103700 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.485+0000 7f68d2d9d640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68d41040a0 0x7f68d41a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.486+0000 7f68d1d9b640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d4103700 0x7f68d419ebe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00d950 tx=0x7f68bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.486+0000 7f68cb7fe640 1 -- 172.21.15.81:0/514500522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc017070 con 0x7f68d4103700 2024-09-21T03:00:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.486+0000 7f68cb7fe640 1 -- 172.21.15.81:0/514500522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68bc009c30 con 0x7f68d4103700 2024-09-21T03:00:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.486+0000 7f68cb7fe640 1 -- 172.21.15.81:0/514500522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00f620 con 0x7f68d4103700 2024-09-21T03:00:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.486+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d4198a10 con 0x7f68d4103700 2024-09-21T03:00:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.486+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d4198f00 con 0x7f68d4103700 2024-09-21T03:00:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.487+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d4109830 con 0x7f68d4103700 2024-09-21T03:00:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.489+0000 7f68cb7fe640 1 -- 172.21.15.81:0/514500522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f68bc010460 con 0x7f68d4103700 2024-09-21T03:00:07.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.490+0000 7f68cb7fe640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f68c00bab00 0x7f68c00bd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.491+0000 7f68d259c640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f68c00bab00 0x7f68c00bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.491+0000 7f68cb7fe640 1 -- 172.21.15.81:0/514500522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f68bc0e7300 con 0x7f68d4103700 2024-09-21T03:00:07.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.491+0000 7f68d259c640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f68c00bab00 0x7f68c00bd010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68c400bbe0 tx=0x7f68c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:07.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.494+0000 7f68cb7fe640 1 -- 172.21.15.81:0/514500522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68bc0ad7f0 con 0x7f68d4103700 2024-09-21T03:00:07.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:07 smithi181 ceph-mon[34096]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:00:07.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:07 smithi181 ceph-mon[34096]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.678+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f68d419a410 con 0x7f68c00bab00 2024-09-21T03:00:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:07 smithi164 ceph-mon[34236]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:00:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:07 smithi164 ceph-mon[34236]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.690+0000 7f68cb7fe640 1 -- 172.21.15.81:0/514500522 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f68d419a410 con 0x7f68c00bab00 2024-09-21T03:00:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T03:00:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:mds.a smithi081 running (2m) 54s ago 2m 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 34e6ee5b313a 2024-09-21T03:00:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:mds.b smithi164 running (2m) 55s ago 2m 96.3M - 19.3.0-5120-g18432218 ddce307e1f32 5f7a3c84ad26 2024-09-21T03:00:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:mds.c smithi181 running (2m) 55s ago 2m 84.0M - 19.3.0-5120-g18432218 ddce307e1f32 e50eaf792f76 2024-09-21T03:00:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:mds.d smithi081 running (2m) 54s ago 2m 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 9e701b94b302 2024-09-21T03:00:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:mds.e smithi164 running (2m) 55s ago 2m 83.0M - 19.3.0-5120-g18432218 ddce307e1f32 34763d1e3791 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mds.f smithi181 running (2m) 55s ago 2m 83.1M - 19.3.0-5120-g18432218 ddce307e1f32 dbb06427d565 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mds.g smithi081 running (2m) 54s ago 2m 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 c956db1e1f3c 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mds.h smithi164 running (2m) 55s ago 2m 84.9M - 19.3.0-5120-g18432218 ddce307e1f32 ce2bdcf938d1 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mds.i smithi181 running (2m) 55s ago 2m 87.6M - 19.3.0-5120-g18432218 ddce307e1f32 55aa1f22a1f8 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mds.j smithi081 running (2m) 54s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 909d0090824b 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mds.k smithi164 running (2m) 55s ago 2m 83.2M - 19.3.0-5120-g18432218 ddce307e1f32 6791a4ffbc4a 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mds.l smithi181 running (2m) 55s ago 2m 82.4M - 19.3.0-5120-g18432218 ddce307e1f32 06691b4986b0 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.x smithi081 *:9283,8765 running (10m) 54s ago 10m 592M - 19.3.0-5120-g18432218 ddce307e1f32 6f2af48afde9 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.y smithi164 *:8443,8765 running (8m) 55s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 5e49aeb60565 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.z smithi181 *:8443,8765 running (8m) 55s ago 8m 523M - 19.3.0-5120-g18432218 ddce307e1f32 429eb4bc9667 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a smithi081 running (10m) 54s ago 10m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 4868ece53fa7 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b smithi164 running (8m) 55s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 86da62be435b 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c smithi181 running (8m) 55s ago 8m 114M 2048M 19.3.0-5120-g18432218 ddce307e1f32 3737afef4436 2024-09-21T03:00:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (7m) 54s ago 7m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 7c84349b6475 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi164 running (7m) 55s ago 7m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9ea75220ac39 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi181 running (6m) 55s ago 6m 116M 4271M 19.3.0-5120-g18432218 ddce307e1f32 39e0dfca9448 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi081 running (6m) 54s ago 6m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 577853a4a5c0 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi164 running (5m) 55s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 40fb26253c80 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi181 running (5m) 55s ago 5m 120M 4271M 19.3.0-5120-g18432218 ddce307e1f32 f34a0daf3a9f 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 smithi081 running (4m) 54s ago 4m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 821aa6a8992a 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 smithi164 running (4m) 55s ago 4m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 941afe368919 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 smithi181 running (4m) 55s ago 4m 110M 4271M 19.3.0-5120-g18432218 ddce307e1f32 ae9c5e4f0577 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 smithi081 running (3m) 54s ago 3m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0069110a26c9 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 smithi164 running (3m) 55s ago 3m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 31ae8be22d41 2024-09-21T03:00:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 smithi181 running (2m) 55s ago 2m 118M 4271M 19.3.0-5120-g18432218 ddce307e1f32 36a499cfa971 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f68c00bab00 msgr2=0x7f68c00bd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f68c00bab00 0x7f68c00bd010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68c400bbe0 tx=0x7f68c400b390 comp rx=0 tx=0).stop 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d4103700 msgr2=0x7f68d419ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d4103700 0x7f68d419ebe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00d950 tx=0x7f68bc00de10 comp rx=0 tx=0).stop 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 shutdown_connections 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f68c00bab00 0x7f68c00bd010 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f68d41040a0 0x7f68d41a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d4103700 0x7f68d419ebe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 --2- 172.21.15.81:0/514500522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68d4102670 0x7f68d406c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 >> 172.21.15.81:0/514500522 conn(0x7f68d40fdfe0 msgr2=0x7f68d4106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 shutdown_connections 2024-09-21T03:00:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:07.693+0000 7f68d8b92640 1 -- 172.21.15.81:0/514500522 wait complete. 2024-09-21T03:00:08.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:08 smithi081 ceph-mon[30991]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:08.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:08 smithi181 ceph-mon[34096]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:08.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T03:00:08.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:08 smithi164 ceph-mon[34236]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 -- 172.21.15.81:0/3016795362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 msgr2=0x7f52d410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 --2- 172.21.15.81:0/3016795362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d410aa10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009ca0 tx=0x7f52cc02a950 comp rx=0 tx=0).stop 2024-09-21T03:00:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 -- 172.21.15.81:0/3016795362 shutdown_connections 2024-09-21T03:00:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 --2- 172.21.15.81:0/3016795362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d410aa10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 --2- 172.21.15.81:0/3016795362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52d41036d0 0x7f52d4103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 --2- 172.21.15.81:0/3016795362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52d4102640 0x7f52d4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 -- 172.21.15.81:0/3016795362 >> 172.21.15.81:0/3016795362 conn(0x7f52d40fdfb0 msgr2=0x7f52d4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 -- 172.21.15.81:0/3016795362 shutdown_connections 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 -- 172.21.15.81:0/3016795362 wait complete. 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.263+0000 7f52d8932640 1 Processor -- start 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d8932640 1 -- start start 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d8932640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52d4102640 0x7f52d406b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d8932640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52d41036d0 0x7f52d419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d8932640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d41a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d8932640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52d410e140 con 0x7f52d4104070 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d8932640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f52d410dfc0 con 0x7f52d4102640 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d8932640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f52d410e2c0 con 0x7f52d41036d0 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d41a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d41a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53254/0 (socket says 172.21.15.81:53254) 2024-09-21T03:00:09.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 -- 172.21.15.81:0/2553000193 learned_addr learned my addr 172.21.15.81:0/2553000193 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52cbfff640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52d41036d0 0x7f52d419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d259c640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52d4102640 0x7f52d406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 -- 172.21.15.81:0/2553000193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52d41036d0 msgr2=0x7f52d419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52d41036d0 0x7f52d419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 -- 172.21.15.81:0/2553000193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52d4102640 msgr2=0x7f52d406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52d4102640 0x7f52d406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 -- 172.21.15.81:0/2553000193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d41a1970 con 0x7f52d4104070 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52cbfff640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52d41036d0 0x7f52d419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.264+0000 7f52d2d9d640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d41a1150 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f52cc02f800 tx=0x7f52cc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.265+0000 7f52cb7fe640 1 -- 172.21.15.81:0/2553000193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc034040 con 0x7f52d4104070 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.265+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d41a1c00 con 0x7f52d4104070 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.265+0000 7f52cb7fe640 1 -- 172.21.15.81:0/2553000193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52cc030850 con 0x7f52d4104070 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.265+0000 7f52cb7fe640 1 -- 172.21.15.81:0/2553000193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc039430 con 0x7f52d4104070 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.265+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d41a2130 con 0x7f52d4104070 2024-09-21T03:00:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.266+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d4109820 con 0x7f52d4104070 2024-09-21T03:00:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.267+0000 7f52cb7fe640 1 -- 172.21.15.81:0/2553000193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f52cc037020 con 0x7f52d4104070 2024-09-21T03:00:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.268+0000 7f52cb7fe640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52c00b65a0 0x7f52c00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.268+0000 7f52d259c640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52c00b65a0 0x7f52c00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.268+0000 7f52cb7fe640 1 -- 172.21.15.81:0/2553000193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f52cc1088d0 con 0x7f52d4104070 2024-09-21T03:00:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.269+0000 7f52d259c640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52c00b65a0 0x7f52c00b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f52c4005fd0 tx=0x7f52c4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.277+0000 7f52cb7fe640 1 -- 172.21.15.81:0/2553000193 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52cc0cecc0 con 0x7f52d4104070 2024-09-21T03:00:09.453 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:09 smithi081 ceph-mon[30991]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:00:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.472+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f52d4063800 con 0x7f52c00b65a0 2024-09-21T03:00:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.478+0000 7f52cb7fe640 1 -- 172.21.15.81:0/2553000193 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f52d4063800 con 0x7f52c00b65a0 2024-09-21T03:00:09.479 INFO:teuthology.orchestra.run.smithi081.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T03:00:09.479 INFO:teuthology.orchestra.run.smithi081.stdout:mds.all 12/12 57s ago 2m smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi164=b;smithi164=e;smithi164=h;smithi164=k;smithi181=c;smithi181=f;smithi181=i;smithi181=l;count:12 2024-09-21T03:00:09.479 INFO:teuthology.orchestra.run.smithi081.stdout:mgr 3/3 57s ago 8m smithi081=x;smithi164=y;smithi181=z;count:3 2024-09-21T03:00:09.479 INFO:teuthology.orchestra.run.smithi081.stdout:mon 3/3 57s ago 8m smithi081:172.21.15.81=a;smithi164:172.21.15.164=b;smithi181:172.21.15.181=c;count:3 2024-09-21T03:00:09.479 INFO:teuthology.orchestra.run.smithi081.stdout:osd 12 57s ago - 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52c00b65a0 msgr2=0x7f52c00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52c00b65a0 0x7f52c00b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f52c4005fd0 tx=0x7f52c4005850 comp rx=0 tx=0).stop 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 msgr2=0x7f52d41a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d41a1150 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f52cc02f800 tx=0x7f52cc003f90 comp rx=0 tx=0).stop 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 shutdown_connections 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f52c00b65a0 0x7f52c00b8ab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f52d41036d0 0x7f52d419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52d4104070 0x7f52d41a1150 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 --2- 172.21.15.81:0/2553000193 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f52d4102640 0x7f52d406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 >> 172.21.15.81:0/2553000193 conn(0x7f52d40fdfb0 msgr2=0x7f52d41069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 shutdown_connections 2024-09-21T03:00:09.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:09.480+0000 7f52d8932640 1 -- 172.21.15.81:0/2553000193 wait complete. 2024-09-21T03:00:09.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:09 smithi181 ceph-mon[34096]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:00:09.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:09 smithi164 ceph-mon[34236]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:00:10.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:10 smithi081 ceph-mon[30991]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:10.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T03:00:10.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:10 smithi181 ceph-mon[34096]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:10.560 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:10.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:10 smithi164 ceph-mon[34236]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 -- 172.21.15.81:0/2920088479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 msgr2=0x7f0020104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 --2- 172.21.15.81:0/2920088479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f0020104c10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0008009900 tx=0x7f000802a480 comp rx=0 tx=0).stop 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 -- 172.21.15.81:0/2920088479 shutdown_connections 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 --2- 172.21.15.81:0/2920088479 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f00201051a0 0x7f002010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 --2- 172.21.15.81:0/2920088479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f0020104c10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 --2- 172.21.15.81:0/2920088479 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0020103770 0x7f0020103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 -- 172.21.15.81:0/2920088479 >> 172.21.15.81:0/2920088479 conn(0x7f00200ff0e0 msgr2=0x7f0020101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 -- 172.21.15.81:0/2920088479 shutdown_connections 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 -- 172.21.15.81:0/2920088479 wait complete. 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.059+0000 7f0026fad640 1 Processor -- start 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0026fad640 1 -- start start 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0026fad640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0020103770 0x7f0020199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0026fad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f002019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0026fad640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00201051a0 0x7f002019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0026fad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f002010f270 con 0x7f0020104800 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0026fad640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f002010f0f0 con 0x7f00201051a0 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0026fad640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f002010f3f0 con 0x7f0020103770 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f002019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f002019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53276/0 (socket says 172.21.15.81:53276) 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 -- 172.21.15.81:0/3080189504 learned_addr learned my addr 172.21.15.81:0/3080189504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f002554a640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00201051a0 0x7f002019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f0024d49640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0020103770 0x7f0020199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 -- 172.21.15.81:0/3080189504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0020103770 msgr2=0x7f0020199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0020103770 0x7f0020199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 -- 172.21.15.81:0/3080189504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00201051a0 msgr2=0x7f002019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00201051a0 0x7f002019b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 -- 172.21.15.81:0/3080189504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002019b900 con 0x7f0020104800 2024-09-21T03:00:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f002554a640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00201051a0 0x7f002019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:11.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.060+0000 7f001ffff640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f002019a540 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0008009230 tx=0x7f00080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:11.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.061+0000 7f001dffb640 1 -- 172.21.15.81:0/3080189504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000803f030 con 0x7f0020104800 2024-09-21T03:00:11.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.061+0000 7f001dffb640 1 -- 172.21.15.81:0/3080189504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0008003c90 con 0x7f0020104800 2024-09-21T03:00:11.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.061+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002019bb90 con 0x7f0020104800 2024-09-21T03:00:11.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.061+0000 7f001dffb640 1 -- 172.21.15.81:0/3080189504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008035070 con 0x7f0020104800 2024-09-21T03:00:11.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.061+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00201a2120 con 0x7f0020104800 2024-09-21T03:00:11.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.062+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002010a930 con 0x7f0020104800 2024-09-21T03:00:11.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.063+0000 7f001dffb640 1 -- 172.21.15.81:0/3080189504 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0008042030 con 0x7f0020104800 2024-09-21T03:00:11.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.064+0000 7f001dffb640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f000c0b65a0 0x7f000c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:11.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.064+0000 7f0024d49640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f000c0b65a0 0x7f000c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:11.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.064+0000 7f001dffb640 1 -- 172.21.15.81:0/3080189504 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f00081082f0 con 0x7f0020104800 2024-09-21T03:00:11.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.065+0000 7f0024d49640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f000c0b65a0 0x7f000c0b8ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0010005c40 tx=0x7f0010008230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:11.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.068+0000 7f001dffb640 1 -- 172.21.15.81:0/3080189504 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00080ce6e0 con 0x7f0020104800 2024-09-21T03:00:11.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.252+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f0020063800 con 0x7f000c0b65a0 2024-09-21T03:00:11.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.254+0000 7f001dffb640 1 -- 172.21.15.81:0/3080189504 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f0020063800 con 0x7f000c0b65a0 2024-09-21T03:00:11.257 INFO:teuthology.orchestra.run.smithi081.stdout:HOST ADDR LABELS STATUS 2024-09-21T03:00:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 172.21.15.81 2024-09-21T03:00:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:smithi164 172.21.15.164 2024-09-21T03:00:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:smithi181 172.21.15.181 2024-09-21T03:00:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:3 hosts in cluster 2024-09-21T03:00:11.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f000c0b65a0 msgr2=0x7f000c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f000c0b65a0 0x7f000c0b8ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0010005c40 tx=0x7f0010008230 comp rx=0 tx=0).stop 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 msgr2=0x7f002019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f002019a540 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0008009230 tx=0x7f00080042f0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 shutdown_connections 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f000c0b65a0 0x7f000c0b8ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00201051a0 0x7f002019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0020104800 0x7f002019a540 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 --2- 172.21.15.81:0/3080189504 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0020103770 0x7f0020199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 >> 172.21.15.81:0/3080189504 conn(0x7f00200ff0e0 msgr2=0x7f0020107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 shutdown_connections 2024-09-21T03:00:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:11.256+0000 7f0026fad640 1 -- 172.21.15.81:0/3080189504 wait complete. 2024-09-21T03:00:11.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:11 smithi181 ceph-mon[34096]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:11.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:11 smithi081 ceph-mon[30991]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:11 smithi164 ceph-mon[34236]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:12.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T03:00:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:12.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:12 smithi081 ceph-mon[30991]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:12.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:12 smithi181 ceph-mon[34096]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:12.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:12 smithi164 ceph-mon[34236]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 -- 172.21.15.81:0/1232977413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141036e0 msgr2=0x7f1c14103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 --2- 172.21.15.81:0/1232977413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141036e0 0x7f1c14103af0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009900 tx=0x7f1c0802a480 comp rx=0 tx=0).stop 2024-09-21T03:00:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 -- 172.21.15.81:0/1232977413 shutdown_connections 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 --2- 172.21.15.81:0/1232977413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c14104080 0x7f1c1410aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 --2- 172.21.15.81:0/1232977413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c141036e0 0x7f1c14103af0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 --2- 172.21.15.81:0/1232977413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c14102650 0x7f1c14102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 -- 172.21.15.81:0/1232977413 >> 172.21.15.81:0/1232977413 conn(0x7f1c140fdfe0 msgr2=0x7f1c14100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 -- 172.21.15.81:0/1232977413 shutdown_connections 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 -- 172.21.15.81:0/1232977413 wait complete. 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 Processor -- start 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.692+0000 7f1c1adda640 1 -- start start 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c1adda640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c14102650 0x7f1c1406c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c1adda640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c141036e0 0x7f1c1419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c1adda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c14104080 0x7f1c141a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c1adda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1410e130 con 0x7f1c14104080 2024-09-21T03:00:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c1adda640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1410dfb0 con 0x7f1c141036e0 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c1adda640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1410e2b0 con 0x7f1c14102650 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c14104080 0x7f1c141a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c14104080 0x7f1c141a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39452/0 (socket says 172.21.15.81:39452) 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 -- 172.21.15.81:0/4027458739 learned_addr learned my addr 172.21.15.81:0/4027458739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c18b76640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c14102650 0x7f1c1406c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c13fff640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c141036e0 0x7f1c1419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 -- 172.21.15.81:0/4027458739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c14102650 msgr2=0x7f1c1406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c14102650 0x7f1c1406c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 -- 172.21.15.81:0/4027458739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c141036e0 msgr2=0x7f1c1419ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c141036e0 0x7f1c1419ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 -- 172.21.15.81:0/4027458739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c141a19c0 con 0x7f1c14104080 2024-09-21T03:00:12.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c19377640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c14104080 0x7f1c141a11a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00eb10 tx=0x7f1c0c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:12.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.693+0000 7f1c11ffb640 1 -- 172.21.15.81:0/4027458739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c004b20 con 0x7f1c14104080 2024-09-21T03:00:12.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.694+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c141a1cb0 con 0x7f1c14104080 2024-09-21T03:00:12.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.694+0000 7f1c11ffb640 1 -- 172.21.15.81:0/4027458739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c0c004cc0 con 0x7f1c14104080 2024-09-21T03:00:12.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.694+0000 7f1c11ffb640 1 -- 172.21.15.81:0/4027458739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c010690 con 0x7f1c14104080 2024-09-21T03:00:12.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.694+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c141a21a0 con 0x7f1c14104080 2024-09-21T03:00:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.695+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c14109830 con 0x7f1c14104080 2024-09-21T03:00:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.696+0000 7f1c11ffb640 1 -- 172.21.15.81:0/4027458739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1c0c005000 con 0x7f1c14104080 2024-09-21T03:00:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.697+0000 7f1c11ffb640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bfc0b65a0 0x7f1bfc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.697+0000 7f1c18b76640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bfc0b65a0 0x7f1bfc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.697+0000 7f1c11ffb640 1 -- 172.21.15.81:0/4027458739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1c0c0e8000 con 0x7f1c14104080 2024-09-21T03:00:12.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.697+0000 7f1c18b76640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bfc0b65a0 0x7f1bfc0b8ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c04005d00 tx=0x7f1c0400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:12.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.700+0000 7f1c11ffb640 1 -- 172.21.15.81:0/4027458739 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c0c056710 con 0x7f1c14104080 2024-09-21T03:00:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.884+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f1c14063800 con 0x7f1bfc0b65a0 2024-09-21T03:00:12.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.886+0000 7f1c11ffb640 1 -- 172.21.15.81:0/4027458739 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f1c14063800 con 0x7f1bfc0b65a0 2024-09-21T03:00:12.890 INFO:teuthology.orchestra.run.smithi081.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T03:00:12.890 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T03:00:12.890 INFO:teuthology.orchestra.run.smithi081.stdout:smithi164 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300H0400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T03:00:12.890 INFO:teuthology.orchestra.run.smithi081.stdout:smithi181 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000E400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bfc0b65a0 msgr2=0x7f1bfc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bfc0b65a0 0x7f1bfc0b8ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c04005d00 tx=0x7f1c0400b410 comp rx=0 tx=0).stop 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c14104080 msgr2=0x7f1c141a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c14104080 0x7f1c141a11a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00eb10 tx=0x7f1c0c00c2d0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 shutdown_connections 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1bfc0b65a0 0x7f1bfc0b8ab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c14104080 0x7f1c141a11a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c141036e0 0x7f1c1419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 --2- 172.21.15.81:0/4027458739 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1c14102650 0x7f1c1406c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:12.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 >> 172.21.15.81:0/4027458739 conn(0x7f1c140fdfe0 msgr2=0x7f1c14106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:12.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.888+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 shutdown_connections 2024-09-21T03:00:12.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:12.889+0000 7f1c1adda640 1 -- 172.21.15.81:0/4027458739 wait complete. 2024-09-21T03:00:13.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:13 smithi181 ceph-mon[34096]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:00:13.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:13 smithi081 ceph-mon[30991]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:00:13.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:13 smithi164 ceph-mon[34236]: pgmap v354: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:00:13.711 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:00:13.720 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T03:00:13.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T03:00:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:14.365 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:14 smithi164 ceph-mon[34236]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:14.365 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:14 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:00:14.404 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:14 smithi081 ceph-mon[30991]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:14.404 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:14 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:00:14.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:14 smithi181 ceph-mon[34096]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:00:14.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:14 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:00:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.492+0000 7f9ff1249640 1 -- 172.21.15.81:0/3286008313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 msgr2=0x7f9fec1032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.492+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3286008313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec1032a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009ca0 tx=0x7f9fe002a950 comp rx=0 tx=0).stop 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 -- 172.21.15.81:0/3286008313 shutdown_connections 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3286008313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fec103830 0x7f9fec10a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3286008313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec1032a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3286008313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec101e00 0x7f9fec102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 -- 172.21.15.81:0/3286008313 >> 172.21.15.81:0/3286008313 conn(0x7f9fec0fd770 msgr2=0x7f9fec0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 -- 172.21.15.81:0/3286008313 shutdown_connections 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 -- 172.21.15.81:0/3286008313 wait complete. 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.493+0000 7f9ff1249640 1 Processor -- start 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9ff1249640 1 -- start start 2024-09-21T03:00:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9ff1249640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fec101e00 0x7f9fec199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9ff1249640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9ff1249640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec103830 0x7f9fec19b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9ff1249640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10f290 con 0x7f9fec102e90 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9ff1249640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10f110 con 0x7f9fec101e00 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9ff1249640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10f410 con 0x7f9fec103830 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39480/0 (socket says 172.21.15.81:39480) 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 -- 172.21.15.81:0/3845467488 learned_addr learned my addr 172.21.15.81:0/3845467488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fead9d640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fec101e00 0x7f9fec199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9feb59e640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec103830 0x7f9fec19b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 -- 172.21.15.81:0/3845467488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec103830 msgr2=0x7f9fec19b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec103830 0x7f9fec19b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 -- 172.21.15.81:0/3845467488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fec101e00 msgr2=0x7f9fec199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:14.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fec101e00 0x7f9fec199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 -- 172.21.15.81:0/3845467488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec19b910 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9feb59e640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec103830 0x7f9fec19b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fead9d640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fec101e00 0x7f9fec199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.494+0000 7f9fea59c640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec19a550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0032000 tx=0x7f9fe0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.495+0000 7f9fd3fff640 1 -- 172.21.15.81:0/3845467488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0034040 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.495+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec19bba0 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.495+0000 7f9fd3fff640 1 -- 172.21.15.81:0/3845467488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fe0030850 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.495+0000 7f9fd3fff640 1 -- 172.21.15.81:0/3845467488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0004720 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.495+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec1a2130 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.496+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fec108fe0 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.497+0000 7f9fd3fff640 1 -- 172.21.15.81:0/3845467488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9fe0037020 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.498+0000 7f9fd3fff640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9fd40b65a0 0x7f9fd40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.498+0000 7f9fead9d640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9fd40b65a0 0x7f9fd40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.498+0000 7f9fd3fff640 1 -- 172.21.15.81:0/3845467488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f9fe01087c0 con 0x7f9fec102e90 2024-09-21T03:00:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.498+0000 7f9fead9d640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9fd40b65a0 0x7f9fd40b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc005d00 tx=0x7f9fdc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.502+0000 7f9fd3fff640 1 -- 172.21.15.81:0/3845467488 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9fe00cebb0 con 0x7f9fec102e90 2024-09-21T03:00:14.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.723+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9fec02e640 con 0x7f9fec102e90 2024-09-21T03:00:14.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.724+0000 7f9fd3fff640 1 -- 172.21.15.81:0/3845467488 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3096 (secure 0 0 0) 0x7f9fe00d2f90 con 0x7f9fec102e90 2024-09-21T03:00:14.725 INFO:teuthology.orchestra.run.smithi081.stdout:e24 2024-09-21T03:00:14.725 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-21T02:58:54:243506+0000 2024-09-21T03:00:14.725 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:00:14.725 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 24 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-21T02:58:15.629942+0000 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-21T02:58:53.899125+0000 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 300 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-21T03:00:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 3 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1,2 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=24599,1=24572,2=24568} 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3,4] 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-21T03:00:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 0 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 24599 members: 24568,24572,24599 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b{0:24599} state up:active seq 4 addr [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c{0:24553} state up:standby-replay seq 1 addr [v2:172.21.15.181:6836/3046788185,v1:172.21.15.181:6837/3046788185] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.h{1:24572} state up:active seq 16 addr [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.e{1:24551} state up:standby-replay seq 1 addr [v2:172.21.15.164:6834/1947556688,v1:172.21.15.164:6835/1947556688] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.i{2:24568} state up:active seq 15 addr [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.f{2:24547} state up:standby-replay seq 1 addr [v2:172.21.15.181:6834/3990133631,v1:172.21.15.181:6835/3990133631] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.j{-1:14712} state up:standby seq 1 addr [v2:172.21.15.81:6834/2295096585,v1:172.21.15.81:6835/2295096585] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d{-1:14724} state up:standby seq 1 addr [v2:172.21.15.81:6836/982276876,v1:172.21.15.81:6837/982276876] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.g{-1:14781} state up:standby seq 1 addr [v2:172.21.15.81:6838/1201929574,v1:172.21.15.81:6839/1201929574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a{-1:14793} state up:standby seq 1 addr [v2:172.21.15.81:6840/1840355403,v1:172.21.15.81:6841/1840355403] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.l{-1:24520} state up:standby seq 1 addr [v2:172.21.15.181:6832/2510878090,v1:172.21.15.181:6833/2510878090] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.k{-1:24527} state up:standby seq 1 addr [v2:172.21.15.164:6832/2052229726,v1:172.21.15.164:6833/2052229726] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9fd40b65a0 msgr2=0x7f9fd40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9fd40b65a0 0x7f9fd40b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc005d00 tx=0x7f9fdc00b410 comp rx=0 tx=0).stop 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 msgr2=0x7f9fec19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec19a550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0032000 tx=0x7f9fe0003ce0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 shutdown_connections 2024-09-21T03:00:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9fd40b65a0 0x7f9fd40b8ab0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fec103830 0x7f9fec19b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec102e90 0x7f9fec19a550 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 --2- 172.21.15.81:0/3845467488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fec101e00 0x7f9fec199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 >> 172.21.15.81:0/3845467488 conn(0x7f9fec0fd770 msgr2=0x7f9fec1061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 shutdown_connections 2024-09-21T03:00:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:14.726+0000 7f9ff1249640 1 -- 172.21.15.81:0/3845467488 wait complete. 2024-09-21T03:00:15.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:15 smithi181 ceph-mon[34096]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:15 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3845467488' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:00:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:15 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:15 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:15 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:15 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:15 smithi081 ceph-mon[30991]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:15.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:15 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3845467488' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:00:15.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:15 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:15 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:15 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:15 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:15 smithi164 ceph-mon[34236]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:00:15.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:15 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3845467488' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:00:15.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:15 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:15 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:15 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:15 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:15.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T03:00:16.239 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:16.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/207488613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b48102cd0 msgr2=0x7f0b48105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:16.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/207488613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b48102cd0 0x7f0b48105150 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009900 tx=0x7f0b3802a3f0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/207488613 shutdown_connections 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/207488613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b481083b0 0x7f0b4810a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/207488613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48105790 0x7f0b48107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/207488613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b48102cd0 0x7f0b48105150 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/207488613 >> 172.21.15.81:0/207488613 conn(0x7f0b480fd770 msgr2=0x7f0b480ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/207488613 shutdown_connections 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.750+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/207488613 wait complete. 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 Processor -- start 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 -- start start 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b48102cd0 0x7f0b4810a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48105790 0x7f0b481089a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b481083b0 0x7f0b48108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4810e140 con 0x7f0b481083b0 2024-09-21T03:00:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4810dfc0 con 0x7f0b48105790 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4f2b1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4810e2c0 con 0x7f0b48102cd0 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4d84e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b481083b0 0x7f0b48108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4d84e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b481083b0 0x7f0b48108ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39510/0 (socket says 172.21.15.81:39510) 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4d84e640 1 -- 172.21.15.81:0/3172300770 learned_addr learned my addr 172.21.15.81:0/3172300770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.751+0000 7f0b4c84c640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48105790 0x7f0b481089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d04d640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b48102cd0 0x7f0b4810a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d84e640 1 -- 172.21.15.81:0/3172300770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b48102cd0 msgr2=0x7f0b4810a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d84e640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b48102cd0 0x7f0b4810a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d84e640 1 -- 172.21.15.81:0/3172300770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48105790 msgr2=0x7f0b481089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d84e640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48105790 0x7f0b481089a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d84e640 1 -- 172.21.15.81:0/3172300770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b48109550 con 0x7f0b481083b0 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d04d640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b48102cd0 0x7f0b4810a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4c84c640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48105790 0x7f0b481089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4d84e640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b481083b0 0x7f0b48108ee0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000cce0 tx=0x7f0b4000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b3e7fc640 1 -- 172.21.15.81:0/3172300770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000f450 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b3e7fc640 1 -- 172.21.15.81:0/3172300770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b4000fa80 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b481a3fa0 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b3e7fc640 1 -- 172.21.15.81:0/3172300770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40018ad0 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.752+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b481a4340 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.753+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b481a4570 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.755+0000 7f0b3e7fc640 1 -- 172.21.15.81:0/3172300770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0b4000f5f0 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.756+0000 7f0b3e7fc640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0b340b65a0 0x7f0b340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.756+0000 7f0b4d04d640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0b340b65a0 0x7f0b340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.756+0000 7f0b3e7fc640 1 -- 172.21.15.81:0/3172300770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f0b400e8110 con 0x7f0b481083b0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.756+0000 7f0b4d04d640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0b340b65a0 0x7f0b340b8ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0b38005f70 tx=0x7f0b38000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.759+0000 7f0b3e7fc640 1 -- 172.21.15.81:0/3172300770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b40014030 con 0x7f0b481083b0 2024-09-21T03:00:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.964+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f0b481a4740 con 0x7f0b481083b0 2024-09-21T03:00:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.966+0000 7f0b3e7fc640 1 -- 172.21.15.81:0/3172300770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5587 (secure 0 0 0) 0x7f0b400ae590 con 0x7f0b481083b0 2024-09-21T03:00:16.967 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 82 2024-09-21T03:00:16.967 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T03:00:16.967 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-21T02:49:53.486319+0000 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-21T02:58:49.219446+0000 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:crush_version 27 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:full_ratio 0.95 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:backfillfull_ratio 0.9 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:nearfull_ratio 0.85 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:require_min_compat_client luminous 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:min_compat_client luminous 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:require_osd_release squid 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:stretch_mode_enabled false 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T03:00:16.968 INFO:teuthology.orchestra.run.smithi081.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:max_osd 12 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6802/2217822752,v1:172.21.15.81:6803/2217822752] [v2:172.21.15.81:6804/2217822752,v1:172.21.15.81:6805/2217822752] exists,up 28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/2618567246,v1:172.21.15.164:6801/2618567246] [v2:172.21.15.164:6802/2618567246,v1:172.21.15.164:6803/2618567246] exists,up 0eb4ea10-4d33-4614-b945-babb11aac5d4 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 up in weight 1 up_from 17 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/1768571017,v1:172.21.15.181:6801/1768571017] [v2:172.21.15.181:6802/1768571017,v1:172.21.15.181:6803/1768571017] exists,up de365a9b-3533-47fe-8660-2febee4ea04d 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 up in weight 1 up_from 24 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6810/2282791523,v1:172.21.15.81:6811/2282791523] [v2:172.21.15.81:6812/2282791523,v1:172.21.15.81:6813/2282791523] exists,up 1a2e3786-f58f-4cad-b61e-404b2d7da8f1 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 up in weight 1 up_from 30 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6808/1406616378,v1:172.21.15.164:6809/1406616378] [v2:172.21.15.164:6810/1406616378,v1:172.21.15.164:6811/1406616378] exists,up 9e7883d2-d336-454f-b035-5cdaf8cf6d81 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 up in weight 1 up_from 35 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6808/3082949171,v1:172.21.15.181:6809/3082949171] [v2:172.21.15.181:6810/3082949171,v1:172.21.15.181:6811/3082949171] exists,up 510f6ee6-d0cb-4d53-959f-f3fdb5875218 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 up in weight 1 up_from 41 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6818/3031456716,v1:172.21.15.81:6819/3031456716] [v2:172.21.15.81:6820/3031456716,v1:172.21.15.81:6821/3031456716] exists,up 6070ee30-62b8-4773-9031-357aef41a66b 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 up in weight 1 up_from 46 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6816/2193157365,v1:172.21.15.164:6817/2193157365] [v2:172.21.15.164:6818/2193157365,v1:172.21.15.164:6819/2193157365] exists,up 86891d46-f33c-4a5f-a736-373042a6b9c5 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 up in weight 1 up_from 51 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6816/3075845600,v1:172.21.15.181:6817/3075845600] [v2:172.21.15.181:6818/3075845600,v1:172.21.15.181:6819/3075845600] exists,up ceaa3ef3-df5f-4349-8798-cd94dc9f8610 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 up in weight 1 up_from 57 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6826/3125475074,v1:172.21.15.81:6827/3125475074] [v2:172.21.15.81:6828/3125475074,v1:172.21.15.81:6829/3125475074] exists,up 9b8dcc89-4e4a-4834-9953-d7dfc14fa192 2024-09-21T03:00:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6824/1437229316,v1:172.21.15.164:6825/1437229316] [v2:172.21.15.164:6826/1437229316,v1:172.21.15.164:6827/1437229316] exists,up f305743b-43b9-4558-95da-9c59836d2655 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 up in weight 1 up_from 68 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6824/1957538335,v1:172.21.15.181:6825/1957538335] [v2:172.21.15.181:6826/1957538335,v1:172.21.15.181:6827/1957538335] exists,up ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.8 [2,11] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.1d [8,11] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.3 [4,9] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.11 [5,9] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.3c [4,9] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.10 [9,10] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.11 [5,8] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.13 [9,8] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 4.1b [9,8] 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/3359413677 expires 2024-09-22T02:50:47.609507+0000 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/677187629 expires 2024-09-22T02:50:47.609507+0000 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2658968302 expires 2024-09-22T02:50:47.609507+0000 2024-09-21T03:00:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/677187629 expires 2024-09-22T02:50:47.609507+0000 2024-09-21T03:00:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/3217567960 expires 2024-09-22T02:50:22.009612+0000 2024-09-21T03:00:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/3217567960 expires 2024-09-22T02:50:22.009612+0000 2024-09-21T03:00:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2305526484 expires 2024-09-22T02:50:22.009612+0000 2024-09-21T03:00:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/837683568 expires 2024-09-22T02:50:22.009612+0000 2024-09-21T03:00:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2720123143 expires 2024-09-22T02:50:47.609507+0000 2024-09-21T03:00:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/83784468 expires 2024-09-22T02:50:22.009612+0000 2024-09-21T03:00:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0b340b65a0 msgr2=0x7f0b340b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0b340b65a0 0x7f0b340b8ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0b38005f70 tx=0x7f0b38000bc0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b481083b0 msgr2=0x7f0b48108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b481083b0 0x7f0b48108ee0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000cce0 tx=0x7f0b4000a620 comp rx=0 tx=0).stop 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 shutdown_connections 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0b340b65a0 0x7f0b340b8ab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b481083b0 0x7f0b48108ee0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b48105790 0x7f0b481089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 --2- 172.21.15.81:0/3172300770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b48102cd0 0x7f0b4810a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 >> 172.21.15.81:0/3172300770 conn(0x7f0b480fd770 msgr2=0x7f0b481079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 shutdown_connections 2024-09-21T03:00:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:16.968+0000 7f0b4f2b1640 1 -- 172.21.15.81:0/3172300770 wait complete. 2024-09-21T03:00:17.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:17 smithi181 ceph-mon[34096]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:00:17.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:17 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3172300770' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:00:17.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:17 smithi081 ceph-mon[30991]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:00:17.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:17 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3172300770' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:00:17.672 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T03:00:17.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:00:17.684 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:17 smithi164 ceph-mon[34236]: pgmap v356: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:00:17.684 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:17 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3172300770' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:00:17.979 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:18.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:00:18.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:00:18.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 -- 172.21.15.81:0/2764684110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec102b40 msgr2=0x7f04ec102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 --2- 172.21.15.81:0/2764684110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec102b40 0x7f04ec102f50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009900 tx=0x7f04e002a410 comp rx=0 tx=0).stop 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 -- 172.21.15.81:0/2764684110 shutdown_connections 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 --2- 172.21.15.81:0/2764684110 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04ec108dd0 0x7f04ec10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 --2- 172.21.15.81:0/2764684110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04ec108480 0x7f04ec108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 --2- 172.21.15.81:0/2764684110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec102b40 0x7f04ec102f50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 -- 172.21.15.81:0/2764684110 >> 172.21.15.81:0/2764684110 conn(0x7f04ec079750 msgr2=0x7f04ec079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 -- 172.21.15.81:0/2764684110 shutdown_connections 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.526+0000 7f04f2e27640 1 -- 172.21.15.81:0/2764684110 wait complete. 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 Processor -- start 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 -- start start 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04ec102b40 0x7f04ec19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04ec108480 0x7f04ec19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec108dd0 0x7f04ec19fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec112850 con 0x7f04ec108dd0 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec1126d0 con 0x7f04ec102b40 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.527+0000 7f04f2e27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec1129d0 con 0x7f04ec108480 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec108dd0 0x7f04ec19fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec108dd0 0x7f04ec19fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39536/0 (socket says 172.21.15.81:39536) 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 -- 172.21.15.81:0/317796374 learned_addr learned my addr 172.21.15.81:0/317796374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04ebfff640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04ec108480 0x7f04ec19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f0bc3640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04ec102b40 0x7f04ec19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 -- 172.21.15.81:0/317796374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04ec108480 msgr2=0x7f04ec19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04ec108480 0x7f04ec19a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 -- 172.21.15.81:0/317796374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04ec102b40 msgr2=0x7f04ec19a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04ec102b40 0x7f04ec19a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 -- 172.21.15.81:0/317796374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ec1a02c0 con 0x7f04ec108dd0 2024-09-21T03:00:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f13c4640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec108dd0 0x7f04ec19fb90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f04e400eaa0 tx=0x7f04e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04e9ffb640 1 -- 172.21.15.81:0/317796374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400cdb0 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04e9ffb640 1 -- 172.21.15.81:0/317796374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04e4005020 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ec1a05b0 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.528+0000 7f04e9ffb640 1 -- 172.21.15.81:0/317796374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40116d0 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.529+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ec1a6d10 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.530+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ec103dc0 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.531+0000 7f04e9ffb640 1 -- 172.21.15.81:0/317796374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f04e40051d0 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.531+0000 7f04e9ffb640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f04dc0b65a0 0x7f04dc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.532+0000 7f04f0bc3640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f04dc0b65a0 0x7f04dc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.532+0000 7f04e9ffb640 1 -- 172.21.15.81:0/317796374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f04e40e78d0 con 0x7f04ec108dd0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.532+0000 7f04f0bc3640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f04dc0b65a0 0x7f04dc0b8ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04e00057c0 tx=0x7f04e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.536+0000 7f04e9ffb640 1 -- 172.21.15.81:0/317796374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04e4016030 con 0x7f04ec108dd0 2024-09-21T03:00:18.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:00:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:00:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:00:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:00:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:00:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.750+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04ec19b480 con 0x7f04ec108dd0 2024-09-21T03:00:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.751+0000 7f04e9ffb640 1 -- 172.21.15.81:0/317796374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7f04e40b20a0 con 0x7f04ec108dd0 2024-09-21T03:00:18.753 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:18.753 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-21T02:58:54:243506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:53.899125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T03:00:18.753 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-21T03:00:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f04dc0b65a0 msgr2=0x7f04dc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f04dc0b65a0 0x7f04dc0b8ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04e00057c0 tx=0x7f04e00058d0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec108dd0 msgr2=0x7f04ec19fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec108dd0 0x7f04ec19fb90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f04e400eaa0 tx=0x7f04e400ef60 comp rx=0 tx=0).stop 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 shutdown_connections 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f04dc0b65a0 0x7f04dc0b8ab0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04ec108480 0x7f04ec19a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04ec108dd0 0x7f04ec19fb90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 --2- 172.21.15.81:0/317796374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04ec102b40 0x7f04ec19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 >> 172.21.15.81:0/317796374 conn(0x7f04ec079750 msgr2=0x7f04ec106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 shutdown_connections 2024-09-21T03:00:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:18.754+0000 7f04f2e27640 1 -- 172.21.15.81:0/317796374 wait complete. 2024-09-21T03:00:19.427 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:19 smithi081 ceph-mon[30991]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:00:19.427 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:19 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/317796374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:19.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:00:19.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:19 smithi164 ceph-mon[34236]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:00:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:19 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/317796374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:19.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:19 smithi181 ceph-mon[34096]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:00:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:19 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/317796374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 -- 172.21.15.81:0/3444227968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc1049e0 msgr2=0x7ffadc104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 --2- 172.21.15.81:0/3444227968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc1049e0 0x7ffadc104df0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009900 tx=0x7ffad002a410 comp rx=0 tx=0).stop 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 -- 172.21.15.81:0/3444227968 shutdown_connections 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 --2- 172.21.15.81:0/3444227968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffadc105330 0x7ffadc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 --2- 172.21.15.81:0/3444227968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffadc10de40 0x7ffadc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 --2- 172.21.15.81:0/3444227968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc1049e0 0x7ffadc104df0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 -- 172.21.15.81:0/3444227968 >> 172.21.15.81:0/3444227968 conn(0x7ffadc079750 msgr2=0x7ffadc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 -- 172.21.15.81:0/3444227968 shutdown_connections 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.203+0000 7ffae0d67640 1 -- 172.21.15.81:0/3444227968 wait complete. 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.204+0000 7ffae0d67640 1 Processor -- start 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.204+0000 7ffae0d67640 1 -- start start 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffae0d67640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffadc1049e0 0x7ffadc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffae0d67640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffadc105330 0x7ffadc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffae0d67640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc10de40 0x7ffadc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffae0d67640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc113970 con 0x7ffadc10de40 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffae0d67640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc1137f0 con 0x7ffadc1049e0 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffae0d67640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc113af0 con 0x7ffadc105330 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc10de40 0x7ffadc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc10de40 0x7ffadc19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39548/0 (socket says 172.21.15.81:39548) 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 -- 172.21.15.81:0/300013691 learned_addr learned my addr 172.21.15.81:0/300013691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffada59c640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffadc1049e0 0x7ffadc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffad9d9b640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffadc105330 0x7ffadc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 -- 172.21.15.81:0/300013691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffadc105330 msgr2=0x7ffadc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffadc105330 0x7ffadc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 -- 172.21.15.81:0/300013691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffadc1049e0 msgr2=0x7ffadc19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffadc1049e0 0x7ffadc19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 -- 172.21.15.81:0/300013691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffadc1a0430 con 0x7ffadc10de40 2024-09-21T03:00:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffad9d9b640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffadc105330 0x7ffadc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffadad9d640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc10de40 0x7ffadc19fd00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffad400eaa0 tx=0x7ffad400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad400cdb0 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffadc1a0720 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffad4005020 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.205+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad40116d0 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.206+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffadc1a6e80 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.206+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffadc06c280 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.208+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ffad40051d0 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.209+0000 7ffacb7fe640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffac40b65a0 0x7ffac40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.209+0000 7ffada59c640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffac40b65a0 0x7ffac40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.209+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ffad40e7d30 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.209+0000 7ffada59c640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffac40b65a0 0x7ffac40b8ab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffad0004770 tx=0x7ffad00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.212+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffad4016030 con 0x7ffadc10de40 2024-09-21T03:00:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.297+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ffad40a9c90 con 0x7ffadc10de40 2024-09-21T03:00:20.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.432+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffadc104df0 con 0x7ffadc10de40 2024-09-21T03:00:20.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.433+0000 7ffacb7fe640 1 -- 172.21.15.81:0/300013691 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7ffadc104df0 con 0x7ffadc10de40 2024-09-21T03:00:20.434 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:20.434 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-21T02:58:54:243506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T02:58:53.899125+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T03:00:20.435 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-21T03:00:20.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffac40b65a0 msgr2=0x7ffac40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:20.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffac40b65a0 0x7ffac40b8ab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffad0004770 tx=0x7ffad00058d0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc10de40 msgr2=0x7ffadc19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc10de40 0x7ffadc19fd00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffad400eaa0 tx=0x7ffad400ef60 comp rx=0 tx=0).stop 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 shutdown_connections 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ffac40b65a0 0x7ffac40b8ab0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffadc105330 0x7ffadc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffadc10de40 0x7ffadc19fd00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 --2- 172.21.15.81:0/300013691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffadc1049e0 0x7ffadc19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 >> 172.21.15.81:0/300013691 conn(0x7ffadc079750 msgr2=0x7ffadc0ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 shutdown_connections 2024-09-21T03:00:20.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:20.435+0000 7ffae0d67640 1 -- 172.21.15.81:0/300013691 wait complete. 2024-09-21T03:00:21.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:00:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:21.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:21 smithi081 ceph-mon[30991]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:00:21.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:21 smithi081 ceph-mon[30991]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T03:00:21.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:21 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/300013691' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:21.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:21 smithi164 ceph-mon[34236]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:00:21.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:21 smithi164 ceph-mon[34236]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T03:00:21.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:21 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/300013691' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:21.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:21 smithi181 ceph-mon[34096]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:00:21.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:21 smithi181 ceph-mon[34096]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T03:00:21.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:21 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/300013691' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 -- 172.21.15.81:0/4044951146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 msgr2=0x7f108c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 --2- 172.21.15.81:0/4044951146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c110620 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1084009ca0 tx=0x7f108402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 -- 172.21.15.81:0/4044951146 shutdown_connections 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 --2- 172.21.15.81:0/4044951146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c110620 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 --2- 172.21.15.81:0/4044951146 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c1094a0 0x7f108c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 --2- 172.21.15.81:0/4044951146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f108c103b60 0x7f108c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 -- 172.21.15.81:0/4044951146 >> 172.21.15.81:0/4044951146 conn(0x7f108c07b850 msgr2=0x7f108c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 -- 172.21.15.81:0/4044951146 shutdown_connections 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.928+0000 7f1092aa5640 1 -- 172.21.15.81:0/4044951146 wait complete. 2024-09-21T03:00:21.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 Processor -- start 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 -- start start 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f108c103b60 0x7f108c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c1094a0 0x7f108c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1139b0 con 0x7f108c109df0 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f108c113830 con 0x7f108c1094a0 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1092aa5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f108c113b30 con 0x7f108c103b60 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1091042640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1091042640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34160/0 (socket says 172.21.15.81:34160) 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f1091042640 1 -- 172.21.15.81:0/3441168731 learned_addr learned my addr 172.21.15.81:0/3441168731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.929+0000 7f108bfff640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c1094a0 0x7f108c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1090841640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f108c103b60 0x7f108c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:21.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1091042640 1 -- 172.21.15.81:0/3441168731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f108c103b60 msgr2=0x7f108c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1091042640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f108c103b60 0x7f108c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1091042640 1 -- 172.21.15.81:0/3441168731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c1094a0 msgr2=0x7f108c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1091042640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c1094a0 0x7f108c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1091042640 1 -- 172.21.15.81:0/3441168731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c1a8780 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1091042640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c076190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1084031040 tx=0x7f1084032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1089ffb640 1 -- 172.21.15.81:0/3441168731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084004040 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c1a8a10 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1089ffb640 1 -- 172.21.15.81:0/3441168731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1084004670 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1089ffb640 1 -- 172.21.15.81:0/3441168731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084030bb0 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.930+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c1a8f50 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.931+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c103f70 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.933+0000 7f1089ffb640 1 -- 172.21.15.81:0/3441168731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f10840041e0 con 0x7f108c109df0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.933+0000 7f1089ffb640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10780b6510 0x7f10780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.934+0000 7f1090841640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10780b6510 0x7f10780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:21.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.934+0000 7f1089ffb640 1 -- 172.21.15.81:0/3441168731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1084108910 con 0x7f108c109df0 2024-09-21T03:00:21.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.934+0000 7f1090841640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10780b6510 0x7f10780b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f108c077160 tx=0x7f107c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:21.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:21.937+0000 7f1089ffb640 1 -- 172.21.15.81:0/3441168731 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10840cee60 con 0x7f108c109df0 2024-09-21T03:00:22.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.118+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f108c076a10 con 0x7f108c109df0 2024-09-21T03:00:22.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.120+0000 7f1089ffb640 1 -- 172.21.15.81:0/3441168731 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7f108c076a10 con 0x7f108c109df0 2024-09-21T03:00:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:22.122 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10780b6510 msgr2=0x7f10780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10780b6510 0x7f10780b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f108c077160 tx=0x7f107c00b390 comp rx=0 tx=0).stop 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 msgr2=0x7f108c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c076190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1084031040 tx=0x7f1084032bc0 comp rx=0 tx=0).stop 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 shutdown_connections 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f10780b6510 0x7f10780b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108c109df0 0x7f108c076190 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c1094a0 0x7f108c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 --2- 172.21.15.81:0/3441168731 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f108c103b60 0x7f108c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 >> 172.21.15.81:0/3441168731 conn(0x7f108c07b850 msgr2=0x7f108c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:22.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 shutdown_connections 2024-09-21T03:00:22.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:22.122+0000 7f1092aa5640 1 -- 172.21.15.81:0/3441168731 wait complete. 2024-09-21T03:00:22.478 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:22 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3441168731' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:00:22.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:22 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3441168731' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:00:22.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3441168731' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:00:22.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:58:15.629942+0000', 'modified': '2024-09-21T02:58:53.899125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24599, 'mds_1': 24572, 'mds_2': 24568}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24547': {'gid': 24547, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/3990133631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 3990133631}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 3990133631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24551': {'gid': 24551, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.164:6835/1947556688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1947556688}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 1947556688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24553': {'gid': 24553, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/3046788185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3046788185}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3046788185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.181:6839/1458541171', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 1458541171}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 1458541171}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24572': {'gid': 24572, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.164:6837/3749524162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6836', 'nonce': 3749524162}, {'type': 'v1', 'addr': '172.21.15.164:6837', 'nonce': 3749524162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.164:6839/399869191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6838', 'nonce': 399869191}, {'type': 'v1', 'addr': '172.21.15.164:6839', 'nonce': 399869191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24599, 'qdb_cluster': [24568, 24572, 24599]} 2024-09-21T03:00:22.810 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T03:00:22.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T03:00:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:23.458 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:23 smithi081 ceph-mon[30991]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 -- 172.21.15.81:0/683867005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c109df0 msgr2=0x7ff49c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/683867005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c109df0 0x7ff49c110620 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff494009ca0 tx=0x7ff49402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 -- 172.21.15.81:0/683867005 shutdown_connections 2024-09-21T03:00:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/683867005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff49c1094a0 0x7ff49c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/683867005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c109df0 0x7ff49c110620 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/683867005 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c103b60 0x7ff49c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 -- 172.21.15.81:0/683867005 >> 172.21.15.81:0/683867005 conn(0x7ff49c07b850 msgr2=0x7ff49c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 -- 172.21.15.81:0/683867005 shutdown_connections 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.547+0000 7ff4a3c91640 1 -- 172.21.15.81:0/683867005 wait complete. 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 Processor -- start 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 -- start start 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c103b60 0x7ff49c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c1094a0 0x7ff49c19a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff49c109df0 0x7ff49c19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1139b0 con 0x7ff49c103b60 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c113830 con 0x7ff49c1094a0 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a3c91640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c113b30 con 0x7ff49c109df0 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a1a2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c103b60 0x7ff49c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a1a2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c103b60 0x7ff49c19a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34172/0 (socket says 172.21.15.81:34172) 2024-09-21T03:00:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.548+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/1924085397 learned_addr learned my addr 172.21.15.81:0/1924085397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a122c640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c1094a0 0x7ff49c19a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a222e640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff49c109df0 0x7ff49c19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/1924085397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff49c109df0 msgr2=0x7ff49c19fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff49c109df0 0x7ff49c19fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/1924085397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c1094a0 msgr2=0x7ff49c19a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c1094a0 0x7ff49c19a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/1924085397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c1a0250 con 0x7ff49c103b60 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a222e640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff49c109df0 0x7ff49c19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c103b60 0x7ff49c19a3a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c920 tx=0x7ff49800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff48effd640 1 -- 172.21.15.81:0/1924085397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498007c70 con 0x7ff49c103b60 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff48effd640 1 -- 172.21.15.81:0/1924085397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff498007e10 con 0x7ff49c103b60 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c1a0540 con 0x7ff49c103b60 2024-09-21T03:00:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff48effd640 1 -- 172.21.15.81:0/1924085397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498018710 con 0x7ff49c103b60 2024-09-21T03:00:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.549+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c1a6d60 con 0x7ff49c103b60 2024-09-21T03:00:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 Processor -- start 2024-09-21T03:00:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff48effd640 1 -- 172.21.15.81:0/1924085397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff49800f450 con 0x7ff49c103b60 2024-09-21T03:00:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 -- start start 2024-09-21T03:00:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431000f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c320a0 0x55a431001440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a431001980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a430f78c10 con 0x55a430c5af60 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a430f68040 con 0x55a430c320a0 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4aa205740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a430f6be50 con 0x55a430c3a280 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4a222e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431000f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.552+0000 7ff4a222e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431000f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34176/0 (socket says 172.21.15.81:34176) 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 -- 172.21.15.81:0/3817965781 learned_addr learned my addr 172.21.15.81:0/3817965781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c320a0 0x55a431001440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a122c640 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a431001980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff48effd640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff4880b6540 0x7ff4880b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 -- 172.21.15.81:0/3817965781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 msgr2=0x55a431001980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a431001980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 -- 172.21.15.81:0/3817965781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c320a0 msgr2=0x55a431001440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c320a0 0x55a431001440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 -- 172.21.15.81:0/3817965781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a430cc6540 con 0x55a430c5af60 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c320a0 0x55a431001440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff4880b6540 0x7ff4880b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff48effd640 1 -- 172.21.15.81:0/1924085397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ff4980e77b0 con 0x7ff49c103b60 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff4a222e640 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431000f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff494009a60 tx=0x7ff494031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39eb25e8129a66f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff487fff640 1 -- 172.21.15.81:0/3817965781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494003e40 con 0x55a430c5af60 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.553+0000 7ff487fff640 1 -- 172.21.15.81:0/3817965781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff494036040 con 0x55a430c5af60 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff487fff640 1 -- 172.21.15.81:0/3817965781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494030820 con 0x55a430c5af60 2024-09-21T03:00:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4a222e640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff4880b6540 0x7ff4880b8a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff49404c000 tx=0x7ff494049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4aa205740 1 -- 172.21.15.81:0/3817965781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 msgr2=0x55a431000f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4aa205740 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431000f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff494009a60 tx=0x7ff494031700 comp rx=0 tx=0).stop 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4aa205740 1 -- 172.21.15.81:0/3817965781 shutdown_connections 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4aa205740 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a431001980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4aa205740 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c320a0 0x55a431001440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4aa205740 1 --2- 172.21.15.81:0/3817965781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431000f00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.554+0000 7ff4aa205740 1 -- 172.21.15.81:0/3817965781 >> 172.21.15.81:0/3817965781 conn(0x55a430c4f350 msgr2=0x55a430ffedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.555+0000 7ff4aa205740 1 -- 172.21.15.81:0/3817965781 shutdown_connections 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.555+0000 7ff4aa205740 1 -- 172.21.15.81:0/3817965781 wait complete. 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.555+0000 7ff4aa205740 1 -- start start 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.555+0000 7ff4aa205740 1 Processor -- start 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.555+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c320a0 0x55a43100ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.555+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a43100cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c5af60 0x55a431018880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a430dc95f0 con 0x55a430c320a0 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a430f03010 con 0x55a430c5af60 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a43100f560 con 0x55a430c3a280 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 10 client.0 _ll_register_callbacks cb 0x55a430f62340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c320a0 0x55a43100ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c320a0 0x55a43100ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34180/0 (socket says 172.21.15.81:34180) 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/2131230462 learned_addr learned my addr 172.21.15.81:0/2131230462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a122c640 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a43100cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a222e640 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c5af60 0x55a431018880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 msgr2=0x55a43100cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a43100cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/2131230462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c5af60 msgr2=0x55a431018880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c5af60 0x55a431018880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 -- 172.21.15.81:0/2131230462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a430f30a00 con 0x55a430c320a0 2024-09-21T03:00:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c320a0 0x55a43100ca00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4980aa870 tx=0x7ff49800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5014ee1c5be6c27b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4857fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4857fa640 1 -- 172.21.15.81:0/2131230462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980acd70 con 0x55a430c320a0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4857fa640 1 -- 172.21.15.81:0/2131230462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ff4980b6240 con 0x55a430c320a0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff494036040 con 0x55a430c320a0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4857fa640 1 -- 172.21.15.81:0/2131230462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff4980ad110 con 0x55a430c320a0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 10 client.15363 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.556+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a43101b560 con 0x55a430c320a0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4857fa640 1 -- 172.21.15.81:0/2131230462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff494036040 con 0x55a430c320a0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4857fa640 1 -- 172.21.15.81:0/2131230462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7ff4980a8fe0 con 0x55a430c320a0 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4aa205740 10 client.15363 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4aa205740 10 client.15363 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4aa205740 20 client.15363 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4aa205740 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430c198e0 0x55a43101ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4aa205740 4 client.15363 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 --> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a430f7ab60 con 0x55a430c198e0 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.557+0000 7ff4a122c640 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430c198e0 0x55a43101ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.558+0000 7ff4a122c640 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430c198e0 0x55a43101ef40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bbbfdea3747c9fb server_cookie=2e6028281c58c66e in_seq=0 out_seq=0 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.558+0000 7ff4857fa640 10 client.15363 ms_handle_connect on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4857fa640 1 -- 172.21.15.81:0/2131230462 <== mds.2 v2:172.21.15.181:6838/1458541171 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a430f7ab60 con 0x55a430c198e0 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4857fa640 10 client.15363 handle_command_reply: tid=0 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 client.15363 shutdown 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c320a0 msgr2=0x55a43100ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c320a0 0x55a43100ca00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4980aa870 tx=0x7ff49800a620 comp rx=0 tx=0).stop 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 shutdown_connections 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430c198e0 0x55a43101ef40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c3a280 0x55a43100cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c5af60 0x55a431018880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4857fa640 0 client.15363 ms_handle_reset on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 --2- 172.21.15.81:0/2131230462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c320a0 0x55a43100ca00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 >> 172.21.15.81:0/2131230462 conn(0x55a430c4f350 msgr2=0x55a4310040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 shutdown_connections 2024-09-21T03:00:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 1 -- 172.21.15.81:0/2131230462 wait complete. 2024-09-21T03:00:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.559+0000 7ff4aa205740 20 client.15363 trim_cache size 0 max 16384 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 Processor -- start 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 -- start start 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431007020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a4310187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431018d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a43101d280 con 0x55a430c5af60 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a43101d950 con 0x55a430c3a280 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4aa205740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a43101e020 con 0x55a430c320a0 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4a222e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431018d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4a222e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431018d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34182/0 (socket says 172.21.15.81:34182) 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4a222e640 1 -- 172.21.15.81:0/714908075 learned_addr learned my addr 172.21.15.81:0/714908075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4a122c640 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a4310187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.577+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431007020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4a222e640 1 -- 172.21.15.81:0/714908075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 msgr2=0x55a431007020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4a222e640 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431007020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4a222e640 1 -- 172.21.15.81:0/714908075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 msgr2=0x55a4310187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4a222e640 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a4310187f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4a222e640 1 -- 172.21.15.81:0/714908075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a431003790 con 0x55a430c5af60 2024-09-21T03:00:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4a222e640 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431018d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff49402a900 tx=0x7ff494031f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2b6c2f7ced589e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4877fe640 1 -- 172.21.15.81:0/714908075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494009890 con 0x55a430c5af60 2024-09-21T03:00:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4877fe640 1 -- 172.21.15.81:0/714908075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff494036030 con 0x55a430c5af60 2024-09-21T03:00:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.578+0000 7ff4877fe640 1 -- 172.21.15.81:0/714908075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4940042a0 con 0x55a430c5af60 2024-09-21T03:00:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 -- 172.21.15.81:0/714908075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 msgr2=0x55a431018d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431018d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff49402a900 tx=0x7ff494031f60 comp rx=0 tx=0).stop 2024-09-21T03:00:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 -- 172.21.15.81:0/714908075 shutdown_connections 2024-09-21T03:00:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a431018d30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a4310187f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 --2- 172.21.15.81:0/714908075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431007020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 -- 172.21.15.81:0/714908075 >> 172.21.15.81:0/714908075 conn(0x55a430c4f350 msgr2=0x55a431007a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 -- 172.21.15.81:0/714908075 shutdown_connections 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 -- 172.21.15.81:0/714908075 wait complete. 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 -- start start 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.579+0000 7ff4aa205740 1 Processor -- start 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431027420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a431027a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4aa205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a4310208d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4aa205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a43101edc0 con 0x55a430c5af60 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4aa205740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a43101e6f0 con 0x55a430c3a280 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4aa205740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a43101f490 con 0x55a430c320a0 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4aa205740 10 client.0 _ll_register_callbacks cb 0x7ff49800cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a4310208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a122c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a431027a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a4310208d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34184/0 (socket says 172.21.15.81:34184) 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 -- 172.21.15.81:0/1657280717 learned_addr learned my addr 172.21.15.81:0/1657280717 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431027420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 -- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 msgr2=0x55a431027420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431027420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 -- 172.21.15.81:0/1657280717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 msgr2=0x55a431027a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a431027a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 -- 172.21.15.81:0/1657280717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a431021010 con 0x55a430c5af60 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a122c640 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a431027a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4a222e640 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a4310208d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff494032010 tx=0x7ff494009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505d0c76d84b6f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.580+0000 7ff4857fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4857fa640 1 -- 172.21.15.81:0/1657280717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49406b060 con 0x55a430c5af60 2024-09-21T03:00:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4857fa640 1 -- 172.21.15.81:0/1657280717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ff494030d80 con 0x55a430c5af60 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff494036030 con 0x55a430c5af60 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4857fa640 1 -- 172.21.15.81:0/1657280717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff494004040 con 0x55a430c5af60 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 10 client.15369 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a4310269f0 con 0x55a430c5af60 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4857fa640 1 -- 172.21.15.81:0/1657280717 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff494036030 con 0x55a430c5af60 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4857fa640 1 -- 172.21.15.81:0/1657280717 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7ff49405b070 con 0x55a430c5af60 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 10 client.15369 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 10 client.15369 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 20 client.15369 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430beec90 0x55a4310916a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 4 client.15369 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.581+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 --> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] -- command(tid 0: {"prefix": "status"}) -- 0x55a430f76610 con 0x55a430beec90 2024-09-21T03:00:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430beec90 0x55a4310916a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:23.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4857fa640 10 client.15369 ms_handle_connect on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4a1a2d640 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430beec90 0x55a4310916a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67c9306ef3f27fca server_cookie=a2d740f4387856c1 in_seq=0 out_seq=0 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4857fa640 1 -- 172.21.15.81:0/1657280717 <== mds.2 v2:172.21.15.181:6838/1458541171 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a430f76610 con 0x55a430beec90 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4857fa640 10 client.15369 handle_command_reply: tid=0 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4aa205740 1 client.15369 shutdown 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 msgr2=0x55a4310208d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.582+0000 7ff4aa205740 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a4310208d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff494032010 tx=0x7ff494009920 comp rx=0 tx=0).stop 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 shutdown_connections 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55a430beec90 0x55a4310916a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a430c5af60 0x55a4310208d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a430c3a280 0x55a431027a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 --2- 172.21.15.81:0/1657280717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a430c320a0 0x55a431027420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4857fa640 0 client.15369 ms_handle_reset on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 >> 172.21.15.81:0/1657280717 conn(0x55a430c4f350 msgr2=0x55a43100afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 shutdown_connections 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 1 -- 172.21.15.81:0/1657280717 wait complete. 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4aa205740 20 client.15369 trim_cache size 0 max 16384 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24568, 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 92.440744043999999, 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 24, 2024-09-21T03:00:23.589 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:23.590 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 147.082615283 2024-09-21T03:00:23.590 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff4880b6540 msgr2=0x7ff4880b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff4880b6540 0x7ff4880b8a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff49404c000 tx=0x7ff494049000 comp rx=0 tx=0).stop 2024-09-21T03:00:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c103b60 msgr2=0x7ff49c19a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c103b60 0x7ff49c19a3a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c920 tx=0x7ff49800cde0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 shutdown_connections 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff4880b6540 0x7ff4880b8a50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff49c109df0 0x7ff49c19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff49c1094a0 0x7ff49c19a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 --2- 172.21.15.81:0/1924085397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49c103b60 0x7ff49c19a3a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 >> 172.21.15.81:0/1924085397 conn(0x7ff49c07b850 msgr2=0x7ff49c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 shutdown_connections 2024-09-21T03:00:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:23.583+0000 7ff4a3c91640 1 -- 172.21.15.81:0/1924085397 wait complete. 2024-09-21T03:00:23.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:23 smithi164 ceph-mon[34236]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:23.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:23 smithi181 ceph-mon[34096]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:00:24.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T03:00:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:25.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 -- 172.21.15.81:0/1382106084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0108cf0 msgr2=0x7f11c010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 --2- 172.21.15.81:0/1382106084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0108cf0 0x7f11c010f520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009ca0 tx=0x7f11b802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 -- 172.21.15.81:0/1382106084 shutdown_connections 2024-09-21T03:00:25.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 --2- 172.21.15.81:0/1382106084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c01083a0 0x7f11c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 --2- 172.21.15.81:0/1382106084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0108cf0 0x7f11c010f520 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 --2- 172.21.15.81:0/1382106084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c0102a60 0x7f11c0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 -- 172.21.15.81:0/1382106084 >> 172.21.15.81:0/1382106084 conn(0x7f11c0079730 msgr2=0x7f11c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 -- 172.21.15.81:0/1382106084 shutdown_connections 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.066+0000 7f11c6916640 1 -- 172.21.15.81:0/1382106084 wait complete. 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 Processor -- start 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 -- start start 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0102a60 0x7f11c019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c01083a0 0x7f11c019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c0108cf0 0x7f11c019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11c0113960 con 0x7f11c0102a60 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f11c01137e0 con 0x7f11c01083a0 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11c6916640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f11c0113ae0 con 0x7f11c0108cf0 2024-09-21T03:00:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.067+0000 7f11bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0102a60 0x7f11c019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0102a60 0x7f11c019a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34202/0 (socket says 172.21.15.81:34202) 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 -- 172.21.15.81:0/805099623 learned_addr learned my addr 172.21.15.81:0/805099623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c01083a0 0x7f11c019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c0108cf0 0x7f11c019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 -- 172.21.15.81:0/805099623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c0108cf0 msgr2=0x7f11c019fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c0108cf0 0x7f11c019fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 -- 172.21.15.81:0/805099623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c01083a0 msgr2=0x7f11c019a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c01083a0 0x7f11c019a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 -- 172.21.15.81:0/805099623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c01a0220 con 0x7f11c0102a60 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bffff640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0102a60 0x7f11c019a370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c920 tx=0x7f11b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bd7fa640 1 -- 172.21.15.81:0/805099623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0007c70 con 0x7f11c0102a60 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c01a0510 con 0x7f11c0102a60 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bd7fa640 1 -- 172.21.15.81:0/805099623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11b0007e10 con 0x7f11c0102a60 2024-09-21T03:00:25.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11bd7fa640 1 -- 172.21.15.81:0/805099623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b00186f0 con 0x7f11c0102a60 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.068+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01a6d30 con 0x7f11c0102a60 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 Processor -- start 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11bd7fa640 1 -- 172.21.15.81:0/805099623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f11b000f450 con 0x7f11c0102a60 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 -- start start 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b71431f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b710630a0 0x557b71432440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b7106b280 0x557b71432980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b713a9c10 con 0x557b7108bf60 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557b71399040 con 0x557b710630a0 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11cce8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557b7139ce50 con 0x557b7106b280 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11c4eb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b71431f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11c4eb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b71431f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34218/0 (socket says 172.21.15.81:34218) 2024-09-21T03:00:25.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.071+0000 7f11c4eb3640 1 -- 172.21.15.81:0/565102126 learned_addr learned my addr 172.21.15.81:0/565102126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11bffff640 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b710630a0 0x557b71432440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b7106b280 0x557b71432980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11c4eb3640 1 -- 172.21.15.81:0/565102126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b7106b280 msgr2=0x557b71432980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b7106b280 0x557b71432980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11c4eb3640 1 -- 172.21.15.81:0/565102126 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b710630a0 msgr2=0x557b71432440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b710630a0 0x557b71432440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11c4eb3640 1 -- 172.21.15.81:0/565102126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b710f7540 con 0x557b7108bf60 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11bffff640 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b710630a0 0x557b71432440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11bd7fa640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11ac0b6540 0x7f11ac0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b71431f00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f11b8031570 tx=0x7f11b80315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ed91d4fc4d875c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:25.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11bffff640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11ac0b6540 0x7f11ac0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11bd7fa640 1 -- 172.21.15.81:0/805099623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f11b00e77b0 con 0x7f11c0102a60 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11b67fc640 1 -- 172.21.15.81:0/565102126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8031b80 con 0x557b7108bf60 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11b67fc640 1 -- 172.21.15.81:0/565102126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11b803f070 con 0x557b7108bf60 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.072+0000 7f11b67fc640 1 -- 172.21.15.81:0/565102126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8004520 con 0x557b7108bf60 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 -- 172.21.15.81:0/565102126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 msgr2=0x557b71431f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11bffff640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11ac0b6540 0x7f11ac0b8a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad590 tx=0x7f11b000fd40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b71431f00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f11b8031570 tx=0x7f11b80315a0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 -- 172.21.15.81:0/565102126 shutdown_connections 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b7106b280 0x557b71432980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b710630a0 0x557b71432440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 --2- 172.21.15.81:0/565102126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b71431f00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 -- 172.21.15.81:0/565102126 >> 172.21.15.81:0/565102126 conn(0x557b71080350 msgr2=0x557b7142fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 -- 172.21.15.81:0/565102126 shutdown_connections 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.073+0000 7f11cce8a740 1 -- 172.21.15.81:0/565102126 wait complete. 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 -- start start 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 Processor -- start 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b71441e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7106b280 0x557b71442350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b7144dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b711fa5f0 con 0x557b7108bf60 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557b71334010 con 0x557b7106b280 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557b714449b0 con 0x557b710630a0 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11cce8a740 10 client.0 _ll_register_callbacks cb 0x557b71393340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11c4eb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b7144dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11c4eb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b7144dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34226/0 (socket says 172.21.15.81:34226) 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.074+0000 7f11c4eb3640 1 -- 172.21.15.81:0/2553101145 learned_addr learned my addr 172.21.15.81:0/2553101145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b71441e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7106b280 0x557b71442350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11c4eb3640 1 -- 172.21.15.81:0/2553101145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 msgr2=0x557b71441e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b71441e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11c4eb3640 1 -- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7106b280 msgr2=0x557b71442350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7106b280 0x557b71442350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11c4eb3640 1 -- 172.21.15.81:0/2553101145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b71361a00 con 0x557b7108bf60 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7106b280 0x557b71442350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b7144dce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f11b8031920 tx=0x7f11b8004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82db362e8019c6b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f119f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f119f7fe640 1 -- 172.21.15.81:0/2553101145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8003970 con 0x557b7108bf60 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f119f7fe640 1 -- 172.21.15.81:0/2553101145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f11b8003b10 con 0x557b7108bf60 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11b803f070 con 0x557b7108bf60 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f119f7fe640 1 -- 172.21.15.81:0/2553101145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f11b8003d10 con 0x557b7108bf60 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11cce8a740 10 client.15381 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b71450950 con 0x557b7108bf60 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.075+0000 7f119f7fe640 1 -- 172.21.15.81:0/2553101145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11b803f070 con 0x557b7108bf60 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f119f7fe640 1 -- 172.21.15.81:0/2553101145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f11b8044500 con 0x557b7108bf60 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f11cce8a740 10 client.15381 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f11cce8a740 10 client.15381 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f11cce8a740 20 client.15381 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f11cce8a740 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7104a8e0 0x557b71453ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f11cce8a740 4 client.15381 mds_command: new command op to 24572 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 --> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b713abb60 con 0x557b7104a8e0 2024-09-21T03:00:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.076+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7104a8e0 0x557b71453ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.077+0000 7f119f7fe640 10 client.15381 ms_handle_connect on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.077+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7104a8e0 0x557b71453ee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6902e3825542fd89 server_cookie=8e1932d6784ed2ce in_seq=0 out_seq=0 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.077+0000 7f119f7fe640 1 -- 172.21.15.81:0/2553101145 <== mds.1 v2:172.21.15.164:6836/3749524162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b713abb60 con 0x557b7104a8e0 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.077+0000 7f119f7fe640 10 client.15381 handle_command_reply: tid=0 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.077+0000 7f11cce8a740 1 client.15381 shutdown 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 msgr2=0x557b7144dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b7144dce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f11b8031920 tx=0x7f11b8004180 comp rx=0 tx=0).stop 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 shutdown_connections 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7104a8e0 0x557b71453ee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7108bf60 0x557b7144dce0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7106b280 0x557b71442350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 --2- 172.21.15.81:0/2553101145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b71441e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 >> 172.21.15.81:0/2553101145 conn(0x557b71080350 msgr2=0x557b71435090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f119f7fe640 0 client.15381 ms_handle_reset on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 shutdown_connections 2024-09-21T03:00:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 1 -- 172.21.15.81:0/2553101145 wait complete. 2024-09-21T03:00:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.078+0000 7f11cce8a740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T03:00:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 Processor -- start 2024-09-21T03:00:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 -- start start 2024-09-21T03:00:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b7143cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b7143d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7144dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b71452220 con 0x557b7106b280 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557b714528f0 con 0x557b7108bf60 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11cce8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557b71452fc0 con 0x557b710630a0 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b7143d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b7143d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34238/0 (socket says 172.21.15.81:34238) 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 -- 172.21.15.81:0/1568954374 learned_addr learned my addr 172.21.15.81:0/1568954374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b7143cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7144dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 -- 172.21.15.81:0/1568954374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 msgr2=0x557b7143cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b7143cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 -- 172.21.15.81:0/1568954374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 msgr2=0x557b7144dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7144dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11bf7fe640 1 -- 172.21.15.81:0/1568954374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b71440110 con 0x557b7106b280 2024-09-21T03:00:25.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.096+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b7143cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:25.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.097+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b7143d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f11c006aaa0 tx=0x7f11a800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa19d5e363edf9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:25.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.097+0000 7f11b5ffb640 1 -- 172.21.15.81:0/1568954374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8004020 con 0x557b7106b280 2024-09-21T03:00:25.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.097+0000 7f11b5ffb640 1 -- 172.21.15.81:0/1568954374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a80041c0 con 0x557b7106b280 2024-09-21T03:00:25.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.097+0000 7f11b5ffb640 1 -- 172.21.15.81:0/1568954374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8011730 con 0x557b7106b280 2024-09-21T03:00:25.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.097+0000 7f11cce8a740 1 -- 172.21.15.81:0/1568954374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 msgr2=0x557b7143d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.097+0000 7f11cce8a740 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b7143d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f11c006aaa0 tx=0x7f11a800a250 comp rx=0 tx=0).stop 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 -- 172.21.15.81:0/1568954374 shutdown_connections 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7144dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b7143d300 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 --2- 172.21.15.81:0/1568954374 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b7143cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 -- 172.21.15.81:0/1568954374 >> 172.21.15.81:0/1568954374 conn(0x557b71080350 msgr2=0x557b71441df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 -- 172.21.15.81:0/1568954374 shutdown_connections 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 -- 172.21.15.81:0/1568954374 wait complete. 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 -- start start 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.098+0000 7f11cce8a740 1 Processor -- start 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b714557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b71455d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7145ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557b71453d60 con 0x557b7106b280 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557b71453690 con 0x557b7108bf60 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557b71454430 con 0x557b710630a0 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 10 client.0 _ll_register_callbacks cb 0x7f11b80314c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b71455d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b71455d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34242/0 (socket says 172.21.15.81:34242) 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 -- 172.21.15.81:0/18813457 learned_addr learned my addr 172.21.15.81:0/18813457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7145ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b714557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 -- 172.21.15.81:0/18813457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 msgr2=0x557b714557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b714557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 -- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 msgr2=0x557b7145ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:25.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7145ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 -- 172.21.15.81:0/18813457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b7145b280 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7145ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11bf7fe640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b71455d60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f11a800abd0 tx=0x7f11a8003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f020295fde9f001 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f119f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f119f7fe640 1 -- 172.21.15.81:0/18813457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a80035f0 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f119f7fe640 1 -- 172.21.15.81:0/18813457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f11a8003790 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.099+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a80041c0 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f119f7fe640 1 -- 172.21.15.81:0/18813457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f11a80039b0 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 10 client.15387 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b7145c5b0 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f119f7fe640 1 -- 172.21.15.81:0/18813457 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a80041c0 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f119f7fe640 1 -- 172.21.15.81:0/18813457 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f11a802f490 con 0x557b7106b280 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 10 client.15387 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 10 client.15387 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:00:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 20 client.15387 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7101fc90 0x557b714c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 4 client.15387 mds_command: new command op to 24572 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 --> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] -- command(tid 0: {"prefix": "status"}) -- 0x557b713a7610 con 0x557b7101fc90 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.100+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7101fc90 0x557b714c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f119f7fe640 10 client.15387 ms_handle_connect on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11c4eb3640 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7101fc90 0x557b714c1f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94d8b71f6c5c71d4 server_cookie=e6bb60d094b86c94 in_seq=0 out_seq=0 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f119f7fe640 1 -- 172.21.15.81:0/18813457 <== mds.1 v2:172.21.15.164:6836/3749524162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557b713a7610 con 0x557b7101fc90 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f119f7fe640 10 client.15387 handle_command_reply: tid=0 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 client.15387 shutdown 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 msgr2=0x557b71455d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b71455d60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f11a800abd0 tx=0x7f11a8003db0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 shutdown_connections 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x557b7101fc90 0x557b714c1f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557b7108bf60 0x557b7145ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557b7106b280 0x557b71455d60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 --2- 172.21.15.81:0/18813457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557b710630a0 0x557b714557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 >> 172.21.15.81:0/18813457 conn(0x557b71080350 msgr2=0x557b7143cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f119f7fe640 0 client.15387 ms_handle_reset on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 shutdown_connections 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.101+0000 7f11cce8a740 1 -- 172.21.15.81:0/18813457 wait complete. 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11cce8a740 20 client.15387 trim_cache size 0 max 16384 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24572, 2024-09-21T03:00:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 94.968367010999998, 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 24, 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 151.16423323699999 2024-09-21T03:00:25.109 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11ac0b6540 msgr2=0x7f11ac0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11ac0b6540 0x7f11ac0b8a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad590 tx=0x7f11b000fd40 comp rx=0 tx=0).stop 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0102a60 msgr2=0x7f11c019a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0102a60 0x7f11c019a370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c920 tx=0x7f11b000cde0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 shutdown_connections 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f11ac0b6540 0x7f11ac0b8a50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11c0108cf0 0x7f11c019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11c01083a0 0x7f11c019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 --2- 172.21.15.81:0/805099623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c0102a60 0x7f11c019a370 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 >> 172.21.15.81:0/805099623 conn(0x7f11c0079730 msgr2=0x7f11c01043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 shutdown_connections 2024-09-21T03:00:25.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:25.102+0000 7f11c6916640 1 -- 172.21.15.81:0/805099623 wait complete. 2024-09-21T03:00:25.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:25 smithi081 ceph-mon[30991]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:25.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:25 smithi164 ceph-mon[34236]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:25.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:25 smithi181 ceph-mon[34096]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:25.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:00:26.178 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 -- 172.21.15.81:0/415274596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514102a60 msgr2=0x7f9514102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 --2- 172.21.15.81:0/415274596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514102a60 0x7f9514102e70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9508009900 tx=0x7f950802a410 comp rx=0 tx=0).stop 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 -- 172.21.15.81:0/415274596 shutdown_connections 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 --2- 172.21.15.81:0/415274596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9514108cf0 0x7f951410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 --2- 172.21.15.81:0/415274596 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95141083a0 0x7f95141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 --2- 172.21.15.81:0/415274596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514102a60 0x7f9514102e70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 -- 172.21.15.81:0/415274596 >> 172.21.15.81:0/415274596 conn(0x7f9514079730 msgr2=0x7f9514079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 -- 172.21.15.81:0/415274596 shutdown_connections 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.684+0000 7f9519228640 1 -- 172.21.15.81:0/415274596 wait complete. 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 Processor -- start 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 -- start start 2024-09-21T03:00:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9514102a60 0x7f951419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141083a0 0x7f951419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514108cf0 0x7f951419bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9514112870 con 0x7f9514108cf0 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f95141126f0 con 0x7f9514102a60 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f9519228640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f95141129f0 con 0x7f95141083a0 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.685+0000 7f951359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514108cf0 0x7f951419bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514108cf0 0x7f951419bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34268/0 (socket says 172.21.15.81:34268) 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 -- 172.21.15.81:0/2323086038 learned_addr learned my addr 172.21.15.81:0/2323086038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951259c640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141083a0 0x7f951419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9514102a60 0x7f951419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 -- 172.21.15.81:0/2323086038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141083a0 msgr2=0x7f951419b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141083a0 0x7f951419b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 -- 172.21.15.81:0/2323086038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9514102a60 msgr2=0x7f951419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9514102a60 0x7f951419b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 -- 172.21.15.81:0/2323086038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95141a64a0 con 0x7f9514108cf0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951259c640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141083a0 0x7f951419b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f951359e640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514108cf0 0x7f951419bca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f950c00b970 tx=0x7f950c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f94fbfff640 1 -- 172.21.15.81:0/2323086038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c019070 con 0x7f9514108cf0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95141a6790 con 0x7f9514108cf0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f94fbfff640 1 -- 172.21.15.81:0/2323086038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f950c014440 con 0x7f9514108cf0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f94fbfff640 1 -- 172.21.15.81:0/2323086038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c0075d0 con 0x7f9514108cf0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.686+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95141a6c80 con 0x7f9514108cf0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 Processor -- start 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f94fbfff640 1 -- 172.21.15.81:0/2323086038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f950c01c070 con 0x7f9514108cf0 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 -- start start 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1ea1f60 0x55e2e2247f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e2248440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e2248980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e2e21bfc10 con 0x55e2e1ea1f60 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55e2e21af040 con 0x55e2e1e81280 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951f79c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e2e21b2e50 con 0x55e2e1e790a0 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1ea1f60 0x55e2e2247f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1ea1f60 0x55e2e2247f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34282/0 (socket says 172.21.15.81:34282) 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951259c640 1 -- 172.21.15.81:0/194439562 learned_addr learned my addr 172.21.15.81:0/194439562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f9512d9d640 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e2248440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951259c640 1 -- 172.21.15.81:0/194439562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 msgr2=0x55e2e2248440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951259c640 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e2248440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951259c640 1 -- 172.21.15.81:0/194439562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 msgr2=0x55e2e2248980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.689+0000 7f951259c640 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e2248980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f951259c640 1 -- 172.21.15.81:0/194439562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2e1f0d540 con 0x55e2e1ea1f60 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f94fbfff640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f94fc0b6510 0x7f94fc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f94fc0b6510 0x7f94fc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f951259c640 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1ea1f60 0x55e2e2247f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9504008cb0 tx=0x7f9504010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6704723c0dbf6b42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f94fbfff640 1 -- 172.21.15.81:0/2323086038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f950c0e6b90 con 0x7f9514108cf0 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f94f97fa640 1 -- 172.21.15.81:0/194439562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504016070 con 0x55e2e1ea1f60 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f94f97fa640 1 -- 172.21.15.81:0/194439562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95040056b0 con 0x55e2e1ea1f60 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.690+0000 7f94f97fa640 1 -- 172.21.15.81:0/194439562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040126e0 con 0x55e2e1ea1f60 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 -- 172.21.15.81:0/194439562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1ea1f60 msgr2=0x55e2e2247f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1ea1f60 0x55e2e2247f00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9504008cb0 tx=0x7f9504010740 comp rx=0 tx=0).stop 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f94fc0b6510 0x7f94fc0b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9508006010 tx=0x7f9508009640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 -- 172.21.15.81:0/194439562 shutdown_connections 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e2248440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e2248980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 --2- 172.21.15.81:0/194439562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1ea1f60 0x55e2e2247f00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 -- 172.21.15.81:0/194439562 >> 172.21.15.81:0/194439562 conn(0x55e2e1e96350 msgr2=0x55e2e2245df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 -- 172.21.15.81:0/194439562 shutdown_connections 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 -- 172.21.15.81:0/194439562 wait complete. 2024-09-21T03:00:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 -- start start 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.691+0000 7f951f79c740 1 Processor -- start 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951f79c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e790a0 0x55e2e2253730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951f79c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e2253cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951f79c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1ea1f60 0x55e2e225f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951f79c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e2e20105f0 con 0x55e2e1e790a0 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951f79c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55e2e214a010 con 0x55e2e1e81280 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951f79c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e2e22566e0 con 0x55e2e1ea1f60 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951f79c740 10 client.0 _ll_register_callbacks cb 0x55e2e21a9340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e790a0 0x55e2e2253730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e790a0 0x55e2e2253730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34290/0 (socket says 172.21.15.81:34290) 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 -- 172.21.15.81:0/2393251415 learned_addr learned my addr 172.21.15.81:0/2393251415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951359e640 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1ea1f60 0x55e2e225f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f951259c640 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e2253cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 -- 172.21.15.81:0/2393251415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1ea1f60 msgr2=0x55e2e225f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1ea1f60 0x55e2e225f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 -- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 msgr2=0x55e2e2253cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e2253cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 -- 172.21.15.81:0/2393251415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2e2177a00 con 0x55e2e1e790a0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e790a0 0x55e2e2253730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9508033000 tx=0x7f9508009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e52560205d19bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.692+0000 7f94f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2393251415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950804d070 con 0x55e2e1e790a0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2393251415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f95080037f0 con 0x55e2e1e790a0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95040056b0 con 0x55e2e1e790a0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2393251415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9508059050 con 0x55e2e1e790a0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 10 client.15399 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e2e2262570 con 0x55e2e1e790a0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2393251415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95040056b0 con 0x55e2e1e790a0 2024-09-21T03:00:26.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2393251415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f9508049940 con 0x55e2e1e790a0 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 10 client.15399 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 10 client.15399 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 20 client.15399 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1e608e0 0x55e2e2266030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 4 client.15399 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.693+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2e21c1b60 con 0x55e2e1e608e0 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.694+0000 7f951259c640 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1e608e0 0x55e2e2266030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.694+0000 7f94f6ff5640 10 client.15399 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.694+0000 7f951259c640 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1e608e0 0x55e2e2266030 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f80b7e1a94ddd3ba server_cookie=12f82cddfab2e748 in_seq=0 out_seq=0 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2393251415 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2e21c1b60 con 0x55e2e1e608e0 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f94f6ff5640 10 client.15399 handle_command_reply: tid=0 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 client.15399 shutdown 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e790a0 msgr2=0x55e2e2253730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e790a0 0x55e2e2253730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9508033000 tx=0x7f9508009260 comp rx=0 tx=0).stop 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 shutdown_connections 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1e608e0 0x55e2e2266030 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f94f6ff5640 0 client.15399 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1ea1f60 0x55e2e225f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e2253cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 --2- 172.21.15.81:0/2393251415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e790a0 0x55e2e2253730 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 >> 172.21.15.81:0/2393251415 conn(0x55e2e1e96350 msgr2=0x55e2e224b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 shutdown_connections 2024-09-21T03:00:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 1 -- 172.21.15.81:0/2393251415 wait complete. 2024-09-21T03:00:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.695+0000 7f951f79c740 20 client.15399 trim_cache size 0 max 16384 2024-09-21T03:00:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 Processor -- start 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 -- start start 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e608e0 0x55e2e22639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e225f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e225fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e2e2264370 con 0x55e2e1e608e0 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55e2e2264a40 con 0x55e2e1e81280 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f951f79c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e2e2265110 con 0x55e2e1e790a0 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f9512d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e608e0 0x55e2e22639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f9512d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e608e0 0x55e2e22639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34292/0 (socket says 172.21.15.81:34292) 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.713+0000 7f9512d9d640 1 -- 172.21.15.81:0/409555948 learned_addr learned my addr 172.21.15.81:0/409555948 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f951259c640 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e225f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f951359e640 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e225fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f9512d9d640 1 -- 172.21.15.81:0/409555948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 msgr2=0x55e2e225f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f9512d9d640 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e225f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f9512d9d640 1 -- 172.21.15.81:0/409555948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 msgr2=0x55e2e225fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f9512d9d640 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e225fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f9512d9d640 1 -- 172.21.15.81:0/409555948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2e2246780 con 0x55e2e1e608e0 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f951259c640 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e225f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f9512d9d640 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e608e0 0x55e2e22639e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9508005d00 tx=0x7f95080315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d5f3c07f94a34e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f94f8ff9640 1 -- 172.21.15.81:0/409555948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950804d050 con 0x55e2e1e608e0 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f94f8ff9640 1 -- 172.21.15.81:0/409555948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9508049ae0 con 0x55e2e1e608e0 2024-09-21T03:00:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.714+0000 7f94f8ff9640 1 -- 172.21.15.81:0/409555948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508035050 con 0x55e2e1e608e0 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 -- 172.21.15.81:0/409555948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e608e0 msgr2=0x55e2e22639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e608e0 0x55e2e22639e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9508005d00 tx=0x7f95080315d0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 -- 172.21.15.81:0/409555948 shutdown_connections 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e790a0 0x55e2e225f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e81280 0x55e2e225fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 --2- 172.21.15.81:0/409555948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e608e0 0x55e2e22639e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 -- 172.21.15.81:0/409555948 >> 172.21.15.81:0/409555948 conn(0x55e2e1e96350 msgr2=0x55e2e2251fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 -- 172.21.15.81:0/409555948 shutdown_connections 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 -- 172.21.15.81:0/409555948 wait complete. 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 -- start start 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.715+0000 7f951f79c740 1 Processor -- start 2024-09-21T03:00:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951f79c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e608e0 0x55e2e226ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951f79c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e790a0 0x55e2e22681d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951f79c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e81280 0x55e2e22688e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951f79c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e2e2265eb0 con 0x55e2e1e81280 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951f79c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55e2e22657e0 con 0x55e2e1e790a0 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951f79c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55e2e2266580 con 0x55e2e1e608e0 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951f79c740 10 client.0 _ll_register_callbacks cb 0x7f9508009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e81280 0x55e2e22688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e81280 0x55e2e22688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34308/0 (socket says 172.21.15.81:34308) 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 -- 172.21.15.81:0/2267115555 learned_addr learned my addr 172.21.15.81:0/2267115555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951259c640 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e790a0 0x55e2e22681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e608e0 0x55e2e226ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 -- 172.21.15.81:0/2267115555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e608e0 msgr2=0x55e2e226ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e608e0 0x55e2e226ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 -- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e790a0 msgr2=0x55e2e22681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e790a0 0x55e2e22681d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 -- 172.21.15.81:0/2267115555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2e226d8f0 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f951359e640 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e81280 0x55e2e22688e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f950c0ac6e0 tx=0x7f950c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1cf5e9a6374b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.716+0000 7f94f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2267115555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c095060 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2267115555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f950c00cb40 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9508049ae0 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2267115555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f950c0b14c0 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 10 client.15405 fetch_fsmap learned FSMap version 24 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e2e22d16e0 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2267115555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9508049ae0 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2267115555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f950c0c2b90 con 0x55e2e1e81280 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 10 client.15405 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:00:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 10 client.15405 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 20 client.15405 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1ea1f60 0x55e2e22d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 4 client.15405 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.717+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "status"}) -- 0x55e2e21bd610 con 0x55e2e1ea1f60 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1ea1f60 0x55e2e22d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f94f6ff5640 10 client.15405 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f9512d9d640 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1ea1f60 0x55e2e22d4fb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b18dc17edd00af07 server_cookie=23e660ae4411a46b in_seq=0 out_seq=0 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f94f6ff5640 1 -- 172.21.15.81:0/2267115555 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e2e21bd610 con 0x55e2e1ea1f60 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f94f6ff5640 10 client.15405 handle_command_reply: tid=0 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f951f79c740 1 client.15405 shutdown 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e81280 msgr2=0x55e2e22688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.718+0000 7f951f79c740 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e81280 0x55e2e22688e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f950c0ac6e0 tx=0x7f950c004b50 comp rx=0 tx=0).stop 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 shutdown_connections 2024-09-21T03:00:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55e2e1ea1f60 0x55e2e22d4fb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e2e1e81280 0x55e2e22688e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2e1e790a0 0x55e2e22681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 --2- 172.21.15.81:0/2267115555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e2e1e608e0 0x55e2e226ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f94f6ff5640 0 client.15405 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 >> 172.21.15.81:0/2267115555 conn(0x55e2e1e96350 msgr2=0x55e2e2245600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 shutdown_connections 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 1 -- 172.21.15.81:0/2267115555 wait complete. 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f951f79c740 20 client.15405 trim_cache size 0 max 16384 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24599, 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 130.68524190299999, 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 24, 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 141.483594332 2024-09-21T03:00:26.726 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f94fc0b6510 msgr2=0x7f94fc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f94fc0b6510 0x7f94fc0b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9508006010 tx=0x7f9508009640 comp rx=0 tx=0).stop 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514108cf0 msgr2=0x7f951419bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514108cf0 0x7f951419bca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f950c00b970 tx=0x7f950c00be30 comp rx=0 tx=0).stop 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 shutdown_connections 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f94fc0b6510 0x7f94fc0b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141083a0 0x7f951419b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9514108cf0 0x7f951419bca0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 --2- 172.21.15.81:0/2323086038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9514102a60 0x7f951419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.719+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 >> 172.21.15.81:0/2323086038 conn(0x7f9514079730 msgr2=0x7f95141015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.720+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 shutdown_connections 2024-09-21T03:00:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:26.720+0000 7f9519228640 1 -- 172.21.15.81:0/2323086038 wait complete. 2024-09-21T03:00:27.459 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:27 smithi081 ceph-mon[30991]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:27.489 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T03:00:27.500 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T03:00:27.500 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-21T03:00:27.500 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-21T03:00:27.500 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:00:27.500 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:27.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:27.500 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T03:00:27.517 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T03:00:27.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:27.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T03:00:27.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:27.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-21T03:00:27.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:27 smithi164 ceph-mon[34236]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:27.686 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T03:00:27.686 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T03:00:27.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T03:00:27.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:27 smithi181 ceph-mon[34096]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:27.935 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.420+0000 7fad4e32a640 1 -- 172.21.15.81:0/1370076825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48102a60 msgr2=0x7fad48102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.420+0000 7fad4e32a640 1 --2- 172.21.15.81:0/1370076825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48102a60 0x7fad48102e70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fad38009900 tx=0x7fad3802a410 comp rx=0 tx=0).stop 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 -- 172.21.15.81:0/1370076825 shutdown_connections 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 --2- 172.21.15.81:0/1370076825 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad48108cf0 0x7fad4810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 --2- 172.21.15.81:0/1370076825 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad481083a0 0x7fad481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 --2- 172.21.15.81:0/1370076825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48102a60 0x7fad48102e70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 -- 172.21.15.81:0/1370076825 >> 172.21.15.81:0/1370076825 conn(0x7fad48079730 msgr2=0x7fad48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 -- 172.21.15.81:0/1370076825 shutdown_connections 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 -- 172.21.15.81:0/1370076825 wait complete. 2024-09-21T03:00:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 Processor -- start 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.421+0000 7fad4e32a640 1 -- start start 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4e32a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad48102a60 0x7fad48199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4e32a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad481083a0 0x7fad48199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4e32a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48108cf0 0x7fad48199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4e32a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad48112810 con 0x7fad48108cf0 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4e32a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fad48112690 con 0x7fad481083a0 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4e32a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fad48112990 con 0x7fad48102a60 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48108cf0 0x7fad48199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48108cf0 0x7fad48199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34316/0 (socket says 172.21.15.81:34316) 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 -- 172.21.15.81:0/2593298348 learned_addr learned my addr 172.21.15.81:0/2593298348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad3ffff640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad481083a0 0x7fad48199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad47fff640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad48102a60 0x7fad48199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 -- 172.21.15.81:0/2593298348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad48102a60 msgr2=0x7fad48199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad48102a60 0x7fad48199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 -- 172.21.15.81:0/2593298348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad481083a0 msgr2=0x7fad48199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad481083a0 0x7fad48199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 -- 172.21.15.81:0/2593298348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad481a8700 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad4c8c7640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48108cf0 0x7fad48199ad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fd0 tx=0x7fad4000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.422+0000 7fad45ffb640 1 -- 172.21.15.81:0/2593298348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40017070 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.423+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad481a89f0 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.423+0000 7fad45ffb640 1 -- 172.21.15.81:0/2593298348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad40003e00 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.423+0000 7fad45ffb640 1 -- 172.21.15.81:0/2593298348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40010460 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.423+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad481a8ee0 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.424+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad48102e70 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.425+0000 7fad45ffb640 1 -- 172.21.15.81:0/2593298348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fad40003970 con 0x7fad48108cf0 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.426+0000 7fad45ffb640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad340b6510 0x7fad340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:28.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.426+0000 7fad47fff640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad340b6510 0x7fad340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.426+0000 7fad45ffb640 1 -- 172.21.15.81:0/2593298348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fad400e7670 con 0x7fad48108cf0 2024-09-21T03:00:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.426+0000 7fad47fff640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad340b6510 0x7fad340b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fad48100b70 tx=0x7fad380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.430+0000 7fad45ffb640 1 -- 172.21.15.81:0/2593298348 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad400b1fa0 con 0x7fad48108cf0 2024-09-21T03:00:28.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.645+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fad4810aac0 con 0x7fad48108cf0 2024-09-21T03:00:28.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.645+0000 7fad45ffb640 1 -- 172.21.15.81:0/2593298348 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+88 (secure 0 0 0) 0x7fad400b6ee0 con 0x7fad48108cf0 2024-09-21T03:00:28.647 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T03:00:28.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad340b6510 msgr2=0x7fad340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:28.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad340b6510 0x7fad340b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fad48100b70 tx=0x7fad380058d0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48108cf0 msgr2=0x7fad48199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48108cf0 0x7fad48199ad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fd0 tx=0x7fad4000b260 comp rx=0 tx=0).stop 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 shutdown_connections 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fad340b6510 0x7fad340b8a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad48108cf0 0x7fad48199ad0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad481083a0 0x7fad48199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 --2- 172.21.15.81:0/2593298348 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad48102a60 0x7fad48199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 >> 172.21.15.81:0/2593298348 conn(0x7fad48079730 msgr2=0x7fad48101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 shutdown_connections 2024-09-21T03:00:28.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:28.648+0000 7fad4e32a640 1 -- 172.21.15.81:0/2593298348 wait complete. 2024-09-21T03:00:29.337 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:29 smithi081 ceph-mon[30991]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:29.337 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:29 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2593298348' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:00:29.338 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:00:29.338 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:00:29.338 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T03:00:29.338 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:00:29.338 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:29.338 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:00:29.339 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:00:29.339 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:00:29.339 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:00:29.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:29.339 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T03:00:29.355 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:00:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:00:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:00:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:00:29.355 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42155sec preferred_lft 42155sec 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T03:00:29.356 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:00:29.357 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:00:29.357 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:00:29.357 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T03:00:29.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:00:29.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-21T03:00:29.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-21T03:00:29.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:00:29.357 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T03:00:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:00:29.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:00:29.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:29.495 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:00:29.520 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T03:00:29.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:29.521 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T03:00:29.578 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T03:00:29.578 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:00:29.578 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:00:29.578 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:00:29.579 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:00:29.579 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:00:29.579 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T03:00:29.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:00:29.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:00:29.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:00:29.579 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T03:00:29.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:00:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:29 smithi164 ceph-mon[34236]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:29 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2593298348' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:00:29.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:00:29.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:29.705 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T03:00:29.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:29.720 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-21T03:00:29.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:29 smithi181 ceph-mon[34096]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:29 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2593298348' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:00:29.776 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:00:29.776 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T03:00:29.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:00:29.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T03:00:29.776 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T03:00:29.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:00:29.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:00:29.894 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T03:00:29.894 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:00:29.894 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T03:00:29.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T03:00:29.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:00:29.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T03:00:29.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T03:00:29.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T03:00:29.895 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T03:00:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:00:30.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:00:30.006 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:00:30.006 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T03:00:30.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T03:00:30.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:00:30.006 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T03:00:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:00:30.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:00:30.083 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-21T03:00:30.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:00:30.083 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:30.113 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:00:30.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:00:30.113 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:30.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-21T03:00:30.234 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T03:00:30.290 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-21T03:00:30.290 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-21T03:00:30.290 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-21T03:00:30.290 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-21T03:00:30.291 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/71f5309a184372d14db39f8c06331334f4eb9dd07e817e770bbe747fc1c6aef9/merged 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/802f08e77b4ce30bf11e857633b63afe9de6b761be8ba3dd6f47d2ab6f61ad4a/merged 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/14917d725a749b2123439a03335f32c0fd141c4aadbfe4d9dc201b599fb8fa12/merged 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/7eb945be1c3fd6e1839b71210e54c369f7ec8035e9a4be33a28239377f615161/merged 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/8d5c3f5951619312f5d0693f8d1da5d0b8f2a88f2cf7f6b74344beee40d7ed77/merged 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/a34224a2f3044d43975f5b2027033f0b4e6612dcbe2447065be07fd9fb6eb08a/merged 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/cace0ddc3dd8c818be03a3fd8c14c9ffa9f8b799b84220224daf69b385bc9cc4/merged 2024-09-21T03:00:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/54227affdef979114705e5c41f9388ebe3aaf4a77807d6da427405ae351dda7b/merged 2024-09-21T03:00:30.293 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/689e63a7551a0c8390e5c49bbf28ab083213a4f683849d1cc963b8664fbaba4e/merged 2024-09-21T03:00:30.293 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/de17c92f254d8668eff4e43d1c6960d4538550bb04b575008e94c8e0ca6f36b1/merged 2024-09-21T03:00:30.293 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-21T03:00:30.293 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:00:30.293 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:00:30.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:30.293 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-21T03:00:30.345 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T03:00:30.345 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/da0e12b5-0d29-42f4-b43a-b13398ac7e0f --client_fs=cephfs) 2024-09-21T03:00:30.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-21T03:00:30.412 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-21T03:00:30.469 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T03:00:30.470 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/71f5309a184372d14db39f8c06331334f4eb9dd07e817e770bbe747fc1c6aef9/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/802f08e77b4ce30bf11e857633b63afe9de6b761be8ba3dd6f47d2ab6f61ad4a/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/14917d725a749b2123439a03335f32c0fd141c4aadbfe4d9dc201b599fb8fa12/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/7eb945be1c3fd6e1839b71210e54c369f7ec8035e9a4be33a28239377f615161/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/8d5c3f5951619312f5d0693f8d1da5d0b8f2a88f2cf7f6b74344beee40d7ed77/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/a34224a2f3044d43975f5b2027033f0b4e6612dcbe2447065be07fd9fb6eb08a/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/cace0ddc3dd8c818be03a3fd8c14c9ffa9f8b799b84220224daf69b385bc9cc4/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/54227affdef979114705e5c41f9388ebe3aaf4a77807d6da427405ae351dda7b/merged 2024-09-21T03:00:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/689e63a7551a0c8390e5c49bbf28ab083213a4f683849d1cc963b8664fbaba4e/merged 2024-09-21T03:00:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/de17c92f254d8668eff4e43d1c6960d4538550bb04b575008e94c8e0ca6f36b1/merged 2024-09-21T03:00:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-21T03:00:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:00:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:00:30.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:30.473 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-21T03:00:30.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-21T03:00:30.478+0000 7f67e9788480 -1 init, newargv = 0x7f67cc004720 newargc=15 2024-09-21T03:00:30.480 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[84075]: starting ceph client 2024-09-21T03:00:30.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[84075]: starting fuse 2024-09-21T03:00:31.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-21T03:00:31.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:31 smithi081 ceph-mon[30991]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:31.625 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T03:00:31.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:31 smithi164 ceph-mon[34236]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:31.682 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-21T03:00:31.682 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-21T03:00:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/71f5309a184372d14db39f8c06331334f4eb9dd07e817e770bbe747fc1c6aef9/merged 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/802f08e77b4ce30bf11e857633b63afe9de6b761be8ba3dd6f47d2ab6f61ad4a/merged 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/0 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/14917d725a749b2123439a03335f32c0fd141c4aadbfe4d9dc201b599fb8fa12/merged 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/7eb945be1c3fd6e1839b71210e54c369f7ec8035e9a4be33a28239377f615161/merged 2024-09-21T03:00:31.684 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/8d5c3f5951619312f5d0693f8d1da5d0b8f2a88f2cf7f6b74344beee40d7ed77/merged 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/a34224a2f3044d43975f5b2027033f0b4e6612dcbe2447065be07fd9fb6eb08a/merged 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/cace0ddc3dd8c818be03a3fd8c14c9ffa9f8b799b84220224daf69b385bc9cc4/merged 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/54227affdef979114705e5c41f9388ebe3aaf4a77807d6da427405ae351dda7b/merged 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/689e63a7551a0c8390e5c49bbf28ab083213a4f683849d1cc963b8664fbaba4e/merged 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/containers/storage/overlay/de17c92f254d8668eff4e43d1c6960d4538550bb04b575008e94c8e0ca6f36b1/merged 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:00:31.685 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:31.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:31.686 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-21T03:00:31.747 INFO:teuthology.orchestra.run.smithi081.stdout:120 2024-09-21T03:00:31.747 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-21T03:00:31.748 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-21T03:00:31.749 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-21T03:00:31.750 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:31 smithi181 ceph-mon[34096]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:00:31.870 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.84075.asok 2024-09-21T03:00:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:00:31.882 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.84075.asok 2024-09-21T03:00:31.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:31.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.84075.asok status 2024-09-21T03:00:32.025 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:32.025 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-21T03:00:32.025 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T03:00:32.025 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:00:32.025 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-21T03:00:32.025 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "84075", 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/volumes/qa/sv_0/da0e12b5-0d29-42f4-b43a-b13398ac7e0f" 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 15417, 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 15417 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-21T03:00:32.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1401197338 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1401197338 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.15417 192.168.0.1:0/1401197338", 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/1401197338", 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 5, 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 24, 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 82, 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-21T03:00:32.027 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-21T03:00:32.028 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:32.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:32.034 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-21T03:00:32.034 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:32.049 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-21T03:00:32.049 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:32.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:00:32.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:32.115 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T03:00:32.124 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:00:32.125 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T03:00:32.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T03:00:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 -- 172.21.15.81:0/769519975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8102c80 msgr2=0x7f3be81050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/769519975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8102c80 0x7f3be81050a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009900 tx=0x7f3be002a410 comp rx=0 tx=0).stop 2024-09-21T03:00:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 -- 172.21.15.81:0/769519975 shutdown_connections 2024-09-21T03:00:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/769519975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be81056e0 0x7f3be8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/769519975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3be8108300 0x7f3be810a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/769519975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8102c80 0x7f3be81050a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:32.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 -- 172.21.15.81:0/769519975 >> 172.21.15.81:0/769519975 conn(0x7f3be80fd6d0 msgr2=0x7f3be80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 -- 172.21.15.81:0/769519975 shutdown_connections 2024-09-21T03:00:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.263+0000 7f3bf07c6640 1 -- 172.21.15.81:0/769519975 wait complete. 2024-09-21T03:00:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 Processor -- start 2024-09-21T03:00:32.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 -- start start 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3be8102c80 0x7f3be8199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be81056e0 0x7f3be819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8108300 0x7f3be819b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3be810f220 con 0x7f3be8108300 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3be810f0a0 con 0x7f3be8102c80 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bf07c6640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3be810f3a0 con 0x7f3be81056e0 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8108300 0x7f3be819b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8108300 0x7f3be819b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60704/0 (socket says 172.21.15.81:60704) 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 -- 172.21.15.81:0/3913831319 learned_addr learned my addr 172.21.15.81:0/3913831319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bee562640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3be8102c80 0x7f3be8199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:32.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 -- 172.21.15.81:0/3913831319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be81056e0 msgr2=0x7f3be819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bedd61640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be81056e0 0x7f3be819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be81056e0 0x7f3be819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 -- 172.21.15.81:0/3913831319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3be8102c80 msgr2=0x7f3be8199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3be8102c80 0x7f3be8199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3beed63640 1 -- 172.21.15.81:0/3913831319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be819b940 con 0x7f3be8108300 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.264+0000 7f3bee562640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3be8102c80 0x7f3be8199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.265+0000 7f3beed63640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8108300 0x7f3be819b120 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800d750 tx=0x7f3bd800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.265+0000 7f3be77fe640 1 -- 172.21.15.81:0/3913831319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8017070 con 0x7f3be8108300 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.265+0000 7f3be77fe640 1 -- 172.21.15.81:0/3913831319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bd80054b0 con 0x7f3be8108300 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.265+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be819bc30 con 0x7f3be8108300 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.265+0000 7f3be77fe640 1 -- 172.21.15.81:0/3913831319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8004b90 con 0x7f3be8108300 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.265+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be81a2320 con 0x7f3be8108300 2024-09-21T03:00:32.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.266+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be80ff1f0 con 0x7f3be8108300 2024-09-21T03:00:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.267+0000 7f3be77fe640 1 -- 172.21.15.81:0/3913831319 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3bd8004d30 con 0x7f3be8108300 2024-09-21T03:00:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.268+0000 7f3be77fe640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3bd00b6590 0x7f3bd00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.268+0000 7f3bee562640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3bd00b6590 0x7f3bd00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.269+0000 7f3be77fe640 1 -- 172.21.15.81:0/3913831319 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f3bd80e74c0 con 0x7f3be8108300 2024-09-21T03:00:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.269+0000 7f3bee562640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3bd00b6590 0x7f3bd00b8aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3be0005f70 tx=0x7f3be0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:32.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.272+0000 7f3be77fe640 1 -- 172.21.15.81:0/3913831319 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3bd80ada90 con 0x7f3be8108300 2024-09-21T03:00:32.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:32.487+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f3be802e640 con 0x7f3be8108300 2024-09-21T03:00:33.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.312+0000 7f3be77fe640 1 -- 172.21.15.81:0/3913831319 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f3bd80b1e70 con 0x7f3be8108300 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3bd00b6590 msgr2=0x7f3bd00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3bd00b6590 0x7f3bd00b8aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3be0005f70 tx=0x7f3be0000bc0 comp rx=0 tx=0).stop 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8108300 msgr2=0x7f3be819b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8108300 0x7f3be819b120 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800d750 tx=0x7f3bd800dc10 comp rx=0 tx=0).stop 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 shutdown_connections 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3bd00b6590 0x7f3bd00b8aa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3be81056e0 0x7f3be819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8108300 0x7f3be819b120 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 --2- 172.21.15.81:0/3913831319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3be8102c80 0x7f3be8199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 >> 172.21.15.81:0/3913831319 conn(0x7f3be80fd6d0 msgr2=0x7f3be8103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 shutdown_connections 2024-09-21T03:00:33.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:33.315+0000 7f3bf07c6640 1 -- 172.21.15.81:0/3913831319 wait complete. 2024-09-21T03:00:33.331 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T03:00:33.341 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T03:00:33.395 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T03:00:33.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T03:00:33.398 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T03:00:33.447 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T03:00:33.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:00:33.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:33 smithi164 ceph-mon[34236]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:00:33.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:33 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3913831319' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T03:00:33.696 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:33 smithi181 ceph-mon[34096]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:00:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:33 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3913831319' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T03:00:33.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:33 smithi081 ceph-mon[30991]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:00:33.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:33 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3913831319' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T03:00:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 -- 172.21.15.81:0/707247854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de41052f0 msgr2=0x7f5de410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 --2- 172.21.15.81:0/707247854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de41052f0 0x7f5de410d930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009900 tx=0x7f5dd802a410 comp rx=0 tx=0).stop 2024-09-21T03:00:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 -- 172.21.15.81:0/707247854 shutdown_connections 2024-09-21T03:00:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 --2- 172.21.15.81:0/707247854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de410de70 0x7f5de4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 --2- 172.21.15.81:0/707247854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de41052f0 0x7f5de410d930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 --2- 172.21.15.81:0/707247854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5de41048c0 0x7f5de4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 -- 172.21.15.81:0/707247854 >> 172.21.15.81:0/707247854 conn(0x7f5de4079740 msgr2=0x7f5de4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 -- 172.21.15.81:0/707247854 shutdown_connections 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.173+0000 7f5dea905640 1 -- 172.21.15.81:0/707247854 wait complete. 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 Processor -- start 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 -- start start 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de41048c0 0x7f5de419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5de41052f0 0x7f5de419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de410de70 0x7f5de419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4113970 con 0x7f5de410de70 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5de41137f0 con 0x7f5de41052f0 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5dea905640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5de4113af0 con 0x7f5de41048c0 2024-09-21T03:00:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5de8ea2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de410de70 0x7f5de419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5de8ea2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de410de70 0x7f5de419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60728/0 (socket says 172.21.15.81:60728) 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5de8ea2640 1 -- 172.21.15.81:0/3320782940 learned_addr learned my addr 172.21.15.81:0/3320782940 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5de3fff640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de41048c0 0x7f5de419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.174+0000 7f5de37fe640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5de41052f0 0x7f5de419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de8ea2640 1 -- 172.21.15.81:0/3320782940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de41048c0 msgr2=0x7f5de419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de8ea2640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de41048c0 0x7f5de419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de8ea2640 1 -- 172.21.15.81:0/3320782940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5de41052f0 msgr2=0x7f5de419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de8ea2640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5de41052f0 0x7f5de419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de8ea2640 1 -- 172.21.15.81:0/3320782940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de41a03f0 con 0x7f5de410de70 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de37fe640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5de41052f0 0x7f5de419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de8ea2640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de410de70 0x7f5de419fcc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00b970 tx=0x7f5ddc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de17fa640 1 -- 172.21.15.81:0/3320782940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc019070 con 0x7f5de410de70 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de17fa640 1 -- 172.21.15.81:0/3320782940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ddc014440 con 0x7f5de410de70 2024-09-21T03:00:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5de17fa640 1 -- 172.21.15.81:0/3320782940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0075d0 con 0x7f5de410de70 2024-09-21T03:00:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de41a06e0 con 0x7f5de410de70 2024-09-21T03:00:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.175+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de41a6e40 con 0x7f5de410de70 2024-09-21T03:00:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.176+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de406c180 con 0x7f5de410de70 2024-09-21T03:00:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.178+0000 7f5de17fa640 1 -- 172.21.15.81:0/3320782940 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5ddc01c070 con 0x7f5de410de70 2024-09-21T03:00:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.179+0000 7f5de17fa640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5dcc0b6510 0x7f5dcc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.179+0000 7f5de3fff640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5dcc0b6510 0x7f5dcc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.179+0000 7f5de17fa640 1 -- 172.21.15.81:0/3320782940 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5ddc0e6aa0 con 0x7f5de410de70 2024-09-21T03:00:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.179+0000 7f5de3fff640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5dcc0b6510 0x7f5dcc0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5de406c880 tx=0x7f5dd400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:34.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.183+0000 7f5de17fa640 1 -- 172.21.15.81:0/3320782940 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ddc0b13d0 con 0x7f5de410de70 2024-09-21T03:00:34.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.363+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5de4109010 con 0x7f5dcc0b6510 2024-09-21T03:00:34.365 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:34 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3913831319' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T03:00:34.365 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:34 smithi081 ceph-mon[30991]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:00:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.369+0000 7f5de17fa640 1 -- 172.21.15.81:0/3320782940 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340730 (secure 0 0 0) 0x7f5dd4010be0 con 0x7f5dcc0b6510 2024-09-21T03:00:34.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:34.375 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5dcc0b6510 msgr2=0x7f5dcc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5dcc0b6510 0x7f5dcc0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5de406c880 tx=0x7f5dd400b390 comp rx=0 tx=0).stop 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de410de70 msgr2=0x7f5de419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de410de70 0x7f5de419fcc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00b970 tx=0x7f5ddc00be30 comp rx=0 tx=0).stop 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 shutdown_connections 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5dcc0b6510 0x7f5dcc0b8a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de410de70 0x7f5de419fcc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5de41052f0 0x7f5de419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 --2- 172.21.15.81:0/3320782940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5de41048c0 0x7f5de419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 >> 172.21.15.81:0/3320782940 conn(0x7f5de4079740 msgr2=0x7f5de40ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 shutdown_connections 2024-09-21T03:00:34.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:34.373+0000 7f5dea905640 1 -- 172.21.15.81:0/3320782940 wait complete. 2024-09-21T03:00:34.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:34 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3913831319' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T03:00:34.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:34 smithi164 ceph-mon[34236]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:00:34.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:34 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3913831319' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T03:00:34.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:34 smithi181 ceph-mon[34096]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:00:35.117 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2024-09-21T03:00:33.738379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662684,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":707,"num_read_kb":457,"num_write":304,"num_write_kb":2281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385232,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556592,"statfs":{"total":1151940427776,"available":1151545950208,"internally_reserved":0,"allocated":11288576,"data_stored":7508504,"data_compressed":389853,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1479,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003428"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.159285+0000","last_change":"2024-09-21T02:58:13.017321+0000","last_active":"2024-09-21T02:58:52.159285+0000","last_peered":"2024-09-21T02:58:52.159285+0000","last_clean":"2024-09-21T02:58:52.159285+0000","last_became_active":"2024-09-21T02:58:13.017017+0000","last_became_peered":"2024-09-21T02:58:13.017017+0000","last_unstale":"2024-09-21T02:58:52.159285+0000","last_undegraded":"2024-09-21T02:58:52.159285+0000","last_fullsized":"2024-09-21T02:58:52.159285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:11.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945098+0000","last_change":"2024-09-21T02:58:15.043883+0000","last_active":"2024-09-21T03:00:17.945098+0000","last_peered":"2024-09-21T03:00:17.945098+0000","last_clean":"2024-09-21T03:00:17.945098+0000","last_became_active":"2024-09-21T02:58:15.043551+0000","last_became_peered":"2024-09-21T02:58:15.043551+0000","last_unstale":"2024-09-21T03:00:17.945098+0000","last_undegraded":"2024-09-21T03:00:17.945098+0000","last_fullsized":"2024-09-21T03:00:17.945098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:40.867181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224252+0000","last_change":"2024-09-21T02:58:22.084562+0000","last_active":"2024-09-21T02:58:49.224252+0000","last_peered":"2024-09-21T02:58:49.224252+0000","last_clean":"2024-09-21T02:58:49.224252+0000","last_became_active":"2024-09-21T02:58:22.084145+0000","last_became_peered":"2024-09-21T02:58:22.084145+0000","last_unstale":"2024-09-21T02:58:49.224252+0000","last_undegraded":"2024-09-21T02:58:49.224252+0000","last_fullsized":"2024-09-21T02:58:49.224252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:56.402375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.151240+0000","last_change":"2024-09-21T02:58:13.553479+0000","last_active":"2024-09-21T02:58:51.151240+0000","last_peered":"2024-09-21T02:58:51.151240+0000","last_clean":"2024-09-21T02:58:51.151240+0000","last_became_active":"2024-09-21T02:58:13.553117+0000","last_became_peered":"2024-09-21T02:58:13.553117+0000","last_unstale":"2024-09-21T02:58:51.151240+0000","last_undegraded":"2024-09-21T02:58:51.151240+0000","last_fullsized":"2024-09-21T02:58:51.151240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:34.301361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955348+0000","last_change":"2024-09-21T02:58:15.041724+0000","last_active":"2024-09-21T03:00:17.955348+0000","last_peered":"2024-09-21T03:00:17.955348+0000","last_clean":"2024-09-21T03:00:17.955348+0000","last_became_active":"2024-09-21T02:58:15.041355+0000","last_became_peered":"2024-09-21T02:58:15.041355+0000","last_unstale":"2024-09-21T03:00:17.955348+0000","last_undegraded":"2024-09-21T03:00:17.955348+0000","last_fullsized":"2024-09-21T03:00:17.955348+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:19.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226270+0000","last_change":"2024-09-21T02:58:22.085004+0000","last_active":"2024-09-21T02:58:49.226270+0000","last_peered":"2024-09-21T02:58:49.226270+0000","last_clean":"2024-09-21T02:58:49.226270+0000","last_became_active":"2024-09-21T02:58:22.084622+0000","last_became_peered":"2024-09-21T02:58:22.084622+0000","last_unstale":"2024-09-21T02:58:49.226270+0000","last_undegraded":"2024-09-21T02:58:49.226270+0000","last_fullsized":"2024-09-21T02:58:49.226270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.303286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152223+0000","last_change":"2024-09-21T02:58:49.237002+0000","last_active":"2024-09-21T02:58:51.152223+0000","last_peered":"2024-09-21T02:58:51.152223+0000","last_clean":"2024-09-21T02:58:51.152223+0000","last_became_active":"2024-09-21T02:58:49.233219+0000","last_became_peered":"2024-09-21T02:58:49.233219+0000","last_unstale":"2024-09-21T02:58:51.152223+0000","last_undegraded":"2024-09-21T02:58:51.152223+0000","last_fullsized":"2024-09-21T02:58:51.152223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:38.409153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955851+0000","last_change":"2024-09-21T02:58:15.051658+0000","last_active":"2024-09-21T03:00:17.955851+0000","last_peered":"2024-09-21T03:00:17.955851+0000","last_clean":"2024-09-21T03:00:17.955851+0000","last_became_active":"2024-09-21T02:58:15.048345+0000","last_became_peered":"2024-09-21T02:58:15.048345+0000","last_unstale":"2024-09-21T03:00:17.955851+0000","last_undegraded":"2024-09-21T03:00:17.955851+0000","last_fullsized":"2024-09-21T03:00:17.955851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:36.069051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.750150+0000","last_change":"2024-09-21T02:58:49.750028+0000","last_active":"2024-09-21T02:58:49.750150+0000","last_peered":"2024-09-21T02:58:49.750150+0000","last_clean":"2024-09-21T02:58:49.750150+0000","last_became_active":"2024-09-21T02:58:49.749587+0000","last_became_peered":"2024-09-21T02:58:49.749587+0000","last_unstale":"2024-09-21T02:58:49.750150+0000","last_undegraded":"2024-09-21T02:58:49.750150+0000","last_fullsized":"2024-09-21T02:58:49.750150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:33.018490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230873+0000","last_change":"2024-09-21T02:58:13.020762+0000","last_active":"2024-09-21T02:58:49.230873+0000","last_peered":"2024-09-21T02:58:49.230873+0000","last_clean":"2024-09-21T02:58:49.230873+0000","last_became_active":"2024-09-21T02:58:13.020263+0000","last_became_peered":"2024-09-21T02:58:13.020263+0000","last_unstale":"2024-09-21T02:58:49.230873+0000","last_undegraded":"2024-09-21T02:58:49.230873+0000","last_fullsized":"2024-09-21T02:58:49.230873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:14.490179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.952394+0000","last_change":"2024-09-21T02:58:15.048732+0000","last_active":"2024-09-21T03:00:17.952394+0000","last_peered":"2024-09-21T03:00:17.952394+0000","last_clean":"2024-09-21T03:00:17.952394+0000","last_became_active":"2024-09-21T02:58:15.048393+0000","last_became_peered":"2024-09-21T02:58:15.048393+0000","last_unstale":"2024-09-21T03:00:17.952394+0000","last_undegraded":"2024-09-21T03:00:17.952394+0000","last_fullsized":"2024-09-21T03:00:17.952394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:07.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225897+0000","last_change":"2024-09-21T02:58:22.087072+0000","last_active":"2024-09-21T02:58:49.225897+0000","last_peered":"2024-09-21T02:58:49.225897+0000","last_clean":"2024-09-21T02:58:49.225897+0000","last_became_active":"2024-09-21T02:58:22.086695+0000","last_became_peered":"2024-09-21T02:58:22.086695+0000","last_unstale":"2024-09-21T02:58:49.225897+0000","last_undegraded":"2024-09-21T02:58:49.225897+0000","last_fullsized":"2024-09-21T02:58:49.225897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:18.592656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953381+0000","last_change":"2024-09-21T02:58:15.043756+0000","last_active":"2024-09-21T03:00:17.953381+0000","last_peered":"2024-09-21T03:00:17.953381+0000","last_clean":"2024-09-21T03:00:17.953381+0000","last_became_active":"2024-09-21T02:58:15.043415+0000","last_became_peered":"2024-09-21T02:58:15.043415+0000","last_unstale":"2024-09-21T03:00:17.953381+0000","last_undegraded":"2024-09-21T03:00:17.953381+0000","last_fullsized":"2024-09-21T03:00:17.953381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:53.655906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156099+0000","last_change":"2024-09-21T02:58:13.017054+0000","last_active":"2024-09-21T02:58:52.156099+0000","last_peered":"2024-09-21T02:58:52.156099+0000","last_clean":"2024-09-21T02:58:52.156099+0000","last_became_active":"2024-09-21T02:58:13.016636+0000","last_became_peered":"2024-09-21T02:58:13.016636+0000","last_unstale":"2024-09-21T02:58:52.156099+0000","last_undegraded":"2024-09-21T02:58:52.156099+0000","last_fullsized":"2024-09-21T02:58:52.156099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:27.941501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226537+0000","last_change":"2024-09-21T02:58:22.229949+0000","last_active":"2024-09-21T02:58:49.226537+0000","last_peered":"2024-09-21T02:58:49.226537+0000","last_clean":"2024-09-21T02:58:49.226537+0000","last_became_active":"2024-09-21T02:58:22.229490+0000","last_became_peered":"2024-09-21T02:58:22.229490+0000","last_unstale":"2024-09-21T02:58:49.226537+0000","last_undegraded":"2024-09-21T02:58:49.226537+0000","last_fullsized":"2024-09-21T02:58:49.226537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:25.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.937881+0000","last_change":"2024-09-21T02:58:15.040559+0000","last_active":"2024-09-21T03:00:17.937881+0000","last_peered":"2024-09-21T03:00:17.937881+0000","last_clean":"2024-09-21T03:00:17.937881+0000","last_became_active":"2024-09-21T02:58:15.040220+0000","last_became_peered":"2024-09-21T02:58:15.040220+0000","last_unstale":"2024-09-21T03:00:17.937881+0000","last_undegraded":"2024-09-21T03:00:17.937881+0000","last_fullsized":"2024-09-21T03:00:17.937881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:55.853966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.138954+0000","last_change":"2024-09-21T02:58:13.017985+0000","last_active":"2024-09-21T02:58:51.138954+0000","last_peered":"2024-09-21T02:58:51.138954+0000","last_clean":"2024-09-21T02:58:51.138954+0000","last_became_active":"2024-09-21T02:58:13.017583+0000","last_became_peered":"2024-09-21T02:58:13.017583+0000","last_unstale":"2024-09-21T02:58:51.138954+0000","last_undegraded":"2024-09-21T02:58:51.138954+0000","last_fullsized":"2024-09-21T02:58:51.138954+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.917960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226338+0000","last_change":"2024-09-21T02:58:22.077294+0000","last_active":"2024-09-21T02:58:49.226338+0000","last_peered":"2024-09-21T02:58:49.226338+0000","last_clean":"2024-09-21T02:58:49.226338+0000","last_became_active":"2024-09-21T02:58:22.076884+0000","last_became_peered":"2024-09-21T02:58:22.076884+0000","last_unstale":"2024-09-21T02:58:49.226338+0000","last_undegraded":"2024-09-21T02:58:49.226338+0000","last_fullsized":"2024-09-21T02:58:49.226338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:00.045383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941399+0000","last_change":"2024-09-21T02:58:15.045160+0000","last_active":"2024-09-21T03:00:17.941399+0000","last_peered":"2024-09-21T03:00:17.941399+0000","last_clean":"2024-09-21T03:00:17.941399+0000","last_became_active":"2024-09-21T02:58:15.044814+0000","last_became_peered":"2024-09-21T02:58:15.044814+0000","last_unstale":"2024-09-21T03:00:17.941399+0000","last_undegraded":"2024-09-21T03:00:17.941399+0000","last_fullsized":"2024-09-21T03:00:17.941399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:13.325320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146885+0000","last_change":"2024-09-21T02:58:13.011081+0000","last_active":"2024-09-21T02:58:50.146885+0000","last_peered":"2024-09-21T02:58:50.146885+0000","last_clean":"2024-09-21T02:58:50.146885+0000","last_became_active":"2024-09-21T02:58:13.010682+0000","last_became_peered":"2024-09-21T02:58:13.010682+0000","last_unstale":"2024-09-21T02:58:50.146885+0000","last_undegraded":"2024-09-21T02:58:50.146885+0000","last_fullsized":"2024-09-21T02:58:50.146885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224126+0000","last_change":"2024-09-21T02:58:22.083449+0000","last_active":"2024-09-21T02:58:49.224126+0000","last_peered":"2024-09-21T02:58:49.224126+0000","last_clean":"2024-09-21T02:58:49.224126+0000","last_became_active":"2024-09-21T02:58:22.082996+0000","last_became_peered":"2024-09-21T02:58:22.082996+0000","last_unstale":"2024-09-21T02:58:49.224126+0000","last_undegraded":"2024-09-21T02:58:49.224126+0000","last_fullsized":"2024-09-21T02:58:49.224126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:21.667824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.936125+0000","last_change":"2024-09-21T02:58:15.039458+0000","last_active":"2024-09-21T03:00:17.936125+0000","last_peered":"2024-09-21T03:00:17.936125+0000","last_clean":"2024-09-21T03:00:17.936125+0000","last_became_active":"2024-09-21T02:58:15.039082+0000","last_became_peered":"2024-09-21T02:58:15.039082+0000","last_unstale":"2024-09-21T03:00:17.936125+0000","last_undegraded":"2024-09-21T03:00:17.936125+0000","last_fullsized":"2024-09-21T03:00:17.936125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:37.102212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147405+0000","last_change":"2024-09-21T02:58:49.982108+0000","last_active":"2024-09-21T02:58:50.147405+0000","last_peered":"2024-09-21T02:58:50.147405+0000","last_clean":"2024-09-21T02:58:50.147405+0000","last_became_active":"2024-09-21T02:58:49.981462+0000","last_became_peered":"2024-09-21T02:58:49.981462+0000","last_unstale":"2024-09-21T02:58:50.147405+0000","last_undegraded":"2024-09-21T02:58:50.147405+0000","last_fullsized":"2024-09-21T02:58:50.147405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:17.624627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226847+0000","last_change":"2024-09-21T02:58:22.231082+0000","last_active":"2024-09-21T02:58:49.226847+0000","last_peered":"2024-09-21T02:58:49.226847+0000","last_clean":"2024-09-21T02:58:49.226847+0000","last_became_active":"2024-09-21T02:58:22.229781+0000","last_became_peered":"2024-09-21T02:58:22.229781+0000","last_unstale":"2024-09-21T02:58:49.226847+0000","last_undegraded":"2024-09-21T02:58:49.226847+0000","last_fullsized":"2024-09-21T02:58:49.226847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:14.964809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951174+0000","last_change":"2024-09-21T02:58:15.033111+0000","last_active":"2024-09-21T03:00:17.951174+0000","last_peered":"2024-09-21T03:00:17.951174+0000","last_clean":"2024-09-21T03:00:17.951174+0000","last_became_active":"2024-09-21T02:58:15.032738+0000","last_became_peered":"2024-09-21T02:58:15.032738+0000","last_unstale":"2024-09-21T03:00:17.951174+0000","last_undegraded":"2024-09-21T03:00:17.951174+0000","last_fullsized":"2024-09-21T03:00:17.951174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:31.209451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147612+0000","last_change":"2024-09-21T02:58:13.229717+0000","last_active":"2024-09-21T02:58:50.147612+0000","last_peered":"2024-09-21T02:58:50.147612+0000","last_clean":"2024-09-21T02:58:50.147612+0000","last_became_active":"2024-09-21T02:58:13.229376+0000","last_became_peered":"2024-09-21T02:58:13.229376+0000","last_unstale":"2024-09-21T02:58:50.147612+0000","last_undegraded":"2024-09-21T02:58:50.147612+0000","last_fullsized":"2024-09-21T02:58:50.147612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:05.436044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224498+0000","last_change":"2024-09-21T02:58:22.081140+0000","last_active":"2024-09-21T02:58:49.224498+0000","last_peered":"2024-09-21T02:58:49.224498+0000","last_clean":"2024-09-21T02:58:49.224498+0000","last_became_active":"2024-09-21T02:58:22.080670+0000","last_became_peered":"2024-09-21T02:58:22.080670+0000","last_unstale":"2024-09-21T02:58:49.224498+0000","last_undegraded":"2024-09-21T02:58:49.224498+0000","last_fullsized":"2024-09-21T02:58:49.224498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:43.078241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938803+0000","last_change":"2024-09-21T02:58:15.035927+0000","last_active":"2024-09-21T03:00:17.938803+0000","last_peered":"2024-09-21T03:00:17.938803+0000","last_clean":"2024-09-21T03:00:17.938803+0000","last_became_active":"2024-09-21T02:58:15.035529+0000","last_became_peered":"2024-09-21T02:58:15.035529+0000","last_unstale":"2024-09-21T03:00:17.938803+0000","last_undegraded":"2024-09-21T03:00:17.938803+0000","last_fullsized":"2024-09-21T03:00:17.938803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'13","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:18.057394+0000","last_change":"2024-09-21T02:58:13.016489+0000","last_active":"2024-09-21T03:00:18.057394+0000","last_peered":"2024-09-21T03:00:18.057394+0000","last_clean":"2024-09-21T03:00:18.057394+0000","last_became_active":"2024-09-21T02:58:13.016176+0000","last_became_peered":"2024-09-21T02:58:13.016176+0000","last_unstale":"2024-09-21T03:00:18.057394+0000","last_undegraded":"2024-09-21T03:00:18.057394+0000","last_fullsized":"2024-09-21T03:00:18.057394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:54.908933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227910+0000","last_change":"2024-09-21T02:58:22.229868+0000","last_active":"2024-09-21T02:58:49.227910+0000","last_peered":"2024-09-21T02:58:49.227910+0000","last_clean":"2024-09-21T02:58:49.227910+0000","last_became_active":"2024-09-21T02:58:22.229318+0000","last_became_peered":"2024-09-21T02:58:22.229318+0000","last_unstale":"2024-09-21T02:58:49.227910+0000","last_undegraded":"2024-09-21T02:58:49.227910+0000","last_fullsized":"2024-09-21T02:58:49.227910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:06.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944913+0000","last_change":"2024-09-21T02:58:15.037953+0000","last_active":"2024-09-21T03:00:17.944913+0000","last_peered":"2024-09-21T03:00:17.944913+0000","last_clean":"2024-09-21T03:00:17.944913+0000","last_became_active":"2024-09-21T02:58:15.036934+0000","last_became_peered":"2024-09-21T02:58:15.036934+0000","last_unstale":"2024-09-21T03:00:17.944913+0000","last_undegraded":"2024-09-21T03:00:17.944913+0000","last_fullsized":"2024-09-21T03:00:17.944913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:35.118295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.152171+0000","last_change":"2024-09-21T02:58:13.553861+0000","last_active":"2024-09-21T02:58:52.152171+0000","last_peered":"2024-09-21T02:58:52.152171+0000","last_clean":"2024-09-21T02:58:52.152171+0000","last_became_active":"2024-09-21T02:58:13.553016+0000","last_became_peered":"2024-09-21T02:58:13.553016+0000","last_unstale":"2024-09-21T02:58:52.152171+0000","last_undegraded":"2024-09-21T02:58:52.152171+0000","last_fullsized":"2024-09-21T02:58:52.152171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227080+0000","last_change":"2024-09-21T02:58:22.087306+0000","last_active":"2024-09-21T02:58:49.227080+0000","last_peered":"2024-09-21T02:58:49.227080+0000","last_clean":"2024-09-21T02:58:49.227080+0000","last_became_active":"2024-09-21T02:58:22.086800+0000","last_became_peered":"2024-09-21T02:58:22.086800+0000","last_unstale":"2024-09-21T02:58:49.227080+0000","last_undegraded":"2024-09-21T02:58:49.227080+0000","last_fullsized":"2024-09-21T02:58:49.227080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:28.652990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938678+0000","last_change":"2024-09-21T02:58:15.038383+0000","last_active":"2024-09-21T03:00:17.938678+0000","last_peered":"2024-09-21T03:00:17.938678+0000","last_clean":"2024-09-21T03:00:17.938678+0000","last_became_active":"2024-09-21T02:58:15.037878+0000","last_became_peered":"2024-09-21T02:58:15.037878+0000","last_unstale":"2024-09-21T03:00:17.938678+0000","last_undegraded":"2024-09-21T03:00:17.938678+0000","last_fullsized":"2024-09-21T03:00:17.938678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:14.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223927+0000","last_change":"2024-09-21T02:58:13.555218+0000","last_active":"2024-09-21T02:58:49.223927+0000","last_peered":"2024-09-21T02:58:49.223927+0000","last_clean":"2024-09-21T02:58:49.223927+0000","last_became_active":"2024-09-21T02:58:13.554831+0000","last_became_peered":"2024-09-21T02:58:13.554831+0000","last_unstale":"2024-09-21T02:58:49.223927+0000","last_undegraded":"2024-09-21T02:58:49.223927+0000","last_fullsized":"2024-09-21T02:58:49.223927+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:32.659118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230196+0000","last_change":"2024-09-21T02:58:22.229673+0000","last_active":"2024-09-21T02:58:49.230196+0000","last_peered":"2024-09-21T02:58:49.230196+0000","last_clean":"2024-09-21T02:58:49.230196+0000","last_became_active":"2024-09-21T02:58:22.229034+0000","last_became_peered":"2024-09-21T02:58:22.229034+0000","last_unstale":"2024-09-21T02:58:49.230196+0000","last_undegraded":"2024-09-21T02:58:49.230196+0000","last_fullsized":"2024-09-21T02:58:49.230196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:26.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.948504+0000","last_change":"2024-09-21T02:58:49.981660+0000","last_active":"2024-09-21T03:00:17.948504+0000","last_peered":"2024-09-21T03:00:17.948504+0000","last_clean":"2024-09-21T03:00:17.948504+0000","last_became_active":"2024-09-21T02:58:49.980972+0000","last_became_peered":"2024-09-21T02:58:49.980972+0000","last_unstale":"2024-09-21T03:00:17.948504+0000","last_undegraded":"2024-09-21T03:00:17.948504+0000","last_fullsized":"2024-09-21T03:00:17.948504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:26.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152564+0000","last_change":"2024-09-21T02:58:13.012751+0000","last_active":"2024-09-21T02:58:51.152564+0000","last_peered":"2024-09-21T02:58:51.152564+0000","last_clean":"2024-09-21T02:58:51.152564+0000","last_became_active":"2024-09-21T02:58:13.012341+0000","last_became_peered":"2024-09-21T02:58:13.012341+0000","last_unstale":"2024-09-21T02:58:51.152564+0000","last_undegraded":"2024-09-21T02:58:51.152564+0000","last_fullsized":"2024-09-21T02:58:51.152564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435102+0000","last_change":"2024-09-21T02:58:22.084620+0000","last_active":"2024-09-21T02:58:49.435102+0000","last_peered":"2024-09-21T02:58:49.435102+0000","last_clean":"2024-09-21T02:58:49.435102+0000","last_became_active":"2024-09-21T02:58:22.083935+0000","last_became_peered":"2024-09-21T02:58:22.083935+0000","last_unstale":"2024-09-21T02:58:49.435102+0000","last_undegraded":"2024-09-21T02:58:49.435102+0000","last_fullsized":"2024-09-21T02:58:49.435102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:37.033928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942732+0000","last_change":"2024-09-21T02:58:15.046935+0000","last_active":"2024-09-21T03:00:17.942732+0000","last_peered":"2024-09-21T03:00:17.942732+0000","last_clean":"2024-09-21T03:00:17.942732+0000","last_became_active":"2024-09-21T02:58:15.046572+0000","last_became_peered":"2024-09-21T02:58:15.046572+0000","last_unstale":"2024-09-21T03:00:17.942732+0000","last_undegraded":"2024-09-21T03:00:17.942732+0000","last_fullsized":"2024-09-21T03:00:17.942732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.942643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:32.373923+0000","last_change":"2024-09-21T02:58:13.553337+0000","last_active":"2024-09-21T03:00:32.373923+0000","last_peered":"2024-09-21T03:00:32.373923+0000","last_clean":"2024-09-21T03:00:32.373923+0000","last_became_active":"2024-09-21T02:58:13.552873+0000","last_became_peered":"2024-09-21T02:58:13.552873+0000","last_unstale":"2024-09-21T03:00:32.373923+0000","last_undegraded":"2024-09-21T03:00:32.373923+0000","last_fullsized":"2024-09-21T03:00:32.373923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:42.800873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435293+0000","last_change":"2024-09-21T02:58:22.230102+0000","last_active":"2024-09-21T02:58:49.435293+0000","last_peered":"2024-09-21T02:58:49.435293+0000","last_clean":"2024-09-21T02:58:49.435293+0000","last_became_active":"2024-09-21T02:58:22.229643+0000","last_became_peered":"2024-09-21T02:58:22.229643+0000","last_unstale":"2024-09-21T02:58:49.435293+0000","last_undegraded":"2024-09-21T02:58:49.435293+0000","last_fullsized":"2024-09-21T02:58:49.435293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.396292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938272+0000","last_change":"2024-09-21T02:58:15.043484+0000","last_active":"2024-09-21T03:00:17.938272+0000","last_peered":"2024-09-21T03:00:17.938272+0000","last_clean":"2024-09-21T03:00:17.938272+0000","last_became_active":"2024-09-21T02:58:15.042663+0000","last_became_peered":"2024-09-21T02:58:15.042663+0000","last_unstale":"2024-09-21T03:00:17.938272+0000","last_undegraded":"2024-09-21T03:00:17.938272+0000","last_fullsized":"2024-09-21T03:00:17.938272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:42.937814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152465+0000","last_change":"2024-09-21T02:58:13.018109+0000","last_active":"2024-09-21T02:58:51.152465+0000","last_peered":"2024-09-21T02:58:51.152465+0000","last_clean":"2024-09-21T02:58:51.152465+0000","last_became_active":"2024-09-21T02:58:13.017761+0000","last_became_peered":"2024-09-21T02:58:13.017761+0000","last_unstale":"2024-09-21T02:58:51.152465+0000","last_undegraded":"2024-09-21T02:58:51.152465+0000","last_fullsized":"2024-09-21T02:58:51.152465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:12.613051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748934+0000","last_change":"2024-09-21T02:58:22.230520+0000","last_active":"2024-09-21T02:58:49.748934+0000","last_peered":"2024-09-21T02:58:49.748934+0000","last_clean":"2024-09-21T02:58:49.748934+0000","last_became_active":"2024-09-21T02:58:22.229999+0000","last_became_peered":"2024-09-21T02:58:22.229999+0000","last_unstale":"2024-09-21T02:58:49.748934+0000","last_undegraded":"2024-09-21T02:58:49.748934+0000","last_fullsized":"2024-09-21T02:58:49.748934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:12.899892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944775+0000","last_change":"2024-09-21T02:58:15.040357+0000","last_active":"2024-09-21T03:00:17.944775+0000","last_peered":"2024-09-21T03:00:17.944775+0000","last_clean":"2024-09-21T03:00:17.944775+0000","last_became_active":"2024-09-21T02:58:15.040026+0000","last_became_peered":"2024-09-21T02:58:15.040026+0000","last_unstale":"2024-09-21T03:00:17.944775+0000","last_undegraded":"2024-09-21T03:00:17.944775+0000","last_fullsized":"2024-09-21T03:00:17.944775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.216541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156121+0000","last_change":"2024-09-21T02:58:13.014816+0000","last_active":"2024-09-21T02:58:52.156121+0000","last_peered":"2024-09-21T02:58:52.156121+0000","last_clean":"2024-09-21T02:58:52.156121+0000","last_became_active":"2024-09-21T02:58:13.013918+0000","last_became_peered":"2024-09-21T02:58:13.013918+0000","last_unstale":"2024-09-21T02:58:52.156121+0000","last_undegraded":"2024-09-21T02:58:52.156121+0000","last_fullsized":"2024-09-21T02:58:52.156121+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:20.892671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230777+0000","last_change":"2024-09-21T02:57:01.191389+0000","last_active":"2024-09-21T02:58:49.230777+0000","last_peered":"2024-09-21T02:58:49.230777+0000","last_clean":"2024-09-21T02:58:49.230777+0000","last_became_active":"2024-09-21T02:57:01.185686+0000","last_became_peered":"2024-09-21T02:57:01.185686+0000","last_unstale":"2024-09-21T02:58:49.230777+0000","last_undegraded":"2024-09-21T02:58:49.230777+0000","last_fullsized":"2024-09-21T02:58:49.230777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_clean_scrub_stamp":"2024-09-21T02:53:36.647024+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.275496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:57.775841+0000","last_change":"2024-09-21T02:58:22.081891+0000","last_active":"2024-09-21T02:58:57.775841+0000","last_peered":"2024-09-21T02:58:57.775841+0000","last_clean":"2024-09-21T02:58:57.775841+0000","last_became_active":"2024-09-21T02:58:22.081435+0000","last_became_peered":"2024-09-21T02:58:22.081435+0000","last_unstale":"2024-09-21T02:58:57.775841+0000","last_undegraded":"2024-09-21T02:58:57.775841+0000","last_fullsized":"2024-09-21T02:58:57.775841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:51.161690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954785+0000","last_change":"2024-09-21T02:58:15.045013+0000","last_active":"2024-09-21T03:00:17.954785+0000","last_peered":"2024-09-21T03:00:17.954785+0000","last_clean":"2024-09-21T03:00:17.954785+0000","last_became_active":"2024-09-21T02:58:15.044650+0000","last_became_peered":"2024-09-21T02:58:15.044650+0000","last_unstale":"2024-09-21T03:00:17.954785+0000","last_undegraded":"2024-09-21T03:00:17.954785+0000","last_fullsized":"2024-09-21T03:00:17.954785+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:39.087982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.159341+0000","last_change":"2024-09-21T02:58:13.553468+0000","last_active":"2024-09-21T02:58:52.159341+0000","last_peered":"2024-09-21T02:58:52.159341+0000","last_clean":"2024-09-21T02:58:52.159341+0000","last_became_active":"2024-09-21T02:58:13.552965+0000","last_became_peered":"2024-09-21T02:58:13.552965+0000","last_unstale":"2024-09-21T02:58:52.159341+0000","last_undegraded":"2024-09-21T02:58:52.159341+0000","last_fullsized":"2024-09-21T02:58:52.159341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:35.224581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227428+0000","last_change":"2024-09-21T02:58:22.086994+0000","last_active":"2024-09-21T02:58:49.227428+0000","last_peered":"2024-09-21T02:58:49.227428+0000","last_clean":"2024-09-21T02:58:49.227428+0000","last_became_active":"2024-09-21T02:58:22.086506+0000","last_became_peered":"2024-09-21T02:58:22.086506+0000","last_unstale":"2024-09-21T02:58:49.227428+0000","last_undegraded":"2024-09-21T02:58:49.227428+0000","last_fullsized":"2024-09-21T02:58:49.227428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:09.102495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.940988+0000","last_change":"2024-09-21T02:58:15.040224+0000","last_active":"2024-09-21T03:00:17.940988+0000","last_peered":"2024-09-21T03:00:17.940988+0000","last_clean":"2024-09-21T03:00:17.940988+0000","last_became_active":"2024-09-21T02:58:15.039115+0000","last_became_peered":"2024-09-21T02:58:15.039115+0000","last_unstale":"2024-09-21T03:00:17.940988+0000","last_undegraded":"2024-09-21T03:00:17.940988+0000","last_fullsized":"2024-09-21T03:00:17.940988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:35.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156123+0000","last_change":"2024-09-21T02:58:13.021526+0000","last_active":"2024-09-21T02:58:52.156123+0000","last_peered":"2024-09-21T02:58:52.156123+0000","last_clean":"2024-09-21T02:58:52.156123+0000","last_became_active":"2024-09-21T02:58:13.020521+0000","last_became_peered":"2024-09-21T02:58:13.020521+0000","last_unstale":"2024-09-21T02:58:52.156123+0000","last_undegraded":"2024-09-21T02:58:52.156123+0000","last_fullsized":"2024-09-21T02:58:52.156123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:08.645141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980132+0000","last_change":"2024-09-21T02:58:22.077862+0000","last_active":"2024-09-21T02:58:49.980132+0000","last_peered":"2024-09-21T02:58:49.980132+0000","last_clean":"2024-09-21T02:58:49.980132+0000","last_became_active":"2024-09-21T02:58:22.077410+0000","last_became_peered":"2024-09-21T02:58:22.077410+0000","last_unstale":"2024-09-21T02:58:49.980132+0000","last_undegraded":"2024-09-21T02:58:49.980132+0000","last_fullsized":"2024-09-21T02:58:49.980132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:06.549842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.935791+0000","last_change":"2024-09-21T02:58:15.037775+0000","last_active":"2024-09-21T03:00:17.935791+0000","last_peered":"2024-09-21T03:00:17.935791+0000","last_clean":"2024-09-21T03:00:17.935791+0000","last_became_active":"2024-09-21T02:58:15.037036+0000","last_became_peered":"2024-09-21T02:58:15.037036+0000","last_unstale":"2024-09-21T03:00:17.935791+0000","last_undegraded":"2024-09-21T03:00:17.935791+0000","last_fullsized":"2024-09-21T03:00:17.935791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:58.289785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435300+0000","last_change":"2024-09-21T02:58:13.015046+0000","last_active":"2024-09-21T02:58:49.435300+0000","last_peered":"2024-09-21T02:58:49.435300+0000","last_clean":"2024-09-21T02:58:49.435300+0000","last_became_active":"2024-09-21T02:58:13.014643+0000","last_became_peered":"2024-09-21T02:58:13.014643+0000","last_unstale":"2024-09-21T02:58:49.435300+0000","last_undegraded":"2024-09-21T02:58:49.435300+0000","last_fullsized":"2024-09-21T02:58:49.435300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:54.913187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.747960+0000","last_change":"2024-09-21T02:58:22.085805+0000","last_active":"2024-09-21T02:58:49.747960+0000","last_peered":"2024-09-21T02:58:49.747960+0000","last_clean":"2024-09-21T02:58:49.747960+0000","last_became_active":"2024-09-21T02:58:22.084752+0000","last_became_peered":"2024-09-21T02:58:22.084752+0000","last_unstale":"2024-09-21T02:58:49.747960+0000","last_undegraded":"2024-09-21T02:58:49.747960+0000","last_fullsized":"2024-09-21T02:58:49.747960+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:39.357089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941139+0000","last_change":"2024-09-21T02:58:15.046643+0000","last_active":"2024-09-21T03:00:17.941139+0000","last_peered":"2024-09-21T03:00:17.941139+0000","last_clean":"2024-09-21T03:00:17.941139+0000","last_became_active":"2024-09-21T02:58:15.046278+0000","last_became_peered":"2024-09-21T02:58:15.046278+0000","last_unstale":"2024-09-21T03:00:17.941139+0000","last_undegraded":"2024-09-21T03:00:17.941139+0000","last_fullsized":"2024-09-21T03:00:17.941139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.648084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156242+0000","last_change":"2024-09-21T02:58:13.022176+0000","last_active":"2024-09-21T02:58:52.156242+0000","last_peered":"2024-09-21T02:58:52.156242+0000","last_clean":"2024-09-21T02:58:52.156242+0000","last_became_active":"2024-09-21T02:58:13.020122+0000","last_became_peered":"2024-09-21T02:58:13.020122+0000","last_unstale":"2024-09-21T02:58:52.156242+0000","last_undegraded":"2024-09-21T02:58:52.156242+0000","last_fullsized":"2024-09-21T02:58:52.156242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:12.346056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748411+0000","last_change":"2024-09-21T02:58:22.084221+0000","last_active":"2024-09-21T02:58:49.748411+0000","last_peered":"2024-09-21T02:58:49.748411+0000","last_clean":"2024-09-21T02:58:49.748411+0000","last_became_active":"2024-09-21T02:58:22.083793+0000","last_became_peered":"2024-09-21T02:58:22.083793+0000","last_unstale":"2024-09-21T02:58:49.748411+0000","last_undegraded":"2024-09-21T02:58:49.748411+0000","last_fullsized":"2024-09-21T02:58:49.748411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:13.043641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947630+0000","last_change":"2024-09-21T02:58:49.233440+0000","last_active":"2024-09-21T03:00:17.947630+0000","last_peered":"2024-09-21T03:00:17.947630+0000","last_clean":"2024-09-21T03:00:17.947630+0000","last_became_active":"2024-09-21T02:58:49.232996+0000","last_became_peered":"2024-09-21T02:58:49.232996+0000","last_unstale":"2024-09-21T03:00:17.947630+0000","last_undegraded":"2024-09-21T03:00:17.947630+0000","last_fullsized":"2024-09-21T03:00:17.947630+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:13.181861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.154616+0000","last_change":"2024-09-21T02:58:13.553866+0000","last_active":"2024-09-21T02:58:51.154616+0000","last_peered":"2024-09-21T02:58:51.154616+0000","last_clean":"2024-09-21T02:58:51.154616+0000","last_became_active":"2024-09-21T02:58:13.553001+0000","last_became_peered":"2024-09-21T02:58:13.553001+0000","last_unstale":"2024-09-21T02:58:51.154616+0000","last_undegraded":"2024-09-21T02:58:51.154616+0000","last_fullsized":"2024-09-21T02:58:51.154616+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:43.995773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435231+0000","last_change":"2024-09-21T02:58:22.090253+0000","last_active":"2024-09-21T02:58:49.435231+0000","last_peered":"2024-09-21T02:58:49.435231+0000","last_clean":"2024-09-21T02:58:49.435231+0000","last_became_active":"2024-09-21T02:58:22.089818+0000","last_became_peered":"2024-09-21T02:58:22.089818+0000","last_unstale":"2024-09-21T02:58:49.435231+0000","last_undegraded":"2024-09-21T02:58:49.435231+0000","last_fullsized":"2024-09-21T02:58:49.435231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:09.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.940533+0000","last_change":"2024-09-21T02:58:15.042479+0000","last_active":"2024-09-21T03:00:17.940533+0000","last_peered":"2024-09-21T03:00:17.940533+0000","last_clean":"2024-09-21T03:00:17.940533+0000","last_became_active":"2024-09-21T02:58:15.042087+0000","last_became_peered":"2024-09-21T02:58:15.042087+0000","last_unstale":"2024-09-21T03:00:17.940533+0000","last_undegraded":"2024-09-21T03:00:17.940533+0000","last_fullsized":"2024-09-21T03:00:17.940533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.427736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:31.372600+0000","last_change":"2024-09-21T02:58:13.012559+0000","last_active":"2024-09-21T03:00:31.372600+0000","last_peered":"2024-09-21T03:00:31.372600+0000","last_clean":"2024-09-21T03:00:31.372600+0000","last_became_active":"2024-09-21T02:58:13.011062+0000","last_became_peered":"2024-09-21T02:58:13.011062+0000","last_unstale":"2024-09-21T03:00:31.372600+0000","last_undegraded":"2024-09-21T03:00:31.372600+0000","last_fullsized":"2024-09-21T03:00:31.372600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:17.839898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224241+0000","last_change":"2024-09-21T02:58:22.081196+0000","last_active":"2024-09-21T02:58:49.224241+0000","last_peered":"2024-09-21T02:58:49.224241+0000","last_clean":"2024-09-21T02:58:49.224241+0000","last_became_active":"2024-09-21T02:58:22.080787+0000","last_became_peered":"2024-09-21T02:58:22.080787+0000","last_unstale":"2024-09-21T02:58:49.224241+0000","last_undegraded":"2024-09-21T02:58:49.224241+0000","last_fullsized":"2024-09-21T02:58:49.224241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.283112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951437+0000","last_change":"2024-09-21T02:58:15.046322+0000","last_active":"2024-09-21T03:00:17.951437+0000","last_peered":"2024-09-21T03:00:17.951437+0000","last_clean":"2024-09-21T03:00:17.951437+0000","last_became_active":"2024-09-21T02:58:15.045936+0000","last_became_peered":"2024-09-21T02:58:15.045936+0000","last_unstale":"2024-09-21T03:00:17.951437+0000","last_undegraded":"2024-09-21T03:00:17.951437+0000","last_fullsized":"2024-09-21T03:00:17.951437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:08.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145891+0000","last_change":"2024-09-21T02:58:13.022277+0000","last_active":"2024-09-21T02:58:50.145891+0000","last_peered":"2024-09-21T02:58:50.145891+0000","last_clean":"2024-09-21T02:58:50.145891+0000","last_became_active":"2024-09-21T02:58:13.021901+0000","last_became_peered":"2024-09-21T02:58:13.021901+0000","last_unstale":"2024-09-21T02:58:50.145891+0000","last_undegraded":"2024-09-21T02:58:50.145891+0000","last_fullsized":"2024-09-21T02:58:50.145891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:01.029435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226991+0000","last_change":"2024-09-21T02:58:22.088951+0000","last_active":"2024-09-21T02:58:49.226991+0000","last_peered":"2024-09-21T02:58:49.226991+0000","last_clean":"2024-09-21T02:58:49.226991+0000","last_became_active":"2024-09-21T02:58:22.088427+0000","last_became_peered":"2024-09-21T02:58:22.088427+0000","last_unstale":"2024-09-21T02:58:49.226991+0000","last_undegraded":"2024-09-21T02:58:49.226991+0000","last_fullsized":"2024-09-21T02:58:49.226991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:52.700517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.934441+0000","last_change":"2024-09-21T02:58:15.038390+0000","last_active":"2024-09-21T03:00:17.934441+0000","last_peered":"2024-09-21T03:00:17.934441+0000","last_clean":"2024-09-21T03:00:17.934441+0000","last_became_active":"2024-09-21T02:58:15.037368+0000","last_became_peered":"2024-09-21T02:58:15.037368+0000","last_unstale":"2024-09-21T03:00:17.934441+0000","last_undegraded":"2024-09-21T03:00:17.934441+0000","last_fullsized":"2024-09-21T03:00:17.934441+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:54.736444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152969+0000","last_change":"2024-09-21T02:58:13.013246+0000","last_active":"2024-09-21T02:58:51.152969+0000","last_peered":"2024-09-21T02:58:51.152969+0000","last_clean":"2024-09-21T02:58:51.152969+0000","last_became_active":"2024-09-21T02:58:13.012830+0000","last_became_peered":"2024-09-21T02:58:13.012830+0000","last_unstale":"2024-09-21T02:58:51.152969+0000","last_undegraded":"2024-09-21T02:58:51.152969+0000","last_fullsized":"2024-09-21T02:58:51.152969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:31.406565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748517+0000","last_change":"2024-09-21T02:58:22.086799+0000","last_active":"2024-09-21T02:58:49.748517+0000","last_peered":"2024-09-21T02:58:49.748517+0000","last_clean":"2024-09-21T02:58:49.748517+0000","last_became_active":"2024-09-21T02:58:22.086395+0000","last_became_peered":"2024-09-21T02:58:22.086395+0000","last_unstale":"2024-09-21T02:58:49.748517+0000","last_undegraded":"2024-09-21T02:58:49.748517+0000","last_fullsized":"2024-09-21T02:58:49.748517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:38.985072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.935637+0000","last_change":"2024-09-21T02:58:15.037346+0000","last_active":"2024-09-21T03:00:17.935637+0000","last_peered":"2024-09-21T03:00:17.935637+0000","last_clean":"2024-09-21T03:00:17.935637+0000","last_became_active":"2024-09-21T02:58:15.036984+0000","last_became_peered":"2024-09-21T02:58:15.036984+0000","last_unstale":"2024-09-21T03:00:17.935637+0000","last_undegraded":"2024-09-21T03:00:17.935637+0000","last_fullsized":"2024-09-21T03:00:17.935637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:43.856844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":279,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:30.325009+0000","last_change":"2024-09-21T02:58:13.018287+0000","last_active":"2024-09-21T03:00:30.325009+0000","last_peered":"2024-09-21T03:00:30.325009+0000","last_clean":"2024-09-21T03:00:30.325009+0000","last_became_active":"2024-09-21T02:58:13.017908+0000","last_became_peered":"2024-09-21T02:58:13.017908+0000","last_unstale":"2024-09-21T03:00:30.325009+0000","last_undegraded":"2024-09-21T03:00:30.325009+0000","last_fullsized":"2024-09-21T03:00:30.325009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:30.422946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66954,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":170,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223420+0000","last_change":"2024-09-21T02:58:22.078106+0000","last_active":"2024-09-21T02:58:49.223420+0000","last_peered":"2024-09-21T02:58:49.223420+0000","last_clean":"2024-09-21T02:58:49.223420+0000","last_became_active":"2024-09-21T02:58:22.077675+0000","last_became_peered":"2024-09-21T02:58:22.077675+0000","last_unstale":"2024-09-21T02:58:49.223420+0000","last_undegraded":"2024-09-21T02:58:49.223420+0000","last_fullsized":"2024-09-21T02:58:49.223420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:08.965865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955019+0000","last_change":"2024-09-21T02:58:15.045911+0000","last_active":"2024-09-21T03:00:17.955019+0000","last_peered":"2024-09-21T03:00:17.955019+0000","last_clean":"2024-09-21T03:00:17.955019+0000","last_became_active":"2024-09-21T02:58:15.045506+0000","last_became_peered":"2024-09-21T02:58:15.045506+0000","last_unstale":"2024-09-21T03:00:17.955019+0000","last_undegraded":"2024-09-21T03:00:17.955019+0000","last_fullsized":"2024-09-21T03:00:17.955019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.982730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.144087+0000","last_change":"2024-09-21T02:58:13.555132+0000","last_active":"2024-09-21T02:58:50.144087+0000","last_peered":"2024-09-21T02:58:50.144087+0000","last_clean":"2024-09-21T02:58:50.144087+0000","last_became_active":"2024-09-21T02:58:13.554582+0000","last_became_peered":"2024-09-21T02:58:13.554582+0000","last_unstale":"2024-09-21T02:58:50.144087+0000","last_undegraded":"2024-09-21T02:58:50.144087+0000","last_fullsized":"2024-09-21T02:58:50.144087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:56.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.234599+0000","last_change":"2024-09-21T02:58:49.234443+0000","last_active":"2024-09-21T02:58:49.234599+0000","last_peered":"2024-09-21T02:58:49.234599+0000","last_clean":"2024-09-21T02:58:49.234599+0000","last_became_active":"2024-09-21T02:58:49.233758+0000","last_became_peered":"2024-09-21T02:58:49.233758+0000","last_unstale":"2024-09-21T02:58:49.234599+0000","last_undegraded":"2024-09-21T02:58:49.234599+0000","last_fullsized":"2024-09-21T02:58:49.234599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:06.821726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944745+0000","last_change":"2024-09-21T02:58:15.033598+0000","last_active":"2024-09-21T03:00:17.944745+0000","last_peered":"2024-09-21T03:00:17.944745+0000","last_clean":"2024-09-21T03:00:17.944745+0000","last_became_active":"2024-09-21T02:58:15.033268+0000","last_became_peered":"2024-09-21T02:58:15.033268+0000","last_unstale":"2024-09-21T03:00:17.944745+0000","last_undegraded":"2024-09-21T03:00:17.944745+0000","last_fullsized":"2024-09-21T03:00:17.944745+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:25.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145942+0000","last_change":"2024-09-21T02:58:13.018159+0000","last_active":"2024-09-21T02:58:50.145942+0000","last_peered":"2024-09-21T02:58:50.145942+0000","last_clean":"2024-09-21T02:58:50.145942+0000","last_became_active":"2024-09-21T02:58:13.017263+0000","last_became_peered":"2024-09-21T02:58:13.017263+0000","last_unstale":"2024-09-21T02:58:50.145942+0000","last_undegraded":"2024-09-21T02:58:50.145942+0000","last_fullsized":"2024-09-21T02:58:50.145942+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:47.981435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.982319+0000","last_change":"2024-09-21T02:58:49.981593+0000","last_active":"2024-09-21T02:58:49.982319+0000","last_peered":"2024-09-21T02:58:49.982319+0000","last_clean":"2024-09-21T02:58:49.982319+0000","last_became_active":"2024-09-21T02:58:49.980890+0000","last_became_peered":"2024-09-21T02:58:49.980890+0000","last_unstale":"2024-09-21T02:58:49.982319+0000","last_undegraded":"2024-09-21T02:58:49.982319+0000","last_fullsized":"2024-09-21T02:58:49.982319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:59.251327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955362+0000","last_change":"2024-09-21T02:58:15.049561+0000","last_active":"2024-09-21T03:00:17.955362+0000","last_peered":"2024-09-21T03:00:17.955362+0000","last_clean":"2024-09-21T03:00:17.955362+0000","last_became_active":"2024-09-21T02:58:15.049205+0000","last_became_peered":"2024-09-21T02:58:15.049205+0000","last_unstale":"2024-09-21T03:00:17.955362+0000","last_undegraded":"2024-09-21T03:00:17.955362+0000","last_fullsized":"2024-09-21T03:00:17.955362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:56.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":138,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:30.314273+0000","last_change":"2024-09-21T02:58:13.018964+0000","last_active":"2024-09-21T03:00:30.314273+0000","last_peered":"2024-09-21T03:00:30.314273+0000","last_clean":"2024-09-21T03:00:30.314273+0000","last_became_active":"2024-09-21T02:58:13.017420+0000","last_became_peered":"2024-09-21T02:58:13.017420+0000","last_unstale":"2024-09-21T03:00:30.314273+0000","last_undegraded":"2024-09-21T03:00:30.314273+0000","last_fullsized":"2024-09-21T03:00:30.314273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233600+0000","last_change":"2024-09-21T02:58:49.233486+0000","last_active":"2024-09-21T02:58:49.233600+0000","last_peered":"2024-09-21T02:58:49.233600+0000","last_clean":"2024-09-21T02:58:49.233600+0000","last_became_active":"2024-09-21T02:58:49.232940+0000","last_became_peered":"2024-09-21T02:58:49.232940+0000","last_unstale":"2024-09-21T02:58:49.233600+0000","last_undegraded":"2024-09-21T02:58:49.233600+0000","last_fullsized":"2024-09-21T02:58:49.233600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:19.283141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979795+0000","last_change":"2024-09-21T02:58:22.085163+0000","last_active":"2024-09-21T02:58:49.979795+0000","last_peered":"2024-09-21T02:58:49.979795+0000","last_clean":"2024-09-21T02:58:49.979795+0000","last_became_active":"2024-09-21T02:58:22.084768+0000","last_became_peered":"2024-09-21T02:58:22.084768+0000","last_unstale":"2024-09-21T02:58:49.979795+0000","last_undegraded":"2024-09-21T02:58:49.979795+0000","last_fullsized":"2024-09-21T02:58:49.979795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:46.892421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947197+0000","last_change":"2024-09-21T02:58:15.035051+0000","last_active":"2024-09-21T03:00:17.947197+0000","last_peered":"2024-09-21T03:00:17.947197+0000","last_clean":"2024-09-21T03:00:17.947197+0000","last_became_active":"2024-09-21T02:58:15.034692+0000","last_became_peered":"2024-09-21T02:58:15.034692+0000","last_unstale":"2024-09-21T03:00:17.947197+0000","last_undegraded":"2024-09-21T03:00:17.947197+0000","last_fullsized":"2024-09-21T03:00:17.947197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:14.605154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748786+0000","last_change":"2024-09-21T02:58:13.018102+0000","last_active":"2024-09-21T02:58:49.748786+0000","last_peered":"2024-09-21T02:58:49.748786+0000","last_clean":"2024-09-21T02:58:49.748786+0000","last_became_active":"2024-09-21T02:58:13.017537+0000","last_became_peered":"2024-09-21T02:58:13.017537+0000","last_unstale":"2024-09-21T02:58:49.748786+0000","last_undegraded":"2024-09-21T02:58:49.748786+0000","last_fullsized":"2024-09-21T02:58:49.748786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:40.096326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227485+0000","last_change":"2024-09-21T02:58:22.084362+0000","last_active":"2024-09-21T02:58:49.227485+0000","last_peered":"2024-09-21T02:58:49.227485+0000","last_clean":"2024-09-21T02:58:49.227485+0000","last_became_active":"2024-09-21T02:58:22.083895+0000","last_became_peered":"2024-09-21T02:58:22.083895+0000","last_unstale":"2024-09-21T02:58:49.227485+0000","last_undegraded":"2024-09-21T02:58:49.227485+0000","last_fullsized":"2024-09-21T02:58:49.227485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:54.101588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.932312+0000","last_change":"2024-09-21T02:58:15.034768+0000","last_active":"2024-09-21T03:00:17.932312+0000","last_peered":"2024-09-21T03:00:17.932312+0000","last_clean":"2024-09-21T03:00:17.932312+0000","last_became_active":"2024-09-21T02:58:15.034420+0000","last_became_peered":"2024-09-21T02:58:15.034420+0000","last_unstale":"2024-09-21T03:00:17.932312+0000","last_undegraded":"2024-09-21T03:00:17.932312+0000","last_fullsized":"2024-09-21T03:00:17.932312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:25.750158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152269+0000","last_change":"2024-09-21T02:58:13.015026+0000","last_active":"2024-09-21T02:58:51.152269+0000","last_peered":"2024-09-21T02:58:51.152269+0000","last_clean":"2024-09-21T02:58:51.152269+0000","last_became_active":"2024-09-21T02:58:13.014668+0000","last_became_peered":"2024-09-21T02:58:13.014668+0000","last_unstale":"2024-09-21T02:58:51.152269+0000","last_undegraded":"2024-09-21T02:58:51.152269+0000","last_fullsized":"2024-09-21T02:58:51.152269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:20.117518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153234+0000","last_change":"2024-09-21T02:58:13.018044+0000","last_active":"2024-09-21T02:58:51.153234+0000","last_peered":"2024-09-21T02:58:51.153234+0000","last_clean":"2024-09-21T02:58:51.153234+0000","last_became_active":"2024-09-21T02:58:13.017628+0000","last_became_peered":"2024-09-21T02:58:13.017628+0000","last_unstale":"2024-09-21T02:58:51.153234+0000","last_undegraded":"2024-09-21T02:58:51.153234+0000","last_fullsized":"2024-09-21T02:58:51.153234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:38.749379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942552+0000","last_change":"2024-09-21T02:58:15.048160+0000","last_active":"2024-09-21T03:00:17.942552+0000","last_peered":"2024-09-21T03:00:17.942552+0000","last_clean":"2024-09-21T03:00:17.942552+0000","last_became_active":"2024-09-21T02:58:15.046371+0000","last_became_peered":"2024-09-21T02:58:15.046371+0000","last_unstale":"2024-09-21T03:00:17.942552+0000","last_undegraded":"2024-09-21T03:00:17.942552+0000","last_fullsized":"2024-09-21T03:00:17.942552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:49.386799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224497+0000","last_change":"2024-09-21T02:58:22.089918+0000","last_active":"2024-09-21T02:58:49.224497+0000","last_peered":"2024-09-21T02:58:49.224497+0000","last_clean":"2024-09-21T02:58:49.224497+0000","last_became_active":"2024-09-21T02:58:22.089457+0000","last_became_peered":"2024-09-21T02:58:22.089457+0000","last_unstale":"2024-09-21T02:58:49.224497+0000","last_undegraded":"2024-09-21T02:58:49.224497+0000","last_fullsized":"2024-09-21T02:58:49.224497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:28.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:31.316323+0000","last_change":"2024-09-21T02:58:13.021192+0000","last_active":"2024-09-21T03:00:31.316323+0000","last_peered":"2024-09-21T03:00:31.316323+0000","last_clean":"2024-09-21T03:00:31.316323+0000","last_became_active":"2024-09-21T02:58:13.020746+0000","last_became_peered":"2024-09-21T02:58:13.020746+0000","last_unstale":"2024-09-21T03:00:31.316323+0000","last_undegraded":"2024-09-21T03:00:31.316323+0000","last_fullsized":"2024-09-21T03:00:31.316323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:13.260225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.946573+0000","last_change":"2024-09-21T02:58:15.038375+0000","last_active":"2024-09-21T03:00:17.946573+0000","last_peered":"2024-09-21T03:00:17.946573+0000","last_clean":"2024-09-21T03:00:17.946573+0000","last_became_active":"2024-09-21T02:58:15.038011+0000","last_became_peered":"2024-09-21T02:58:15.038011+0000","last_unstale":"2024-09-21T03:00:17.946573+0000","last_undegraded":"2024-09-21T03:00:17.946573+0000","last_fullsized":"2024-09-21T03:00:17.946573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:50.820554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224842+0000","last_change":"2024-09-21T02:58:22.088436+0000","last_active":"2024-09-21T02:58:49.224842+0000","last_peered":"2024-09-21T02:58:49.224842+0000","last_clean":"2024-09-21T02:58:49.224842+0000","last_became_active":"2024-09-21T02:58:22.087857+0000","last_became_peered":"2024-09-21T02:58:22.087857+0000","last_unstale":"2024-09-21T02:58:49.224842+0000","last_undegraded":"2024-09-21T02:58:49.224842+0000","last_fullsized":"2024-09-21T02:58:49.224842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:40.314833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942098+0000","last_change":"2024-09-21T02:58:15.041490+0000","last_active":"2024-09-21T03:00:17.942098+0000","last_peered":"2024-09-21T03:00:17.942098+0000","last_clean":"2024-09-21T03:00:17.942098+0000","last_became_active":"2024-09-21T02:58:15.041106+0000","last_became_peered":"2024-09-21T02:58:15.041106+0000","last_unstale":"2024-09-21T03:00:17.942098+0000","last_undegraded":"2024-09-21T03:00:17.942098+0000","last_fullsized":"2024-09-21T03:00:17.942098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:57.228254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951748+0000","last_change":"2024-09-21T02:58:15.041375+0000","last_active":"2024-09-21T03:00:17.951748+0000","last_peered":"2024-09-21T03:00:17.951748+0000","last_clean":"2024-09-21T03:00:17.951748+0000","last_became_active":"2024-09-21T02:58:15.041041+0000","last_became_peered":"2024-09-21T02:58:15.041041+0000","last_unstale":"2024-09-21T03:00:17.951748+0000","last_undegraded":"2024-09-21T03:00:17.951748+0000","last_fullsized":"2024-09-21T03:00:17.951748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:49.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938040+0000","last_change":"2024-09-21T02:58:15.036772+0000","last_active":"2024-09-21T03:00:17.938040+0000","last_peered":"2024-09-21T03:00:17.938040+0000","last_clean":"2024-09-21T03:00:17.938040+0000","last_became_active":"2024-09-21T02:58:15.036390+0000","last_became_peered":"2024-09-21T02:58:15.036390+0000","last_unstale":"2024-09-21T03:00:17.938040+0000","last_undegraded":"2024-09-21T03:00:17.938040+0000","last_fullsized":"2024-09-21T03:00:17.938040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:49.169184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.950999+0000","last_change":"2024-09-21T02:58:15.035375+0000","last_active":"2024-09-21T03:00:17.950999+0000","last_peered":"2024-09-21T03:00:17.950999+0000","last_clean":"2024-09-21T03:00:17.950999+0000","last_became_active":"2024-09-21T02:58:15.035015+0000","last_became_peered":"2024-09-21T02:58:15.035015+0000","last_unstale":"2024-09-21T03:00:17.950999+0000","last_undegraded":"2024-09-21T03:00:17.950999+0000","last_fullsized":"2024-09-21T03:00:17.950999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:32.980690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938021+0000","last_change":"2024-09-21T02:58:15.046431+0000","last_active":"2024-09-21T03:00:17.938021+0000","last_peered":"2024-09-21T03:00:17.938021+0000","last_clean":"2024-09-21T03:00:17.938021+0000","last_became_active":"2024-09-21T02:58:15.046048+0000","last_became_peered":"2024-09-21T02:58:15.046048+0000","last_unstale":"2024-09-21T03:00:17.938021+0000","last_undegraded":"2024-09-21T03:00:17.938021+0000","last_fullsized":"2024-09-21T03:00:17.938021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:42.079020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.943370+0000","last_change":"2024-09-21T02:58:15.043192+0000","last_active":"2024-09-21T03:00:17.943370+0000","last_peered":"2024-09-21T03:00:17.943370+0000","last_clean":"2024-09-21T03:00:17.943370+0000","last_became_active":"2024-09-21T02:58:15.042413+0000","last_became_peered":"2024-09-21T02:58:15.042413+0000","last_unstale":"2024-09-21T03:00:17.943370+0000","last_undegraded":"2024-09-21T03:00:17.943370+0000","last_fullsized":"2024-09-21T03:00:17.943370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:31.491311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945252+0000","last_change":"2024-09-21T02:58:15.040194+0000","last_active":"2024-09-21T03:00:17.945252+0000","last_peered":"2024-09-21T03:00:17.945252+0000","last_clean":"2024-09-21T03:00:17.945252+0000","last_became_active":"2024-09-21T02:58:15.039803+0000","last_became_peered":"2024-09-21T02:58:15.039803+0000","last_unstale":"2024-09-21T03:00:17.945252+0000","last_undegraded":"2024-09-21T03:00:17.945252+0000","last_fullsized":"2024-09-21T03:00:17.945252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:21.357004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939815+0000","last_change":"2024-09-21T02:58:15.043038+0000","last_active":"2024-09-21T03:00:17.939815+0000","last_peered":"2024-09-21T03:00:17.939815+0000","last_clean":"2024-09-21T03:00:17.939815+0000","last_became_active":"2024-09-21T02:58:15.042643+0000","last_became_peered":"2024-09-21T02:58:15.042643+0000","last_unstale":"2024-09-21T03:00:17.939815+0000","last_undegraded":"2024-09-21T03:00:17.939815+0000","last_fullsized":"2024-09-21T03:00:17.939815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:14.639995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944730+0000","last_change":"2024-09-21T02:58:15.037015+0000","last_active":"2024-09-21T03:00:17.944730+0000","last_peered":"2024-09-21T03:00:17.944730+0000","last_clean":"2024-09-21T03:00:17.944730+0000","last_became_active":"2024-09-21T02:58:15.036628+0000","last_became_peered":"2024-09-21T02:58:15.036628+0000","last_unstale":"2024-09-21T03:00:17.944730+0000","last_undegraded":"2024-09-21T03:00:17.944730+0000","last_fullsized":"2024-09-21T03:00:17.944730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:07.823178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.940728+0000","last_change":"2024-09-21T02:58:15.041768+0000","last_active":"2024-09-21T03:00:17.940728+0000","last_peered":"2024-09-21T03:00:17.940728+0000","last_clean":"2024-09-21T03:00:17.940728+0000","last_became_active":"2024-09-21T02:58:15.041374+0000","last_became_peered":"2024-09-21T02:58:15.041374+0000","last_unstale":"2024-09-21T03:00:17.940728+0000","last_undegraded":"2024-09-21T03:00:17.940728+0000","last_fullsized":"2024-09-21T03:00:17.940728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:25.145949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.952784+0000","last_change":"2024-09-21T02:58:15.047263+0000","last_active":"2024-09-21T03:00:17.952784+0000","last_peered":"2024-09-21T03:00:17.952784+0000","last_clean":"2024-09-21T03:00:17.952784+0000","last_became_active":"2024-09-21T02:58:15.046490+0000","last_became_peered":"2024-09-21T02:58:15.046490+0000","last_unstale":"2024-09-21T03:00:17.952784+0000","last_undegraded":"2024-09-21T03:00:17.952784+0000","last_fullsized":"2024-09-21T03:00:17.952784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:45.413510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939463+0000","last_change":"2024-09-21T02:58:15.034115+0000","last_active":"2024-09-21T03:00:17.939463+0000","last_peered":"2024-09-21T03:00:17.939463+0000","last_clean":"2024-09-21T03:00:17.939463+0000","last_became_active":"2024-09-21T02:58:15.033709+0000","last_became_peered":"2024-09-21T02:58:15.033709+0000","last_unstale":"2024-09-21T03:00:17.939463+0000","last_undegraded":"2024-09-21T03:00:17.939463+0000","last_fullsized":"2024-09-21T03:00:17.939463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:54.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.943614+0000","last_change":"2024-09-21T02:58:15.047154+0000","last_active":"2024-09-21T03:00:17.943614+0000","last_peered":"2024-09-21T03:00:17.943614+0000","last_clean":"2024-09-21T03:00:17.943614+0000","last_became_active":"2024-09-21T02:58:15.046777+0000","last_became_peered":"2024-09-21T02:58:15.046777+0000","last_unstale":"2024-09-21T03:00:17.943614+0000","last_undegraded":"2024-09-21T03:00:17.943614+0000","last_fullsized":"2024-09-21T03:00:17.943614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:56.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939462+0000","last_change":"2024-09-21T02:58:15.036867+0000","last_active":"2024-09-21T03:00:17.939462+0000","last_peered":"2024-09-21T03:00:17.939462+0000","last_clean":"2024-09-21T03:00:17.939462+0000","last_became_active":"2024-09-21T02:58:15.036228+0000","last_became_peered":"2024-09-21T02:58:15.036228+0000","last_unstale":"2024-09-21T03:00:17.939462+0000","last_undegraded":"2024-09-21T03:00:17.939462+0000","last_fullsized":"2024-09-21T03:00:17.939462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:11.245917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947344+0000","last_change":"2024-09-21T02:58:15.037311+0000","last_active":"2024-09-21T03:00:17.947344+0000","last_peered":"2024-09-21T03:00:17.947344+0000","last_clean":"2024-09-21T03:00:17.947344+0000","last_became_active":"2024-09-21T02:58:15.036909+0000","last_became_peered":"2024-09-21T02:58:15.036909+0000","last_unstale":"2024-09-21T03:00:17.947344+0000","last_undegraded":"2024-09-21T03:00:17.947344+0000","last_fullsized":"2024-09-21T03:00:17.947344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:35.250000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953942+0000","last_change":"2024-09-21T02:58:15.042678+0000","last_active":"2024-09-21T03:00:17.953942+0000","last_peered":"2024-09-21T03:00:17.953942+0000","last_clean":"2024-09-21T03:00:17.953942+0000","last_became_active":"2024-09-21T02:58:15.042334+0000","last_became_peered":"2024-09-21T02:58:15.042334+0000","last_unstale":"2024-09-21T03:00:17.953942+0000","last_undegraded":"2024-09-21T03:00:17.953942+0000","last_fullsized":"2024-09-21T03:00:17.953942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:09.302354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953098+0000","last_change":"2024-09-21T02:58:15.040741+0000","last_active":"2024-09-21T03:00:17.953098+0000","last_peered":"2024-09-21T03:00:17.953098+0000","last_clean":"2024-09-21T03:00:17.953098+0000","last_became_active":"2024-09-21T02:58:15.040357+0000","last_became_peered":"2024-09-21T02:58:15.040357+0000","last_unstale":"2024-09-21T03:00:17.953098+0000","last_undegraded":"2024-09-21T03:00:17.953098+0000","last_fullsized":"2024-09-21T03:00:17.953098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.950877+0000","last_change":"2024-09-21T02:58:15.029780+0000","last_active":"2024-09-21T03:00:17.950877+0000","last_peered":"2024-09-21T03:00:17.950877+0000","last_clean":"2024-09-21T03:00:17.950877+0000","last_became_active":"2024-09-21T02:58:15.029259+0000","last_became_peered":"2024-09-21T02:58:15.029259+0000","last_unstale":"2024-09-21T03:00:17.950877+0000","last_undegraded":"2024-09-21T03:00:17.950877+0000","last_fullsized":"2024-09-21T03:00:17.950877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:35.683337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945010+0000","last_change":"2024-09-21T02:58:15.040557+0000","last_active":"2024-09-21T03:00:17.945010+0000","last_peered":"2024-09-21T03:00:17.945010+0000","last_clean":"2024-09-21T03:00:17.945010+0000","last_became_active":"2024-09-21T02:58:15.040178+0000","last_became_peered":"2024-09-21T02:58:15.040178+0000","last_unstale":"2024-09-21T03:00:17.945010+0000","last_undegraded":"2024-09-21T03:00:17.945010+0000","last_fullsized":"2024-09-21T03:00:17.945010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:50.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.925448+0000","last_change":"2024-09-21T02:58:15.041717+0000","last_active":"2024-09-21T03:00:17.925448+0000","last_peered":"2024-09-21T03:00:17.925448+0000","last_clean":"2024-09-21T03:00:17.925448+0000","last_became_active":"2024-09-21T02:58:15.041375+0000","last_became_peered":"2024-09-21T02:58:15.041375+0000","last_unstale":"2024-09-21T03:00:17.925448+0000","last_undegraded":"2024-09-21T03:00:17.925448+0000","last_fullsized":"2024-09-21T03:00:17.925448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:22.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.924845+0000","last_change":"2024-09-21T02:58:15.042001+0000","last_active":"2024-09-21T03:00:17.924845+0000","last_peered":"2024-09-21T03:00:17.924845+0000","last_clean":"2024-09-21T03:00:17.924845+0000","last_became_active":"2024-09-21T02:58:15.038585+0000","last_became_peered":"2024-09-21T02:58:15.038585+0000","last_unstale":"2024-09-21T03:00:17.924845+0000","last_undegraded":"2024-09-21T03:00:17.924845+0000","last_fullsized":"2024-09-21T03:00:17.924845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954646+0000","last_change":"2024-09-21T02:58:15.046636+0000","last_active":"2024-09-21T03:00:17.954646+0000","last_peered":"2024-09-21T03:00:17.954646+0000","last_clean":"2024-09-21T03:00:17.954646+0000","last_became_active":"2024-09-21T02:58:15.046103+0000","last_became_peered":"2024-09-21T02:58:15.046103+0000","last_unstale":"2024-09-21T03:00:17.954646+0000","last_undegraded":"2024-09-21T03:00:17.954646+0000","last_fullsized":"2024-09-21T03:00:17.954646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.579641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.946646+0000","last_change":"2024-09-21T02:58:15.045461+0000","last_active":"2024-09-21T03:00:17.946646+0000","last_peered":"2024-09-21T03:00:17.946646+0000","last_clean":"2024-09-21T03:00:17.946646+0000","last_became_active":"2024-09-21T02:58:15.045091+0000","last_became_peered":"2024-09-21T02:58:15.045091+0000","last_unstale":"2024-09-21T03:00:17.946646+0000","last_undegraded":"2024-09-21T03:00:17.946646+0000","last_fullsized":"2024-09-21T03:00:17.946646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:33.078860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954069+0000","last_change":"2024-09-21T02:58:15.042454+0000","last_active":"2024-09-21T03:00:17.954069+0000","last_peered":"2024-09-21T03:00:17.954069+0000","last_clean":"2024-09-21T03:00:17.954069+0000","last_became_active":"2024-09-21T02:58:15.042071+0000","last_became_peered":"2024-09-21T02:58:15.042071+0000","last_unstale":"2024-09-21T03:00:17.954069+0000","last_undegraded":"2024-09-21T03:00:17.954069+0000","last_fullsized":"2024-09-21T03:00:17.954069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:09.798110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941111+0000","last_change":"2024-09-21T02:58:15.039238+0000","last_active":"2024-09-21T03:00:17.941111+0000","last_peered":"2024-09-21T03:00:17.941111+0000","last_clean":"2024-09-21T03:00:17.941111+0000","last_became_active":"2024-09-21T02:58:15.037883+0000","last_became_peered":"2024-09-21T02:58:15.037883+0000","last_unstale":"2024-09-21T03:00:17.941111+0000","last_undegraded":"2024-09-21T03:00:17.941111+0000","last_fullsized":"2024-09-21T03:00:17.941111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:13.418696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941466+0000","last_change":"2024-09-21T02:58:15.040236+0000","last_active":"2024-09-21T03:00:17.941466+0000","last_peered":"2024-09-21T03:00:17.941466+0000","last_clean":"2024-09-21T03:00:17.941466+0000","last_became_active":"2024-09-21T02:58:15.039895+0000","last_became_peered":"2024-09-21T02:58:15.039895+0000","last_unstale":"2024-09-21T03:00:17.941466+0000","last_undegraded":"2024-09-21T03:00:17.941466+0000","last_fullsized":"2024-09-21T03:00:17.941466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:48.099127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.949016+0000","last_change":"2024-09-21T02:58:15.044804+0000","last_active":"2024-09-21T03:00:17.949016+0000","last_peered":"2024-09-21T03:00:17.949016+0000","last_clean":"2024-09-21T03:00:17.949016+0000","last_became_active":"2024-09-21T02:58:15.044446+0000","last_became_peered":"2024-09-21T02:58:15.044446+0000","last_unstale":"2024-09-21T03:00:17.949016+0000","last_undegraded":"2024-09-21T03:00:17.949016+0000","last_fullsized":"2024-09-21T03:00:17.949016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:37.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.917965+0000","last_change":"2024-09-21T02:58:15.034219+0000","last_active":"2024-09-21T03:00:17.917965+0000","last_peered":"2024-09-21T03:00:17.917965+0000","last_clean":"2024-09-21T03:00:17.917965+0000","last_became_active":"2024-09-21T02:58:15.033775+0000","last_became_peered":"2024-09-21T02:58:15.033775+0000","last_unstale":"2024-09-21T03:00:17.917965+0000","last_undegraded":"2024-09-21T03:00:17.917965+0000","last_fullsized":"2024-09-21T03:00:17.917965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:12.534737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945403+0000","last_change":"2024-09-21T02:58:49.231259+0000","last_active":"2024-09-21T03:00:17.945403+0000","last_peered":"2024-09-21T03:00:17.945403+0000","last_clean":"2024-09-21T03:00:17.945403+0000","last_became_active":"2024-09-21T02:58:49.230867+0000","last_became_peered":"2024-09-21T02:58:49.230867+0000","last_unstale":"2024-09-21T03:00:17.945403+0000","last_undegraded":"2024-09-21T03:00:17.945403+0000","last_fullsized":"2024-09-21T03:00:17.945403+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:11.163458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954842+0000","last_change":"2024-09-21T02:58:15.037273+0000","last_active":"2024-09-21T03:00:17.954842+0000","last_peered":"2024-09-21T03:00:17.954842+0000","last_clean":"2024-09-21T03:00:17.954842+0000","last_became_active":"2024-09-21T02:58:15.036879+0000","last_became_peered":"2024-09-21T02:58:15.036879+0000","last_unstale":"2024-09-21T03:00:17.954842+0000","last_undegraded":"2024-09-21T03:00:17.954842+0000","last_fullsized":"2024-09-21T03:00:17.954842+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:50.721998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944928+0000","last_change":"2024-09-21T02:58:15.035716+0000","last_active":"2024-09-21T03:00:17.944928+0000","last_peered":"2024-09-21T03:00:17.944928+0000","last_clean":"2024-09-21T03:00:17.944928+0000","last_became_active":"2024-09-21T02:58:15.035356+0000","last_became_peered":"2024-09-21T02:58:15.035356+0000","last_unstale":"2024-09-21T03:00:17.944928+0000","last_undegraded":"2024-09-21T03:00:17.944928+0000","last_fullsized":"2024-09-21T03:00:17.944928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953875+0000","last_change":"2024-09-21T02:58:15.041737+0000","last_active":"2024-09-21T03:00:17.953875+0000","last_peered":"2024-09-21T03:00:17.953875+0000","last_clean":"2024-09-21T03:00:17.953875+0000","last_became_active":"2024-09-21T02:58:15.041387+0000","last_became_peered":"2024-09-21T02:58:15.041387+0000","last_unstale":"2024-09-21T03:00:17.953875+0000","last_undegraded":"2024-09-21T03:00:17.953875+0000","last_fullsized":"2024-09-21T03:00:17.953875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.893510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72082,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":631,"num_read_kb":393,"num_write":179,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281500,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":462290,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972398,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1116551,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135923,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":466622,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":462446,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495677,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1058496,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659203,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":457702,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855431,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":1054045,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018957,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":463377,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215185,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":457896,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444118,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":525423,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":524566,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":459090,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:00:35.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:00:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:35.494 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:35 smithi081 ceph-mon[30991]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T03:00:35.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:35 smithi081 ceph-mon[30991]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:35.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:35 smithi181 ceph-mon[34096]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T03:00:35.650 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:35 smithi181 ceph-mon[34096]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:35.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:35 smithi164 ceph-mon[34236]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T03:00:35.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:35 smithi164 ceph-mon[34236]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 -- 172.21.15.81:0/591598974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 msgr2=0x7f0dd8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 --2- 172.21.15.81:0/591598974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8103f90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009900 tx=0x7f0dc802a410 comp rx=0 tx=0).stop 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 -- 172.21.15.81:0/591598974 shutdown_connections 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 --2- 172.21.15.81:0/591598974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dd8109e10 0x7f0dd8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 --2- 172.21.15.81:0/591598974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dd81094c0 0x7f0dd81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 --2- 172.21.15.81:0/591598974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8103f90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 -- 172.21.15.81:0/591598974 >> 172.21.15.81:0/591598974 conn(0x7f0dd80ff610 msgr2=0x7f0dd8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 -- 172.21.15.81:0/591598974 shutdown_connections 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 -- 172.21.15.81:0/591598974 wait complete. 2024-09-21T03:00:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 Processor -- start 2024-09-21T03:00:35.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.900+0000 7f0ddded5640 1 -- start start 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0ddded5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0ddded5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dd81094c0 0x7f0dd8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0ddded5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dd8109e10 0x7f0dd8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0ddded5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd81139d0 con 0x7f0dd8103b80 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0ddded5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd8113850 con 0x7f0dd8109e10 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0ddded5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd8113b50 con 0x7f0dd81094c0 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60748/0 (socket says 172.21.15.81:60748) 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 -- 172.21.15.81:0/3872917760 learned_addr learned my addr 172.21.15.81:0/3872917760 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dcffff640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dd81094c0 0x7f0dd8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd7fff640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dd8109e10 0x7f0dd8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 -- 172.21.15.81:0/3872917760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dd81094c0 msgr2=0x7f0dd8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dd81094c0 0x7f0dd8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 -- 172.21.15.81:0/3872917760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dd8109e10 msgr2=0x7f0dd8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dd8109e10 0x7f0dd8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 -- 172.21.15.81:0/3872917760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd81a8680 con 0x7f0dd8103b80 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.901+0000 7f0dd77fe640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8075710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0dc802a930 tx=0x7f0dc8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.902+0000 7f0dd57fa640 1 -- 172.21.15.81:0/3872917760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc803f070 con 0x7f0dd8103b80 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.902+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd81a8910 con 0x7f0dd8103b80 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.902+0000 7f0dd57fa640 1 -- 172.21.15.81:0/3872917760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0dc8003e40 con 0x7f0dd8103b80 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.902+0000 7f0dd57fa640 1 -- 172.21.15.81:0/3872917760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8035030 con 0x7f0dd8103b80 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.902+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd81a8e40 con 0x7f0dd8103b80 2024-09-21T03:00:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.903+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd8104e00 con 0x7f0dd8103b80 2024-09-21T03:00:35.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.904+0000 7f0dd57fa640 1 -- 172.21.15.81:0/3872917760 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0dc8042070 con 0x7f0dd8103b80 2024-09-21T03:00:35.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.905+0000 7f0dd57fa640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0dc40b6510 0x7f0dc40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:35.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.905+0000 7f0dcffff640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0dc40b6510 0x7f0dc40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:35.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.905+0000 7f0dd57fa640 1 -- 172.21.15.81:0/3872917760 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f0dc81081d0 con 0x7f0dd8103b80 2024-09-21T03:00:35.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.906+0000 7f0dcffff640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0dc40b6510 0x7f0dc40b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8109020 tx=0x7f0dc000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:35.908+0000 7f0dd57fa640 1 -- 172.21.15.81:0/3872917760 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0dc80d2b00 con 0x7f0dd8103b80 2024-09-21T03:00:36.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.086+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0dd8063800 con 0x7f0dc40b6510 2024-09-21T03:00:36.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.092+0000 7f0dd57fa640 1 -- 172.21.15.81:0/3872917760 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340734 (secure 0 0 0) 0x7f0dd8063800 con 0x7f0dc40b6510 2024-09-21T03:00:36.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:36.098 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T03:00:36.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0dc40b6510 msgr2=0x7f0dc40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:36.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0dc40b6510 0x7f0dc40b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8109020 tx=0x7f0dc000b390 comp rx=0 tx=0).stop 2024-09-21T03:00:36.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 msgr2=0x7f0dd8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:36.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8075710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0dc802a930 tx=0x7f0dc8003c20 comp rx=0 tx=0).stop 2024-09-21T03:00:36.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 shutdown_connections 2024-09-21T03:00:36.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f0dc40b6510 0x7f0dc40b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:36.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dd81094c0 0x7f0dd8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:36.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0dd8109e10 0x7f0dd8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:36.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 --2- 172.21.15.81:0/3872917760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd8103b80 0x7f0dd8075710 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:36.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 >> 172.21.15.81:0/3872917760 conn(0x7f0dd80ff610 msgr2=0x7f0dd8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:36.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 shutdown_connections 2024-09-21T03:00:36.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:36.095+0000 7f0ddded5640 1 -- 172.21.15.81:0/3872917760 wait complete. 2024-09-21T03:00:36.820 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-21T03:00:35.738992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667033,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":724,"num_read_kb":473,"num_write":310,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":751,"ondisk_log_size":751,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385232,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556592,"statfs":{"total":1151940427776,"available":1151545950208,"internally_reserved":0,"allocated":11288576,"data_stored":7511462,"data_compressed":389853,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5828,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":48,"num_write":10,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003472"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.159285+0000","last_change":"2024-09-21T02:58:13.017321+0000","last_active":"2024-09-21T02:58:52.159285+0000","last_peered":"2024-09-21T02:58:52.159285+0000","last_clean":"2024-09-21T02:58:52.159285+0000","last_became_active":"2024-09-21T02:58:13.017017+0000","last_became_peered":"2024-09-21T02:58:13.017017+0000","last_unstale":"2024-09-21T02:58:52.159285+0000","last_undegraded":"2024-09-21T02:58:52.159285+0000","last_fullsized":"2024-09-21T02:58:52.159285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:11.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945098+0000","last_change":"2024-09-21T02:58:15.043883+0000","last_active":"2024-09-21T03:00:17.945098+0000","last_peered":"2024-09-21T03:00:17.945098+0000","last_clean":"2024-09-21T03:00:17.945098+0000","last_became_active":"2024-09-21T02:58:15.043551+0000","last_became_peered":"2024-09-21T02:58:15.043551+0000","last_unstale":"2024-09-21T03:00:17.945098+0000","last_undegraded":"2024-09-21T03:00:17.945098+0000","last_fullsized":"2024-09-21T03:00:17.945098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:40.867181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224252+0000","last_change":"2024-09-21T02:58:22.084562+0000","last_active":"2024-09-21T02:58:49.224252+0000","last_peered":"2024-09-21T02:58:49.224252+0000","last_clean":"2024-09-21T02:58:49.224252+0000","last_became_active":"2024-09-21T02:58:22.084145+0000","last_became_peered":"2024-09-21T02:58:22.084145+0000","last_unstale":"2024-09-21T02:58:49.224252+0000","last_undegraded":"2024-09-21T02:58:49.224252+0000","last_fullsized":"2024-09-21T02:58:49.224252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:56.402375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.151240+0000","last_change":"2024-09-21T02:58:13.553479+0000","last_active":"2024-09-21T02:58:51.151240+0000","last_peered":"2024-09-21T02:58:51.151240+0000","last_clean":"2024-09-21T02:58:51.151240+0000","last_became_active":"2024-09-21T02:58:13.553117+0000","last_became_peered":"2024-09-21T02:58:13.553117+0000","last_unstale":"2024-09-21T02:58:51.151240+0000","last_undegraded":"2024-09-21T02:58:51.151240+0000","last_fullsized":"2024-09-21T02:58:51.151240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:34.301361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955348+0000","last_change":"2024-09-21T02:58:15.041724+0000","last_active":"2024-09-21T03:00:17.955348+0000","last_peered":"2024-09-21T03:00:17.955348+0000","last_clean":"2024-09-21T03:00:17.955348+0000","last_became_active":"2024-09-21T02:58:15.041355+0000","last_became_peered":"2024-09-21T02:58:15.041355+0000","last_unstale":"2024-09-21T03:00:17.955348+0000","last_undegraded":"2024-09-21T03:00:17.955348+0000","last_fullsized":"2024-09-21T03:00:17.955348+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:19.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226270+0000","last_change":"2024-09-21T02:58:22.085004+0000","last_active":"2024-09-21T02:58:49.226270+0000","last_peered":"2024-09-21T02:58:49.226270+0000","last_clean":"2024-09-21T02:58:49.226270+0000","last_became_active":"2024-09-21T02:58:22.084622+0000","last_became_peered":"2024-09-21T02:58:22.084622+0000","last_unstale":"2024-09-21T02:58:49.226270+0000","last_undegraded":"2024-09-21T02:58:49.226270+0000","last_fullsized":"2024-09-21T02:58:49.226270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.303286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152223+0000","last_change":"2024-09-21T02:58:49.237002+0000","last_active":"2024-09-21T02:58:51.152223+0000","last_peered":"2024-09-21T02:58:51.152223+0000","last_clean":"2024-09-21T02:58:51.152223+0000","last_became_active":"2024-09-21T02:58:49.233219+0000","last_became_peered":"2024-09-21T02:58:49.233219+0000","last_unstale":"2024-09-21T02:58:51.152223+0000","last_undegraded":"2024-09-21T02:58:51.152223+0000","last_fullsized":"2024-09-21T02:58:51.152223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:38.409153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955851+0000","last_change":"2024-09-21T02:58:15.051658+0000","last_active":"2024-09-21T03:00:17.955851+0000","last_peered":"2024-09-21T03:00:17.955851+0000","last_clean":"2024-09-21T03:00:17.955851+0000","last_became_active":"2024-09-21T02:58:15.048345+0000","last_became_peered":"2024-09-21T02:58:15.048345+0000","last_unstale":"2024-09-21T03:00:17.955851+0000","last_undegraded":"2024-09-21T03:00:17.955851+0000","last_fullsized":"2024-09-21T03:00:17.955851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:36.069051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.750150+0000","last_change":"2024-09-21T02:58:49.750028+0000","last_active":"2024-09-21T02:58:49.750150+0000","last_peered":"2024-09-21T02:58:49.750150+0000","last_clean":"2024-09-21T02:58:49.750150+0000","last_became_active":"2024-09-21T02:58:49.749587+0000","last_became_peered":"2024-09-21T02:58:49.749587+0000","last_unstale":"2024-09-21T02:58:49.750150+0000","last_undegraded":"2024-09-21T02:58:49.750150+0000","last_fullsized":"2024-09-21T02:58:49.750150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:33.018490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230873+0000","last_change":"2024-09-21T02:58:13.020762+0000","last_active":"2024-09-21T02:58:49.230873+0000","last_peered":"2024-09-21T02:58:49.230873+0000","last_clean":"2024-09-21T02:58:49.230873+0000","last_became_active":"2024-09-21T02:58:13.020263+0000","last_became_peered":"2024-09-21T02:58:13.020263+0000","last_unstale":"2024-09-21T02:58:49.230873+0000","last_undegraded":"2024-09-21T02:58:49.230873+0000","last_fullsized":"2024-09-21T02:58:49.230873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:14.490179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.952394+0000","last_change":"2024-09-21T02:58:15.048732+0000","last_active":"2024-09-21T03:00:17.952394+0000","last_peered":"2024-09-21T03:00:17.952394+0000","last_clean":"2024-09-21T03:00:17.952394+0000","last_became_active":"2024-09-21T02:58:15.048393+0000","last_became_peered":"2024-09-21T02:58:15.048393+0000","last_unstale":"2024-09-21T03:00:17.952394+0000","last_undegraded":"2024-09-21T03:00:17.952394+0000","last_fullsized":"2024-09-21T03:00:17.952394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:07.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225897+0000","last_change":"2024-09-21T02:58:22.087072+0000","last_active":"2024-09-21T02:58:49.225897+0000","last_peered":"2024-09-21T02:58:49.225897+0000","last_clean":"2024-09-21T02:58:49.225897+0000","last_became_active":"2024-09-21T02:58:22.086695+0000","last_became_peered":"2024-09-21T02:58:22.086695+0000","last_unstale":"2024-09-21T02:58:49.225897+0000","last_undegraded":"2024-09-21T02:58:49.225897+0000","last_fullsized":"2024-09-21T02:58:49.225897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:18.592656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953381+0000","last_change":"2024-09-21T02:58:15.043756+0000","last_active":"2024-09-21T03:00:17.953381+0000","last_peered":"2024-09-21T03:00:17.953381+0000","last_clean":"2024-09-21T03:00:17.953381+0000","last_became_active":"2024-09-21T02:58:15.043415+0000","last_became_peered":"2024-09-21T02:58:15.043415+0000","last_unstale":"2024-09-21T03:00:17.953381+0000","last_undegraded":"2024-09-21T03:00:17.953381+0000","last_fullsized":"2024-09-21T03:00:17.953381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:53.655906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156099+0000","last_change":"2024-09-21T02:58:13.017054+0000","last_active":"2024-09-21T02:58:52.156099+0000","last_peered":"2024-09-21T02:58:52.156099+0000","last_clean":"2024-09-21T02:58:52.156099+0000","last_became_active":"2024-09-21T02:58:13.016636+0000","last_became_peered":"2024-09-21T02:58:13.016636+0000","last_unstale":"2024-09-21T02:58:52.156099+0000","last_undegraded":"2024-09-21T02:58:52.156099+0000","last_fullsized":"2024-09-21T02:58:52.156099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:27.941501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226537+0000","last_change":"2024-09-21T02:58:22.229949+0000","last_active":"2024-09-21T02:58:49.226537+0000","last_peered":"2024-09-21T02:58:49.226537+0000","last_clean":"2024-09-21T02:58:49.226537+0000","last_became_active":"2024-09-21T02:58:22.229490+0000","last_became_peered":"2024-09-21T02:58:22.229490+0000","last_unstale":"2024-09-21T02:58:49.226537+0000","last_undegraded":"2024-09-21T02:58:49.226537+0000","last_fullsized":"2024-09-21T02:58:49.226537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:25.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.937881+0000","last_change":"2024-09-21T02:58:15.040559+0000","last_active":"2024-09-21T03:00:17.937881+0000","last_peered":"2024-09-21T03:00:17.937881+0000","last_clean":"2024-09-21T03:00:17.937881+0000","last_became_active":"2024-09-21T02:58:15.040220+0000","last_became_peered":"2024-09-21T02:58:15.040220+0000","last_unstale":"2024-09-21T03:00:17.937881+0000","last_undegraded":"2024-09-21T03:00:17.937881+0000","last_fullsized":"2024-09-21T03:00:17.937881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:55.853966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:24.684199+0000","last_change":"2024-09-21T02:58:13.017985+0000","last_active":"2024-09-21T03:00:24.684199+0000","last_peered":"2024-09-21T03:00:24.684199+0000","last_clean":"2024-09-21T03:00:24.684199+0000","last_became_active":"2024-09-21T02:58:13.017583+0000","last_became_peered":"2024-09-21T02:58:13.017583+0000","last_unstale":"2024-09-21T03:00:24.684199+0000","last_undegraded":"2024-09-21T03:00:24.684199+0000","last_fullsized":"2024-09-21T03:00:24.684199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.917960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226338+0000","last_change":"2024-09-21T02:58:22.077294+0000","last_active":"2024-09-21T02:58:49.226338+0000","last_peered":"2024-09-21T02:58:49.226338+0000","last_clean":"2024-09-21T02:58:49.226338+0000","last_became_active":"2024-09-21T02:58:22.076884+0000","last_became_peered":"2024-09-21T02:58:22.076884+0000","last_unstale":"2024-09-21T02:58:49.226338+0000","last_undegraded":"2024-09-21T02:58:49.226338+0000","last_fullsized":"2024-09-21T02:58:49.226338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:00.045383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941399+0000","last_change":"2024-09-21T02:58:15.045160+0000","last_active":"2024-09-21T03:00:17.941399+0000","last_peered":"2024-09-21T03:00:17.941399+0000","last_clean":"2024-09-21T03:00:17.941399+0000","last_became_active":"2024-09-21T02:58:15.044814+0000","last_became_peered":"2024-09-21T02:58:15.044814+0000","last_unstale":"2024-09-21T03:00:17.941399+0000","last_undegraded":"2024-09-21T03:00:17.941399+0000","last_fullsized":"2024-09-21T03:00:17.941399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:13.325320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146885+0000","last_change":"2024-09-21T02:58:13.011081+0000","last_active":"2024-09-21T02:58:50.146885+0000","last_peered":"2024-09-21T02:58:50.146885+0000","last_clean":"2024-09-21T02:58:50.146885+0000","last_became_active":"2024-09-21T02:58:13.010682+0000","last_became_peered":"2024-09-21T02:58:13.010682+0000","last_unstale":"2024-09-21T02:58:50.146885+0000","last_undegraded":"2024-09-21T02:58:50.146885+0000","last_fullsized":"2024-09-21T02:58:50.146885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224126+0000","last_change":"2024-09-21T02:58:22.083449+0000","last_active":"2024-09-21T02:58:49.224126+0000","last_peered":"2024-09-21T02:58:49.224126+0000","last_clean":"2024-09-21T02:58:49.224126+0000","last_became_active":"2024-09-21T02:58:22.082996+0000","last_became_peered":"2024-09-21T02:58:22.082996+0000","last_unstale":"2024-09-21T02:58:49.224126+0000","last_undegraded":"2024-09-21T02:58:49.224126+0000","last_fullsized":"2024-09-21T02:58:49.224126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:21.667824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.936125+0000","last_change":"2024-09-21T02:58:15.039458+0000","last_active":"2024-09-21T03:00:17.936125+0000","last_peered":"2024-09-21T03:00:17.936125+0000","last_clean":"2024-09-21T03:00:17.936125+0000","last_became_active":"2024-09-21T02:58:15.039082+0000","last_became_peered":"2024-09-21T02:58:15.039082+0000","last_unstale":"2024-09-21T03:00:17.936125+0000","last_undegraded":"2024-09-21T03:00:17.936125+0000","last_fullsized":"2024-09-21T03:00:17.936125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:37.102212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147405+0000","last_change":"2024-09-21T02:58:49.982108+0000","last_active":"2024-09-21T02:58:50.147405+0000","last_peered":"2024-09-21T02:58:50.147405+0000","last_clean":"2024-09-21T02:58:50.147405+0000","last_became_active":"2024-09-21T02:58:49.981462+0000","last_became_peered":"2024-09-21T02:58:49.981462+0000","last_unstale":"2024-09-21T02:58:50.147405+0000","last_undegraded":"2024-09-21T02:58:50.147405+0000","last_fullsized":"2024-09-21T02:58:50.147405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:17.624627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226847+0000","last_change":"2024-09-21T02:58:22.231082+0000","last_active":"2024-09-21T02:58:49.226847+0000","last_peered":"2024-09-21T02:58:49.226847+0000","last_clean":"2024-09-21T02:58:49.226847+0000","last_became_active":"2024-09-21T02:58:22.229781+0000","last_became_peered":"2024-09-21T02:58:22.229781+0000","last_unstale":"2024-09-21T02:58:49.226847+0000","last_undegraded":"2024-09-21T02:58:49.226847+0000","last_fullsized":"2024-09-21T02:58:49.226847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:14.964809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951174+0000","last_change":"2024-09-21T02:58:15.033111+0000","last_active":"2024-09-21T03:00:17.951174+0000","last_peered":"2024-09-21T03:00:17.951174+0000","last_clean":"2024-09-21T03:00:17.951174+0000","last_became_active":"2024-09-21T02:58:15.032738+0000","last_became_peered":"2024-09-21T02:58:15.032738+0000","last_unstale":"2024-09-21T03:00:17.951174+0000","last_undegraded":"2024-09-21T03:00:17.951174+0000","last_fullsized":"2024-09-21T03:00:17.951174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:31.209451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147612+0000","last_change":"2024-09-21T02:58:13.229717+0000","last_active":"2024-09-21T02:58:50.147612+0000","last_peered":"2024-09-21T02:58:50.147612+0000","last_clean":"2024-09-21T02:58:50.147612+0000","last_became_active":"2024-09-21T02:58:13.229376+0000","last_became_peered":"2024-09-21T02:58:13.229376+0000","last_unstale":"2024-09-21T02:58:50.147612+0000","last_undegraded":"2024-09-21T02:58:50.147612+0000","last_fullsized":"2024-09-21T02:58:50.147612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:05.436044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224498+0000","last_change":"2024-09-21T02:58:22.081140+0000","last_active":"2024-09-21T02:58:49.224498+0000","last_peered":"2024-09-21T02:58:49.224498+0000","last_clean":"2024-09-21T02:58:49.224498+0000","last_became_active":"2024-09-21T02:58:22.080670+0000","last_became_peered":"2024-09-21T02:58:22.080670+0000","last_unstale":"2024-09-21T02:58:49.224498+0000","last_undegraded":"2024-09-21T02:58:49.224498+0000","last_fullsized":"2024-09-21T02:58:49.224498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:43.078241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938803+0000","last_change":"2024-09-21T02:58:15.035927+0000","last_active":"2024-09-21T03:00:17.938803+0000","last_peered":"2024-09-21T03:00:17.938803+0000","last_clean":"2024-09-21T03:00:17.938803+0000","last_became_active":"2024-09-21T02:58:15.035529+0000","last_became_peered":"2024-09-21T02:58:15.035529+0000","last_unstale":"2024-09-21T03:00:17.938803+0000","last_undegraded":"2024-09-21T03:00:17.938803+0000","last_fullsized":"2024-09-21T03:00:17.938803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:24.351455+0000","last_change":"2024-09-21T02:58:13.016489+0000","last_active":"2024-09-21T03:00:24.351455+0000","last_peered":"2024-09-21T03:00:24.351455+0000","last_clean":"2024-09-21T03:00:24.351455+0000","last_became_active":"2024-09-21T02:58:13.016176+0000","last_became_peered":"2024-09-21T02:58:13.016176+0000","last_unstale":"2024-09-21T03:00:24.351455+0000","last_undegraded":"2024-09-21T03:00:24.351455+0000","last_fullsized":"2024-09-21T03:00:24.351455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:54.908933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227910+0000","last_change":"2024-09-21T02:58:22.229868+0000","last_active":"2024-09-21T02:58:49.227910+0000","last_peered":"2024-09-21T02:58:49.227910+0000","last_clean":"2024-09-21T02:58:49.227910+0000","last_became_active":"2024-09-21T02:58:22.229318+0000","last_became_peered":"2024-09-21T02:58:22.229318+0000","last_unstale":"2024-09-21T02:58:49.227910+0000","last_undegraded":"2024-09-21T02:58:49.227910+0000","last_fullsized":"2024-09-21T02:58:49.227910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:06.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944913+0000","last_change":"2024-09-21T02:58:15.037953+0000","last_active":"2024-09-21T03:00:17.944913+0000","last_peered":"2024-09-21T03:00:17.944913+0000","last_clean":"2024-09-21T03:00:17.944913+0000","last_became_active":"2024-09-21T02:58:15.036934+0000","last_became_peered":"2024-09-21T02:58:15.036934+0000","last_unstale":"2024-09-21T03:00:17.944913+0000","last_undegraded":"2024-09-21T03:00:17.944913+0000","last_fullsized":"2024-09-21T03:00:17.944913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:35.118295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.152171+0000","last_change":"2024-09-21T02:58:13.553861+0000","last_active":"2024-09-21T02:58:52.152171+0000","last_peered":"2024-09-21T02:58:52.152171+0000","last_clean":"2024-09-21T02:58:52.152171+0000","last_became_active":"2024-09-21T02:58:13.553016+0000","last_became_peered":"2024-09-21T02:58:13.553016+0000","last_unstale":"2024-09-21T02:58:52.152171+0000","last_undegraded":"2024-09-21T02:58:52.152171+0000","last_fullsized":"2024-09-21T02:58:52.152171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227080+0000","last_change":"2024-09-21T02:58:22.087306+0000","last_active":"2024-09-21T02:58:49.227080+0000","last_peered":"2024-09-21T02:58:49.227080+0000","last_clean":"2024-09-21T02:58:49.227080+0000","last_became_active":"2024-09-21T02:58:22.086800+0000","last_became_peered":"2024-09-21T02:58:22.086800+0000","last_unstale":"2024-09-21T02:58:49.227080+0000","last_undegraded":"2024-09-21T02:58:49.227080+0000","last_fullsized":"2024-09-21T02:58:49.227080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:28.652990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938678+0000","last_change":"2024-09-21T02:58:15.038383+0000","last_active":"2024-09-21T03:00:17.938678+0000","last_peered":"2024-09-21T03:00:17.938678+0000","last_clean":"2024-09-21T03:00:17.938678+0000","last_became_active":"2024-09-21T02:58:15.037878+0000","last_became_peered":"2024-09-21T02:58:15.037878+0000","last_unstale":"2024-09-21T03:00:17.938678+0000","last_undegraded":"2024-09-21T03:00:17.938678+0000","last_fullsized":"2024-09-21T03:00:17.938678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:14.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223927+0000","last_change":"2024-09-21T02:58:13.555218+0000","last_active":"2024-09-21T02:58:49.223927+0000","last_peered":"2024-09-21T02:58:49.223927+0000","last_clean":"2024-09-21T02:58:49.223927+0000","last_became_active":"2024-09-21T02:58:13.554831+0000","last_became_peered":"2024-09-21T02:58:13.554831+0000","last_unstale":"2024-09-21T02:58:49.223927+0000","last_undegraded":"2024-09-21T02:58:49.223927+0000","last_fullsized":"2024-09-21T02:58:49.223927+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:32.659118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230196+0000","last_change":"2024-09-21T02:58:22.229673+0000","last_active":"2024-09-21T02:58:49.230196+0000","last_peered":"2024-09-21T02:58:49.230196+0000","last_clean":"2024-09-21T02:58:49.230196+0000","last_became_active":"2024-09-21T02:58:22.229034+0000","last_became_peered":"2024-09-21T02:58:22.229034+0000","last_unstale":"2024-09-21T02:58:49.230196+0000","last_undegraded":"2024-09-21T02:58:49.230196+0000","last_fullsized":"2024-09-21T02:58:49.230196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:26.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.948504+0000","last_change":"2024-09-21T02:58:49.981660+0000","last_active":"2024-09-21T03:00:17.948504+0000","last_peered":"2024-09-21T03:00:17.948504+0000","last_clean":"2024-09-21T03:00:17.948504+0000","last_became_active":"2024-09-21T02:58:49.980972+0000","last_became_peered":"2024-09-21T02:58:49.980972+0000","last_unstale":"2024-09-21T03:00:17.948504+0000","last_undegraded":"2024-09-21T03:00:17.948504+0000","last_fullsized":"2024-09-21T03:00:17.948504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:26.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152564+0000","last_change":"2024-09-21T02:58:13.012751+0000","last_active":"2024-09-21T02:58:51.152564+0000","last_peered":"2024-09-21T02:58:51.152564+0000","last_clean":"2024-09-21T02:58:51.152564+0000","last_became_active":"2024-09-21T02:58:13.012341+0000","last_became_peered":"2024-09-21T02:58:13.012341+0000","last_unstale":"2024-09-21T02:58:51.152564+0000","last_undegraded":"2024-09-21T02:58:51.152564+0000","last_fullsized":"2024-09-21T02:58:51.152564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435102+0000","last_change":"2024-09-21T02:58:22.084620+0000","last_active":"2024-09-21T02:58:49.435102+0000","last_peered":"2024-09-21T02:58:49.435102+0000","last_clean":"2024-09-21T02:58:49.435102+0000","last_became_active":"2024-09-21T02:58:22.083935+0000","last_became_peered":"2024-09-21T02:58:22.083935+0000","last_unstale":"2024-09-21T02:58:49.435102+0000","last_undegraded":"2024-09-21T02:58:49.435102+0000","last_fullsized":"2024-09-21T02:58:49.435102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:37.033928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942732+0000","last_change":"2024-09-21T02:58:15.046935+0000","last_active":"2024-09-21T03:00:17.942732+0000","last_peered":"2024-09-21T03:00:17.942732+0000","last_clean":"2024-09-21T03:00:17.942732+0000","last_became_active":"2024-09-21T02:58:15.046572+0000","last_became_peered":"2024-09-21T02:58:15.046572+0000","last_unstale":"2024-09-21T03:00:17.942732+0000","last_undegraded":"2024-09-21T03:00:17.942732+0000","last_fullsized":"2024-09-21T03:00:17.942732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.942643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:32.373923+0000","last_change":"2024-09-21T02:58:13.553337+0000","last_active":"2024-09-21T03:00:32.373923+0000","last_peered":"2024-09-21T03:00:32.373923+0000","last_clean":"2024-09-21T03:00:32.373923+0000","last_became_active":"2024-09-21T02:58:13.552873+0000","last_became_peered":"2024-09-21T02:58:13.552873+0000","last_unstale":"2024-09-21T03:00:32.373923+0000","last_undegraded":"2024-09-21T03:00:32.373923+0000","last_fullsized":"2024-09-21T03:00:32.373923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:42.800873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435293+0000","last_change":"2024-09-21T02:58:22.230102+0000","last_active":"2024-09-21T02:58:49.435293+0000","last_peered":"2024-09-21T02:58:49.435293+0000","last_clean":"2024-09-21T02:58:49.435293+0000","last_became_active":"2024-09-21T02:58:22.229643+0000","last_became_peered":"2024-09-21T02:58:22.229643+0000","last_unstale":"2024-09-21T02:58:49.435293+0000","last_undegraded":"2024-09-21T02:58:49.435293+0000","last_fullsized":"2024-09-21T02:58:49.435293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.396292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938272+0000","last_change":"2024-09-21T02:58:15.043484+0000","last_active":"2024-09-21T03:00:17.938272+0000","last_peered":"2024-09-21T03:00:17.938272+0000","last_clean":"2024-09-21T03:00:17.938272+0000","last_became_active":"2024-09-21T02:58:15.042663+0000","last_became_peered":"2024-09-21T02:58:15.042663+0000","last_unstale":"2024-09-21T03:00:17.938272+0000","last_undegraded":"2024-09-21T03:00:17.938272+0000","last_fullsized":"2024-09-21T03:00:17.938272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:42.937814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152465+0000","last_change":"2024-09-21T02:58:13.018109+0000","last_active":"2024-09-21T02:58:51.152465+0000","last_peered":"2024-09-21T02:58:51.152465+0000","last_clean":"2024-09-21T02:58:51.152465+0000","last_became_active":"2024-09-21T02:58:13.017761+0000","last_became_peered":"2024-09-21T02:58:13.017761+0000","last_unstale":"2024-09-21T02:58:51.152465+0000","last_undegraded":"2024-09-21T02:58:51.152465+0000","last_fullsized":"2024-09-21T02:58:51.152465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:12.613051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748934+0000","last_change":"2024-09-21T02:58:22.230520+0000","last_active":"2024-09-21T02:58:49.748934+0000","last_peered":"2024-09-21T02:58:49.748934+0000","last_clean":"2024-09-21T02:58:49.748934+0000","last_became_active":"2024-09-21T02:58:22.229999+0000","last_became_peered":"2024-09-21T02:58:22.229999+0000","last_unstale":"2024-09-21T02:58:49.748934+0000","last_undegraded":"2024-09-21T02:58:49.748934+0000","last_fullsized":"2024-09-21T02:58:49.748934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:12.899892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944775+0000","last_change":"2024-09-21T02:58:15.040357+0000","last_active":"2024-09-21T03:00:17.944775+0000","last_peered":"2024-09-21T03:00:17.944775+0000","last_clean":"2024-09-21T03:00:17.944775+0000","last_became_active":"2024-09-21T02:58:15.040026+0000","last_became_peered":"2024-09-21T02:58:15.040026+0000","last_unstale":"2024-09-21T03:00:17.944775+0000","last_undegraded":"2024-09-21T03:00:17.944775+0000","last_fullsized":"2024-09-21T03:00:17.944775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.216541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156121+0000","last_change":"2024-09-21T02:58:13.014816+0000","last_active":"2024-09-21T02:58:52.156121+0000","last_peered":"2024-09-21T02:58:52.156121+0000","last_clean":"2024-09-21T02:58:52.156121+0000","last_became_active":"2024-09-21T02:58:13.013918+0000","last_became_peered":"2024-09-21T02:58:13.013918+0000","last_unstale":"2024-09-21T02:58:52.156121+0000","last_undegraded":"2024-09-21T02:58:52.156121+0000","last_fullsized":"2024-09-21T02:58:52.156121+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:20.892671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230777+0000","last_change":"2024-09-21T02:57:01.191389+0000","last_active":"2024-09-21T02:58:49.230777+0000","last_peered":"2024-09-21T02:58:49.230777+0000","last_clean":"2024-09-21T02:58:49.230777+0000","last_became_active":"2024-09-21T02:57:01.185686+0000","last_became_peered":"2024-09-21T02:57:01.185686+0000","last_unstale":"2024-09-21T02:58:49.230777+0000","last_undegraded":"2024-09-21T02:58:49.230777+0000","last_fullsized":"2024-09-21T02:58:49.230777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_clean_scrub_stamp":"2024-09-21T02:53:36.647024+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.275496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:57.775841+0000","last_change":"2024-09-21T02:58:22.081891+0000","last_active":"2024-09-21T02:58:57.775841+0000","last_peered":"2024-09-21T02:58:57.775841+0000","last_clean":"2024-09-21T02:58:57.775841+0000","last_became_active":"2024-09-21T02:58:22.081435+0000","last_became_peered":"2024-09-21T02:58:22.081435+0000","last_unstale":"2024-09-21T02:58:57.775841+0000","last_undegraded":"2024-09-21T02:58:57.775841+0000","last_fullsized":"2024-09-21T02:58:57.775841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:51.161690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954916+0000","last_change":"2024-09-21T02:58:15.045013+0000","last_active":"2024-09-21T03:00:17.954916+0000","last_peered":"2024-09-21T03:00:17.954916+0000","last_clean":"2024-09-21T03:00:17.954916+0000","last_became_active":"2024-09-21T02:58:15.044650+0000","last_became_peered":"2024-09-21T02:58:15.044650+0000","last_unstale":"2024-09-21T03:00:17.954916+0000","last_undegraded":"2024-09-21T03:00:17.954916+0000","last_fullsized":"2024-09-21T03:00:17.954916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:39.087982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.159341+0000","last_change":"2024-09-21T02:58:13.553468+0000","last_active":"2024-09-21T02:58:52.159341+0000","last_peered":"2024-09-21T02:58:52.159341+0000","last_clean":"2024-09-21T02:58:52.159341+0000","last_became_active":"2024-09-21T02:58:13.552965+0000","last_became_peered":"2024-09-21T02:58:13.552965+0000","last_unstale":"2024-09-21T02:58:52.159341+0000","last_undegraded":"2024-09-21T02:58:52.159341+0000","last_fullsized":"2024-09-21T02:58:52.159341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:35.224581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227428+0000","last_change":"2024-09-21T02:58:22.086994+0000","last_active":"2024-09-21T02:58:49.227428+0000","last_peered":"2024-09-21T02:58:49.227428+0000","last_clean":"2024-09-21T02:58:49.227428+0000","last_became_active":"2024-09-21T02:58:22.086506+0000","last_became_peered":"2024-09-21T02:58:22.086506+0000","last_unstale":"2024-09-21T02:58:49.227428+0000","last_undegraded":"2024-09-21T02:58:49.227428+0000","last_fullsized":"2024-09-21T02:58:49.227428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:09.102495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941104+0000","last_change":"2024-09-21T02:58:15.040224+0000","last_active":"2024-09-21T03:00:17.941104+0000","last_peered":"2024-09-21T03:00:17.941104+0000","last_clean":"2024-09-21T03:00:17.941104+0000","last_became_active":"2024-09-21T02:58:15.039115+0000","last_became_peered":"2024-09-21T02:58:15.039115+0000","last_unstale":"2024-09-21T03:00:17.941104+0000","last_undegraded":"2024-09-21T03:00:17.941104+0000","last_fullsized":"2024-09-21T03:00:17.941104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:35.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156123+0000","last_change":"2024-09-21T02:58:13.021526+0000","last_active":"2024-09-21T02:58:52.156123+0000","last_peered":"2024-09-21T02:58:52.156123+0000","last_clean":"2024-09-21T02:58:52.156123+0000","last_became_active":"2024-09-21T02:58:13.020521+0000","last_became_peered":"2024-09-21T02:58:13.020521+0000","last_unstale":"2024-09-21T02:58:52.156123+0000","last_undegraded":"2024-09-21T02:58:52.156123+0000","last_fullsized":"2024-09-21T02:58:52.156123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:08.645141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980132+0000","last_change":"2024-09-21T02:58:22.077862+0000","last_active":"2024-09-21T02:58:49.980132+0000","last_peered":"2024-09-21T02:58:49.980132+0000","last_clean":"2024-09-21T02:58:49.980132+0000","last_became_active":"2024-09-21T02:58:22.077410+0000","last_became_peered":"2024-09-21T02:58:22.077410+0000","last_unstale":"2024-09-21T02:58:49.980132+0000","last_undegraded":"2024-09-21T02:58:49.980132+0000","last_fullsized":"2024-09-21T02:58:49.980132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:06.549842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938738+0000","last_change":"2024-09-21T02:58:15.037775+0000","last_active":"2024-09-21T03:00:17.938738+0000","last_peered":"2024-09-21T03:00:17.938738+0000","last_clean":"2024-09-21T03:00:17.938738+0000","last_became_active":"2024-09-21T02:58:15.037036+0000","last_became_peered":"2024-09-21T02:58:15.037036+0000","last_unstale":"2024-09-21T03:00:17.938738+0000","last_undegraded":"2024-09-21T03:00:17.938738+0000","last_fullsized":"2024-09-21T03:00:17.938738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:58.289785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435300+0000","last_change":"2024-09-21T02:58:13.015046+0000","last_active":"2024-09-21T02:58:49.435300+0000","last_peered":"2024-09-21T02:58:49.435300+0000","last_clean":"2024-09-21T02:58:49.435300+0000","last_became_active":"2024-09-21T02:58:13.014643+0000","last_became_peered":"2024-09-21T02:58:13.014643+0000","last_unstale":"2024-09-21T02:58:49.435300+0000","last_undegraded":"2024-09-21T02:58:49.435300+0000","last_fullsized":"2024-09-21T02:58:49.435300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:54.913187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.747960+0000","last_change":"2024-09-21T02:58:22.085805+0000","last_active":"2024-09-21T02:58:49.747960+0000","last_peered":"2024-09-21T02:58:49.747960+0000","last_clean":"2024-09-21T02:58:49.747960+0000","last_became_active":"2024-09-21T02:58:22.084752+0000","last_became_peered":"2024-09-21T02:58:22.084752+0000","last_unstale":"2024-09-21T02:58:49.747960+0000","last_undegraded":"2024-09-21T02:58:49.747960+0000","last_fullsized":"2024-09-21T02:58:49.747960+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:39.357089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941139+0000","last_change":"2024-09-21T02:58:15.046643+0000","last_active":"2024-09-21T03:00:17.941139+0000","last_peered":"2024-09-21T03:00:17.941139+0000","last_clean":"2024-09-21T03:00:17.941139+0000","last_became_active":"2024-09-21T02:58:15.046278+0000","last_became_peered":"2024-09-21T02:58:15.046278+0000","last_unstale":"2024-09-21T03:00:17.941139+0000","last_undegraded":"2024-09-21T03:00:17.941139+0000","last_fullsized":"2024-09-21T03:00:17.941139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.648084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156242+0000","last_change":"2024-09-21T02:58:13.022176+0000","last_active":"2024-09-21T02:58:52.156242+0000","last_peered":"2024-09-21T02:58:52.156242+0000","last_clean":"2024-09-21T02:58:52.156242+0000","last_became_active":"2024-09-21T02:58:13.020122+0000","last_became_peered":"2024-09-21T02:58:13.020122+0000","last_unstale":"2024-09-21T02:58:52.156242+0000","last_undegraded":"2024-09-21T02:58:52.156242+0000","last_fullsized":"2024-09-21T02:58:52.156242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:12.346056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748411+0000","last_change":"2024-09-21T02:58:22.084221+0000","last_active":"2024-09-21T02:58:49.748411+0000","last_peered":"2024-09-21T02:58:49.748411+0000","last_clean":"2024-09-21T02:58:49.748411+0000","last_became_active":"2024-09-21T02:58:22.083793+0000","last_became_peered":"2024-09-21T02:58:22.083793+0000","last_unstale":"2024-09-21T02:58:49.748411+0000","last_undegraded":"2024-09-21T02:58:49.748411+0000","last_fullsized":"2024-09-21T02:58:49.748411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:13.043641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947630+0000","last_change":"2024-09-21T02:58:49.233440+0000","last_active":"2024-09-21T03:00:17.947630+0000","last_peered":"2024-09-21T03:00:17.947630+0000","last_clean":"2024-09-21T03:00:17.947630+0000","last_became_active":"2024-09-21T02:58:49.232996+0000","last_became_peered":"2024-09-21T02:58:49.232996+0000","last_unstale":"2024-09-21T03:00:17.947630+0000","last_undegraded":"2024-09-21T03:00:17.947630+0000","last_fullsized":"2024-09-21T03:00:17.947630+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:13.181861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156163+0000","last_change":"2024-09-21T02:58:13.553866+0000","last_active":"2024-09-21T02:58:52.156163+0000","last_peered":"2024-09-21T02:58:52.156163+0000","last_clean":"2024-09-21T02:58:52.156163+0000","last_became_active":"2024-09-21T02:58:13.553001+0000","last_became_peered":"2024-09-21T02:58:13.553001+0000","last_unstale":"2024-09-21T02:58:52.156163+0000","last_undegraded":"2024-09-21T02:58:52.156163+0000","last_fullsized":"2024-09-21T02:58:52.156163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:43.995773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435231+0000","last_change":"2024-09-21T02:58:22.090253+0000","last_active":"2024-09-21T02:58:49.435231+0000","last_peered":"2024-09-21T02:58:49.435231+0000","last_clean":"2024-09-21T02:58:49.435231+0000","last_became_active":"2024-09-21T02:58:22.089818+0000","last_became_peered":"2024-09-21T02:58:22.089818+0000","last_unstale":"2024-09-21T02:58:49.435231+0000","last_undegraded":"2024-09-21T02:58:49.435231+0000","last_fullsized":"2024-09-21T02:58:49.435231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:09.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.940533+0000","last_change":"2024-09-21T02:58:15.042479+0000","last_active":"2024-09-21T03:00:17.940533+0000","last_peered":"2024-09-21T03:00:17.940533+0000","last_clean":"2024-09-21T03:00:17.940533+0000","last_became_active":"2024-09-21T02:58:15.042087+0000","last_became_peered":"2024-09-21T02:58:15.042087+0000","last_unstale":"2024-09-21T03:00:17.940533+0000","last_undegraded":"2024-09-21T03:00:17.940533+0000","last_fullsized":"2024-09-21T03:00:17.940533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.427736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:31.372600+0000","last_change":"2024-09-21T02:58:13.012559+0000","last_active":"2024-09-21T03:00:31.372600+0000","last_peered":"2024-09-21T03:00:31.372600+0000","last_clean":"2024-09-21T03:00:31.372600+0000","last_became_active":"2024-09-21T02:58:13.011062+0000","last_became_peered":"2024-09-21T02:58:13.011062+0000","last_unstale":"2024-09-21T03:00:31.372600+0000","last_undegraded":"2024-09-21T03:00:31.372600+0000","last_fullsized":"2024-09-21T03:00:31.372600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:17.839898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224241+0000","last_change":"2024-09-21T02:58:22.081196+0000","last_active":"2024-09-21T02:58:49.224241+0000","last_peered":"2024-09-21T02:58:49.224241+0000","last_clean":"2024-09-21T02:58:49.224241+0000","last_became_active":"2024-09-21T02:58:22.080787+0000","last_became_peered":"2024-09-21T02:58:22.080787+0000","last_unstale":"2024-09-21T02:58:49.224241+0000","last_undegraded":"2024-09-21T02:58:49.224241+0000","last_fullsized":"2024-09-21T02:58:49.224241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.283112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951437+0000","last_change":"2024-09-21T02:58:15.046322+0000","last_active":"2024-09-21T03:00:17.951437+0000","last_peered":"2024-09-21T03:00:17.951437+0000","last_clean":"2024-09-21T03:00:17.951437+0000","last_became_active":"2024-09-21T02:58:15.045936+0000","last_became_peered":"2024-09-21T02:58:15.045936+0000","last_unstale":"2024-09-21T03:00:17.951437+0000","last_undegraded":"2024-09-21T03:00:17.951437+0000","last_fullsized":"2024-09-21T03:00:17.951437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:08.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145891+0000","last_change":"2024-09-21T02:58:13.022277+0000","last_active":"2024-09-21T02:58:50.145891+0000","last_peered":"2024-09-21T02:58:50.145891+0000","last_clean":"2024-09-21T02:58:50.145891+0000","last_became_active":"2024-09-21T02:58:13.021901+0000","last_became_peered":"2024-09-21T02:58:13.021901+0000","last_unstale":"2024-09-21T02:58:50.145891+0000","last_undegraded":"2024-09-21T02:58:50.145891+0000","last_fullsized":"2024-09-21T02:58:50.145891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:01.029435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226991+0000","last_change":"2024-09-21T02:58:22.088951+0000","last_active":"2024-09-21T02:58:49.226991+0000","last_peered":"2024-09-21T02:58:49.226991+0000","last_clean":"2024-09-21T02:58:49.226991+0000","last_became_active":"2024-09-21T02:58:22.088427+0000","last_became_peered":"2024-09-21T02:58:22.088427+0000","last_unstale":"2024-09-21T02:58:49.226991+0000","last_undegraded":"2024-09-21T02:58:49.226991+0000","last_fullsized":"2024-09-21T02:58:49.226991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:52.700517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.934441+0000","last_change":"2024-09-21T02:58:15.038390+0000","last_active":"2024-09-21T03:00:17.934441+0000","last_peered":"2024-09-21T03:00:17.934441+0000","last_clean":"2024-09-21T03:00:17.934441+0000","last_became_active":"2024-09-21T02:58:15.037368+0000","last_became_peered":"2024-09-21T02:58:15.037368+0000","last_unstale":"2024-09-21T03:00:17.934441+0000","last_undegraded":"2024-09-21T03:00:17.934441+0000","last_fullsized":"2024-09-21T03:00:17.934441+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:54.736444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156157+0000","last_change":"2024-09-21T02:58:13.013246+0000","last_active":"2024-09-21T02:58:52.156157+0000","last_peered":"2024-09-21T02:58:52.156157+0000","last_clean":"2024-09-21T02:58:52.156157+0000","last_became_active":"2024-09-21T02:58:13.012830+0000","last_became_peered":"2024-09-21T02:58:13.012830+0000","last_unstale":"2024-09-21T02:58:52.156157+0000","last_undegraded":"2024-09-21T02:58:52.156157+0000","last_fullsized":"2024-09-21T02:58:52.156157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:31.406565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748517+0000","last_change":"2024-09-21T02:58:22.086799+0000","last_active":"2024-09-21T02:58:49.748517+0000","last_peered":"2024-09-21T02:58:49.748517+0000","last_clean":"2024-09-21T02:58:49.748517+0000","last_became_active":"2024-09-21T02:58:22.086395+0000","last_became_peered":"2024-09-21T02:58:22.086395+0000","last_unstale":"2024-09-21T02:58:49.748517+0000","last_undegraded":"2024-09-21T02:58:49.748517+0000","last_fullsized":"2024-09-21T02:58:49.748517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:38.985072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.935637+0000","last_change":"2024-09-21T02:58:15.037346+0000","last_active":"2024-09-21T03:00:17.935637+0000","last_peered":"2024-09-21T03:00:17.935637+0000","last_clean":"2024-09-21T03:00:17.935637+0000","last_became_active":"2024-09-21T02:58:15.036984+0000","last_became_peered":"2024-09-21T02:58:15.036984+0000","last_unstale":"2024-09-21T03:00:17.935637+0000","last_undegraded":"2024-09-21T03:00:17.935637+0000","last_fullsized":"2024-09-21T03:00:17.935637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:43.856844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'38","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:35.335004+0000","last_change":"2024-09-21T02:58:13.018287+0000","last_active":"2024-09-21T03:00:35.335004+0000","last_peered":"2024-09-21T03:00:35.335004+0000","last_clean":"2024-09-21T03:00:35.335004+0000","last_became_active":"2024-09-21T02:58:13.017908+0000","last_became_peered":"2024-09-21T02:58:13.017908+0000","last_unstale":"2024-09-21T03:00:35.335004+0000","last_undegraded":"2024-09-21T03:00:35.335004+0000","last_fullsized":"2024-09-21T03:00:35.335004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:30.422946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":181,"num_write":39,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223420+0000","last_change":"2024-09-21T02:58:22.078106+0000","last_active":"2024-09-21T02:58:49.223420+0000","last_peered":"2024-09-21T02:58:49.223420+0000","last_clean":"2024-09-21T02:58:49.223420+0000","last_became_active":"2024-09-21T02:58:22.077675+0000","last_became_peered":"2024-09-21T02:58:22.077675+0000","last_unstale":"2024-09-21T02:58:49.223420+0000","last_undegraded":"2024-09-21T02:58:49.223420+0000","last_fullsized":"2024-09-21T02:58:49.223420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:08.965865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955019+0000","last_change":"2024-09-21T02:58:15.045911+0000","last_active":"2024-09-21T03:00:17.955019+0000","last_peered":"2024-09-21T03:00:17.955019+0000","last_clean":"2024-09-21T03:00:17.955019+0000","last_became_active":"2024-09-21T02:58:15.045506+0000","last_became_peered":"2024-09-21T02:58:15.045506+0000","last_unstale":"2024-09-21T03:00:17.955019+0000","last_undegraded":"2024-09-21T03:00:17.955019+0000","last_fullsized":"2024-09-21T03:00:17.955019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.982730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.144087+0000","last_change":"2024-09-21T02:58:13.555132+0000","last_active":"2024-09-21T02:58:50.144087+0000","last_peered":"2024-09-21T02:58:50.144087+0000","last_clean":"2024-09-21T02:58:50.144087+0000","last_became_active":"2024-09-21T02:58:13.554582+0000","last_became_peered":"2024-09-21T02:58:13.554582+0000","last_unstale":"2024-09-21T02:58:50.144087+0000","last_undegraded":"2024-09-21T02:58:50.144087+0000","last_fullsized":"2024-09-21T02:58:50.144087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:56.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.234599+0000","last_change":"2024-09-21T02:58:49.234443+0000","last_active":"2024-09-21T02:58:49.234599+0000","last_peered":"2024-09-21T02:58:49.234599+0000","last_clean":"2024-09-21T02:58:49.234599+0000","last_became_active":"2024-09-21T02:58:49.233758+0000","last_became_peered":"2024-09-21T02:58:49.233758+0000","last_unstale":"2024-09-21T02:58:49.234599+0000","last_undegraded":"2024-09-21T02:58:49.234599+0000","last_fullsized":"2024-09-21T02:58:49.234599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:06.821726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944745+0000","last_change":"2024-09-21T02:58:15.033598+0000","last_active":"2024-09-21T03:00:17.944745+0000","last_peered":"2024-09-21T03:00:17.944745+0000","last_clean":"2024-09-21T03:00:17.944745+0000","last_became_active":"2024-09-21T02:58:15.033268+0000","last_became_peered":"2024-09-21T02:58:15.033268+0000","last_unstale":"2024-09-21T03:00:17.944745+0000","last_undegraded":"2024-09-21T03:00:17.944745+0000","last_fullsized":"2024-09-21T03:00:17.944745+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:25.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145942+0000","last_change":"2024-09-21T02:58:13.018159+0000","last_active":"2024-09-21T02:58:50.145942+0000","last_peered":"2024-09-21T02:58:50.145942+0000","last_clean":"2024-09-21T02:58:50.145942+0000","last_became_active":"2024-09-21T02:58:13.017263+0000","last_became_peered":"2024-09-21T02:58:13.017263+0000","last_unstale":"2024-09-21T02:58:50.145942+0000","last_undegraded":"2024-09-21T02:58:50.145942+0000","last_fullsized":"2024-09-21T02:58:50.145942+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:47.981435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.982319+0000","last_change":"2024-09-21T02:58:49.981593+0000","last_active":"2024-09-21T02:58:49.982319+0000","last_peered":"2024-09-21T02:58:49.982319+0000","last_clean":"2024-09-21T02:58:49.982319+0000","last_became_active":"2024-09-21T02:58:49.980890+0000","last_became_peered":"2024-09-21T02:58:49.980890+0000","last_unstale":"2024-09-21T02:58:49.982319+0000","last_undegraded":"2024-09-21T02:58:49.982319+0000","last_fullsized":"2024-09-21T02:58:49.982319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:59.251327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955362+0000","last_change":"2024-09-21T02:58:15.049561+0000","last_active":"2024-09-21T03:00:17.955362+0000","last_peered":"2024-09-21T03:00:17.955362+0000","last_clean":"2024-09-21T03:00:17.955362+0000","last_became_active":"2024-09-21T02:58:15.049205+0000","last_became_peered":"2024-09-21T02:58:15.049205+0000","last_unstale":"2024-09-21T03:00:17.955362+0000","last_undegraded":"2024-09-21T03:00:17.955362+0000","last_fullsized":"2024-09-21T03:00:17.955362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:56.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:34.321727+0000","last_change":"2024-09-21T02:58:13.018964+0000","last_active":"2024-09-21T03:00:34.321727+0000","last_peered":"2024-09-21T03:00:34.321727+0000","last_clean":"2024-09-21T03:00:34.321727+0000","last_became_active":"2024-09-21T02:58:13.017420+0000","last_became_peered":"2024-09-21T02:58:13.017420+0000","last_unstale":"2024-09-21T03:00:34.321727+0000","last_undegraded":"2024-09-21T03:00:34.321727+0000","last_fullsized":"2024-09-21T03:00:34.321727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233600+0000","last_change":"2024-09-21T02:58:49.233486+0000","last_active":"2024-09-21T02:58:49.233600+0000","last_peered":"2024-09-21T02:58:49.233600+0000","last_clean":"2024-09-21T02:58:49.233600+0000","last_became_active":"2024-09-21T02:58:49.232940+0000","last_became_peered":"2024-09-21T02:58:49.232940+0000","last_unstale":"2024-09-21T02:58:49.233600+0000","last_undegraded":"2024-09-21T02:58:49.233600+0000","last_fullsized":"2024-09-21T02:58:49.233600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:19.283141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979795+0000","last_change":"2024-09-21T02:58:22.085163+0000","last_active":"2024-09-21T02:58:49.979795+0000","last_peered":"2024-09-21T02:58:49.979795+0000","last_clean":"2024-09-21T02:58:49.979795+0000","last_became_active":"2024-09-21T02:58:22.084768+0000","last_became_peered":"2024-09-21T02:58:22.084768+0000","last_unstale":"2024-09-21T02:58:49.979795+0000","last_undegraded":"2024-09-21T02:58:49.979795+0000","last_fullsized":"2024-09-21T02:58:49.979795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:46.892421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947197+0000","last_change":"2024-09-21T02:58:15.035051+0000","last_active":"2024-09-21T03:00:17.947197+0000","last_peered":"2024-09-21T03:00:17.947197+0000","last_clean":"2024-09-21T03:00:17.947197+0000","last_became_active":"2024-09-21T02:58:15.034692+0000","last_became_peered":"2024-09-21T02:58:15.034692+0000","last_unstale":"2024-09-21T03:00:17.947197+0000","last_undegraded":"2024-09-21T03:00:17.947197+0000","last_fullsized":"2024-09-21T03:00:17.947197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:14.605154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748786+0000","last_change":"2024-09-21T02:58:13.018102+0000","last_active":"2024-09-21T02:58:49.748786+0000","last_peered":"2024-09-21T02:58:49.748786+0000","last_clean":"2024-09-21T02:58:49.748786+0000","last_became_active":"2024-09-21T02:58:13.017537+0000","last_became_peered":"2024-09-21T02:58:13.017537+0000","last_unstale":"2024-09-21T02:58:49.748786+0000","last_undegraded":"2024-09-21T02:58:49.748786+0000","last_fullsized":"2024-09-21T02:58:49.748786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:40.096326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227485+0000","last_change":"2024-09-21T02:58:22.084362+0000","last_active":"2024-09-21T02:58:49.227485+0000","last_peered":"2024-09-21T02:58:49.227485+0000","last_clean":"2024-09-21T02:58:49.227485+0000","last_became_active":"2024-09-21T02:58:22.083895+0000","last_became_peered":"2024-09-21T02:58:22.083895+0000","last_unstale":"2024-09-21T02:58:49.227485+0000","last_undegraded":"2024-09-21T02:58:49.227485+0000","last_fullsized":"2024-09-21T02:58:49.227485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:54.101588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.932312+0000","last_change":"2024-09-21T02:58:15.034768+0000","last_active":"2024-09-21T03:00:17.932312+0000","last_peered":"2024-09-21T03:00:17.932312+0000","last_clean":"2024-09-21T03:00:17.932312+0000","last_became_active":"2024-09-21T02:58:15.034420+0000","last_became_peered":"2024-09-21T02:58:15.034420+0000","last_unstale":"2024-09-21T03:00:17.932312+0000","last_undegraded":"2024-09-21T03:00:17.932312+0000","last_fullsized":"2024-09-21T03:00:17.932312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:25.750158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152269+0000","last_change":"2024-09-21T02:58:13.015026+0000","last_active":"2024-09-21T02:58:51.152269+0000","last_peered":"2024-09-21T02:58:51.152269+0000","last_clean":"2024-09-21T02:58:51.152269+0000","last_became_active":"2024-09-21T02:58:13.014668+0000","last_became_peered":"2024-09-21T02:58:13.014668+0000","last_unstale":"2024-09-21T02:58:51.152269+0000","last_undegraded":"2024-09-21T02:58:51.152269+0000","last_fullsized":"2024-09-21T02:58:51.152269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:20.117518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153234+0000","last_change":"2024-09-21T02:58:13.018044+0000","last_active":"2024-09-21T02:58:51.153234+0000","last_peered":"2024-09-21T02:58:51.153234+0000","last_clean":"2024-09-21T02:58:51.153234+0000","last_became_active":"2024-09-21T02:58:13.017628+0000","last_became_peered":"2024-09-21T02:58:13.017628+0000","last_unstale":"2024-09-21T02:58:51.153234+0000","last_undegraded":"2024-09-21T02:58:51.153234+0000","last_fullsized":"2024-09-21T02:58:51.153234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:38.749379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942552+0000","last_change":"2024-09-21T02:58:15.048160+0000","last_active":"2024-09-21T03:00:17.942552+0000","last_peered":"2024-09-21T03:00:17.942552+0000","last_clean":"2024-09-21T03:00:17.942552+0000","last_became_active":"2024-09-21T02:58:15.046371+0000","last_became_peered":"2024-09-21T02:58:15.046371+0000","last_unstale":"2024-09-21T03:00:17.942552+0000","last_undegraded":"2024-09-21T03:00:17.942552+0000","last_fullsized":"2024-09-21T03:00:17.942552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:49.386799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224497+0000","last_change":"2024-09-21T02:58:22.089918+0000","last_active":"2024-09-21T02:58:49.224497+0000","last_peered":"2024-09-21T02:58:49.224497+0000","last_clean":"2024-09-21T02:58:49.224497+0000","last_became_active":"2024-09-21T02:58:22.089457+0000","last_became_peered":"2024-09-21T02:58:22.089457+0000","last_unstale":"2024-09-21T02:58:49.224497+0000","last_undegraded":"2024-09-21T02:58:49.224497+0000","last_fullsized":"2024-09-21T02:58:49.224497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:28.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:31.316323+0000","last_change":"2024-09-21T02:58:13.021192+0000","last_active":"2024-09-21T03:00:31.316323+0000","last_peered":"2024-09-21T03:00:31.316323+0000","last_clean":"2024-09-21T03:00:31.316323+0000","last_became_active":"2024-09-21T02:58:13.020746+0000","last_became_peered":"2024-09-21T02:58:13.020746+0000","last_unstale":"2024-09-21T03:00:31.316323+0000","last_undegraded":"2024-09-21T03:00:31.316323+0000","last_fullsized":"2024-09-21T03:00:31.316323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:13.260225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.946573+0000","last_change":"2024-09-21T02:58:15.038375+0000","last_active":"2024-09-21T03:00:17.946573+0000","last_peered":"2024-09-21T03:00:17.946573+0000","last_clean":"2024-09-21T03:00:17.946573+0000","last_became_active":"2024-09-21T02:58:15.038011+0000","last_became_peered":"2024-09-21T02:58:15.038011+0000","last_unstale":"2024-09-21T03:00:17.946573+0000","last_undegraded":"2024-09-21T03:00:17.946573+0000","last_fullsized":"2024-09-21T03:00:17.946573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:50.820554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224842+0000","last_change":"2024-09-21T02:58:22.088436+0000","last_active":"2024-09-21T02:58:49.224842+0000","last_peered":"2024-09-21T02:58:49.224842+0000","last_clean":"2024-09-21T02:58:49.224842+0000","last_became_active":"2024-09-21T02:58:22.087857+0000","last_became_peered":"2024-09-21T02:58:22.087857+0000","last_unstale":"2024-09-21T02:58:49.224842+0000","last_undegraded":"2024-09-21T02:58:49.224842+0000","last_fullsized":"2024-09-21T02:58:49.224842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:40.314833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942098+0000","last_change":"2024-09-21T02:58:15.041490+0000","last_active":"2024-09-21T03:00:17.942098+0000","last_peered":"2024-09-21T03:00:17.942098+0000","last_clean":"2024-09-21T03:00:17.942098+0000","last_became_active":"2024-09-21T02:58:15.041106+0000","last_became_peered":"2024-09-21T02:58:15.041106+0000","last_unstale":"2024-09-21T03:00:17.942098+0000","last_undegraded":"2024-09-21T03:00:17.942098+0000","last_fullsized":"2024-09-21T03:00:17.942098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:57.228254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951748+0000","last_change":"2024-09-21T02:58:15.041375+0000","last_active":"2024-09-21T03:00:17.951748+0000","last_peered":"2024-09-21T03:00:17.951748+0000","last_clean":"2024-09-21T03:00:17.951748+0000","last_became_active":"2024-09-21T02:58:15.041041+0000","last_became_peered":"2024-09-21T02:58:15.041041+0000","last_unstale":"2024-09-21T03:00:17.951748+0000","last_undegraded":"2024-09-21T03:00:17.951748+0000","last_fullsized":"2024-09-21T03:00:17.951748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:49.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938040+0000","last_change":"2024-09-21T02:58:15.036772+0000","last_active":"2024-09-21T03:00:17.938040+0000","last_peered":"2024-09-21T03:00:17.938040+0000","last_clean":"2024-09-21T03:00:17.938040+0000","last_became_active":"2024-09-21T02:58:15.036390+0000","last_became_peered":"2024-09-21T02:58:15.036390+0000","last_unstale":"2024-09-21T03:00:17.938040+0000","last_undegraded":"2024-09-21T03:00:17.938040+0000","last_fullsized":"2024-09-21T03:00:17.938040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:49.169184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.950999+0000","last_change":"2024-09-21T02:58:15.035375+0000","last_active":"2024-09-21T03:00:17.950999+0000","last_peered":"2024-09-21T03:00:17.950999+0000","last_clean":"2024-09-21T03:00:17.950999+0000","last_became_active":"2024-09-21T02:58:15.035015+0000","last_became_peered":"2024-09-21T02:58:15.035015+0000","last_unstale":"2024-09-21T03:00:17.950999+0000","last_undegraded":"2024-09-21T03:00:17.950999+0000","last_fullsized":"2024-09-21T03:00:17.950999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:32.980690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938021+0000","last_change":"2024-09-21T02:58:15.046431+0000","last_active":"2024-09-21T03:00:17.938021+0000","last_peered":"2024-09-21T03:00:17.938021+0000","last_clean":"2024-09-21T03:00:17.938021+0000","last_became_active":"2024-09-21T02:58:15.046048+0000","last_became_peered":"2024-09-21T02:58:15.046048+0000","last_unstale":"2024-09-21T03:00:17.938021+0000","last_undegraded":"2024-09-21T03:00:17.938021+0000","last_fullsized":"2024-09-21T03:00:17.938021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:42.079020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.943370+0000","last_change":"2024-09-21T02:58:15.043192+0000","last_active":"2024-09-21T03:00:17.943370+0000","last_peered":"2024-09-21T03:00:17.943370+0000","last_clean":"2024-09-21T03:00:17.943370+0000","last_became_active":"2024-09-21T02:58:15.042413+0000","last_became_peered":"2024-09-21T02:58:15.042413+0000","last_unstale":"2024-09-21T03:00:17.943370+0000","last_undegraded":"2024-09-21T03:00:17.943370+0000","last_fullsized":"2024-09-21T03:00:17.943370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:31.491311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945252+0000","last_change":"2024-09-21T02:58:15.040194+0000","last_active":"2024-09-21T03:00:17.945252+0000","last_peered":"2024-09-21T03:00:17.945252+0000","last_clean":"2024-09-21T03:00:17.945252+0000","last_became_active":"2024-09-21T02:58:15.039803+0000","last_became_peered":"2024-09-21T02:58:15.039803+0000","last_unstale":"2024-09-21T03:00:17.945252+0000","last_undegraded":"2024-09-21T03:00:17.945252+0000","last_fullsized":"2024-09-21T03:00:17.945252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:21.357004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939815+0000","last_change":"2024-09-21T02:58:15.043038+0000","last_active":"2024-09-21T03:00:17.939815+0000","last_peered":"2024-09-21T03:00:17.939815+0000","last_clean":"2024-09-21T03:00:17.939815+0000","last_became_active":"2024-09-21T02:58:15.042643+0000","last_became_peered":"2024-09-21T02:58:15.042643+0000","last_unstale":"2024-09-21T03:00:17.939815+0000","last_undegraded":"2024-09-21T03:00:17.939815+0000","last_fullsized":"2024-09-21T03:00:17.939815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:14.639995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944730+0000","last_change":"2024-09-21T02:58:15.037015+0000","last_active":"2024-09-21T03:00:17.944730+0000","last_peered":"2024-09-21T03:00:17.944730+0000","last_clean":"2024-09-21T03:00:17.944730+0000","last_became_active":"2024-09-21T02:58:15.036628+0000","last_became_peered":"2024-09-21T02:58:15.036628+0000","last_unstale":"2024-09-21T03:00:17.944730+0000","last_undegraded":"2024-09-21T03:00:17.944730+0000","last_fullsized":"2024-09-21T03:00:17.944730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:07.823178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.940728+0000","last_change":"2024-09-21T02:58:15.041768+0000","last_active":"2024-09-21T03:00:17.940728+0000","last_peered":"2024-09-21T03:00:17.940728+0000","last_clean":"2024-09-21T03:00:17.940728+0000","last_became_active":"2024-09-21T02:58:15.041374+0000","last_became_peered":"2024-09-21T02:58:15.041374+0000","last_unstale":"2024-09-21T03:00:17.940728+0000","last_undegraded":"2024-09-21T03:00:17.940728+0000","last_fullsized":"2024-09-21T03:00:17.940728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:25.145949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.952784+0000","last_change":"2024-09-21T02:58:15.047263+0000","last_active":"2024-09-21T03:00:17.952784+0000","last_peered":"2024-09-21T03:00:17.952784+0000","last_clean":"2024-09-21T03:00:17.952784+0000","last_became_active":"2024-09-21T02:58:15.046490+0000","last_became_peered":"2024-09-21T02:58:15.046490+0000","last_unstale":"2024-09-21T03:00:17.952784+0000","last_undegraded":"2024-09-21T03:00:17.952784+0000","last_fullsized":"2024-09-21T03:00:17.952784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:45.413510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939463+0000","last_change":"2024-09-21T02:58:15.034115+0000","last_active":"2024-09-21T03:00:17.939463+0000","last_peered":"2024-09-21T03:00:17.939463+0000","last_clean":"2024-09-21T03:00:17.939463+0000","last_became_active":"2024-09-21T02:58:15.033709+0000","last_became_peered":"2024-09-21T02:58:15.033709+0000","last_unstale":"2024-09-21T03:00:17.939463+0000","last_undegraded":"2024-09-21T03:00:17.939463+0000","last_fullsized":"2024-09-21T03:00:17.939463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:54.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.943614+0000","last_change":"2024-09-21T02:58:15.047154+0000","last_active":"2024-09-21T03:00:17.943614+0000","last_peered":"2024-09-21T03:00:17.943614+0000","last_clean":"2024-09-21T03:00:17.943614+0000","last_became_active":"2024-09-21T02:58:15.046777+0000","last_became_peered":"2024-09-21T02:58:15.046777+0000","last_unstale":"2024-09-21T03:00:17.943614+0000","last_undegraded":"2024-09-21T03:00:17.943614+0000","last_fullsized":"2024-09-21T03:00:17.943614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:56.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939462+0000","last_change":"2024-09-21T02:58:15.036867+0000","last_active":"2024-09-21T03:00:17.939462+0000","last_peered":"2024-09-21T03:00:17.939462+0000","last_clean":"2024-09-21T03:00:17.939462+0000","last_became_active":"2024-09-21T02:58:15.036228+0000","last_became_peered":"2024-09-21T02:58:15.036228+0000","last_unstale":"2024-09-21T03:00:17.939462+0000","last_undegraded":"2024-09-21T03:00:17.939462+0000","last_fullsized":"2024-09-21T03:00:17.939462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:11.245917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947421+0000","last_change":"2024-09-21T02:58:15.037311+0000","last_active":"2024-09-21T03:00:17.947421+0000","last_peered":"2024-09-21T03:00:17.947421+0000","last_clean":"2024-09-21T03:00:17.947421+0000","last_became_active":"2024-09-21T02:58:15.036909+0000","last_became_peered":"2024-09-21T02:58:15.036909+0000","last_unstale":"2024-09-21T03:00:17.947421+0000","last_undegraded":"2024-09-21T03:00:17.947421+0000","last_fullsized":"2024-09-21T03:00:17.947421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:35.250000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954821+0000","last_change":"2024-09-21T02:58:15.042678+0000","last_active":"2024-09-21T03:00:17.954821+0000","last_peered":"2024-09-21T03:00:17.954821+0000","last_clean":"2024-09-21T03:00:17.954821+0000","last_became_active":"2024-09-21T02:58:15.042334+0000","last_became_peered":"2024-09-21T02:58:15.042334+0000","last_unstale":"2024-09-21T03:00:17.954821+0000","last_undegraded":"2024-09-21T03:00:17.954821+0000","last_fullsized":"2024-09-21T03:00:17.954821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:09.302354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953098+0000","last_change":"2024-09-21T02:58:15.040741+0000","last_active":"2024-09-21T03:00:17.953098+0000","last_peered":"2024-09-21T03:00:17.953098+0000","last_clean":"2024-09-21T03:00:17.953098+0000","last_became_active":"2024-09-21T02:58:15.040357+0000","last_became_peered":"2024-09-21T02:58:15.040357+0000","last_unstale":"2024-09-21T03:00:17.953098+0000","last_undegraded":"2024-09-21T03:00:17.953098+0000","last_fullsized":"2024-09-21T03:00:17.953098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.950877+0000","last_change":"2024-09-21T02:58:15.029780+0000","last_active":"2024-09-21T03:00:17.950877+0000","last_peered":"2024-09-21T03:00:17.950877+0000","last_clean":"2024-09-21T03:00:17.950877+0000","last_became_active":"2024-09-21T02:58:15.029259+0000","last_became_peered":"2024-09-21T02:58:15.029259+0000","last_unstale":"2024-09-21T03:00:17.950877+0000","last_undegraded":"2024-09-21T03:00:17.950877+0000","last_fullsized":"2024-09-21T03:00:17.950877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:35.683337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945010+0000","last_change":"2024-09-21T02:58:15.040557+0000","last_active":"2024-09-21T03:00:17.945010+0000","last_peered":"2024-09-21T03:00:17.945010+0000","last_clean":"2024-09-21T03:00:17.945010+0000","last_became_active":"2024-09-21T02:58:15.040178+0000","last_became_peered":"2024-09-21T02:58:15.040178+0000","last_unstale":"2024-09-21T03:00:17.945010+0000","last_undegraded":"2024-09-21T03:00:17.945010+0000","last_fullsized":"2024-09-21T03:00:17.945010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:50.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.925448+0000","last_change":"2024-09-21T02:58:15.041717+0000","last_active":"2024-09-21T03:00:17.925448+0000","last_peered":"2024-09-21T03:00:17.925448+0000","last_clean":"2024-09-21T03:00:17.925448+0000","last_became_active":"2024-09-21T02:58:15.041375+0000","last_became_peered":"2024-09-21T02:58:15.041375+0000","last_unstale":"2024-09-21T03:00:17.925448+0000","last_undegraded":"2024-09-21T03:00:17.925448+0000","last_fullsized":"2024-09-21T03:00:17.925448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:22.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.924845+0000","last_change":"2024-09-21T02:58:15.042001+0000","last_active":"2024-09-21T03:00:17.924845+0000","last_peered":"2024-09-21T03:00:17.924845+0000","last_clean":"2024-09-21T03:00:17.924845+0000","last_became_active":"2024-09-21T02:58:15.038585+0000","last_became_peered":"2024-09-21T02:58:15.038585+0000","last_unstale":"2024-09-21T03:00:17.924845+0000","last_undegraded":"2024-09-21T03:00:17.924845+0000","last_fullsized":"2024-09-21T03:00:17.924845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954646+0000","last_change":"2024-09-21T02:58:15.046636+0000","last_active":"2024-09-21T03:00:17.954646+0000","last_peered":"2024-09-21T03:00:17.954646+0000","last_clean":"2024-09-21T03:00:17.954646+0000","last_became_active":"2024-09-21T02:58:15.046103+0000","last_became_peered":"2024-09-21T02:58:15.046103+0000","last_unstale":"2024-09-21T03:00:17.954646+0000","last_undegraded":"2024-09-21T03:00:17.954646+0000","last_fullsized":"2024-09-21T03:00:17.954646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.579641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.946646+0000","last_change":"2024-09-21T02:58:15.045461+0000","last_active":"2024-09-21T03:00:17.946646+0000","last_peered":"2024-09-21T03:00:17.946646+0000","last_clean":"2024-09-21T03:00:17.946646+0000","last_became_active":"2024-09-21T02:58:15.045091+0000","last_became_peered":"2024-09-21T02:58:15.045091+0000","last_unstale":"2024-09-21T03:00:17.946646+0000","last_undegraded":"2024-09-21T03:00:17.946646+0000","last_fullsized":"2024-09-21T03:00:17.946646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:33.078860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954069+0000","last_change":"2024-09-21T02:58:15.042454+0000","last_active":"2024-09-21T03:00:17.954069+0000","last_peered":"2024-09-21T03:00:17.954069+0000","last_clean":"2024-09-21T03:00:17.954069+0000","last_became_active":"2024-09-21T02:58:15.042071+0000","last_became_peered":"2024-09-21T02:58:15.042071+0000","last_unstale":"2024-09-21T03:00:17.954069+0000","last_undegraded":"2024-09-21T03:00:17.954069+0000","last_fullsized":"2024-09-21T03:00:17.954069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:09.798110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941111+0000","last_change":"2024-09-21T02:58:15.039238+0000","last_active":"2024-09-21T03:00:17.941111+0000","last_peered":"2024-09-21T03:00:17.941111+0000","last_clean":"2024-09-21T03:00:17.941111+0000","last_became_active":"2024-09-21T02:58:15.037883+0000","last_became_peered":"2024-09-21T02:58:15.037883+0000","last_unstale":"2024-09-21T03:00:17.941111+0000","last_undegraded":"2024-09-21T03:00:17.941111+0000","last_fullsized":"2024-09-21T03:00:17.941111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:13.418696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941466+0000","last_change":"2024-09-21T02:58:15.040236+0000","last_active":"2024-09-21T03:00:17.941466+0000","last_peered":"2024-09-21T03:00:17.941466+0000","last_clean":"2024-09-21T03:00:17.941466+0000","last_became_active":"2024-09-21T02:58:15.039895+0000","last_became_peered":"2024-09-21T02:58:15.039895+0000","last_unstale":"2024-09-21T03:00:17.941466+0000","last_undegraded":"2024-09-21T03:00:17.941466+0000","last_fullsized":"2024-09-21T03:00:17.941466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:48.099127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.949016+0000","last_change":"2024-09-21T02:58:15.044804+0000","last_active":"2024-09-21T03:00:17.949016+0000","last_peered":"2024-09-21T03:00:17.949016+0000","last_clean":"2024-09-21T03:00:17.949016+0000","last_became_active":"2024-09-21T02:58:15.044446+0000","last_became_peered":"2024-09-21T02:58:15.044446+0000","last_unstale":"2024-09-21T03:00:17.949016+0000","last_undegraded":"2024-09-21T03:00:17.949016+0000","last_fullsized":"2024-09-21T03:00:17.949016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:37.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.917965+0000","last_change":"2024-09-21T02:58:15.034219+0000","last_active":"2024-09-21T03:00:17.917965+0000","last_peered":"2024-09-21T03:00:17.917965+0000","last_clean":"2024-09-21T03:00:17.917965+0000","last_became_active":"2024-09-21T02:58:15.033775+0000","last_became_peered":"2024-09-21T02:58:15.033775+0000","last_unstale":"2024-09-21T03:00:17.917965+0000","last_undegraded":"2024-09-21T03:00:17.917965+0000","last_fullsized":"2024-09-21T03:00:17.917965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:12.534737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945403+0000","last_change":"2024-09-21T02:58:49.231259+0000","last_active":"2024-09-21T03:00:17.945403+0000","last_peered":"2024-09-21T03:00:17.945403+0000","last_clean":"2024-09-21T03:00:17.945403+0000","last_became_active":"2024-09-21T02:58:49.230867+0000","last_became_peered":"2024-09-21T02:58:49.230867+0000","last_unstale":"2024-09-21T03:00:17.945403+0000","last_undegraded":"2024-09-21T03:00:17.945403+0000","last_fullsized":"2024-09-21T03:00:17.945403+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:11.163458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954842+0000","last_change":"2024-09-21T02:58:15.037273+0000","last_active":"2024-09-21T03:00:17.954842+0000","last_peered":"2024-09-21T03:00:17.954842+0000","last_clean":"2024-09-21T03:00:17.954842+0000","last_became_active":"2024-09-21T02:58:15.036879+0000","last_became_peered":"2024-09-21T02:58:15.036879+0000","last_unstale":"2024-09-21T03:00:17.954842+0000","last_undegraded":"2024-09-21T03:00:17.954842+0000","last_fullsized":"2024-09-21T03:00:17.954842+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:50.721998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944928+0000","last_change":"2024-09-21T02:58:15.035716+0000","last_active":"2024-09-21T03:00:17.944928+0000","last_peered":"2024-09-21T03:00:17.944928+0000","last_clean":"2024-09-21T03:00:17.944928+0000","last_became_active":"2024-09-21T02:58:15.035356+0000","last_became_peered":"2024-09-21T02:58:15.035356+0000","last_unstale":"2024-09-21T03:00:17.944928+0000","last_undegraded":"2024-09-21T03:00:17.944928+0000","last_fullsized":"2024-09-21T03:00:17.944928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953875+0000","last_change":"2024-09-21T02:58:15.041737+0000","last_active":"2024-09-21T03:00:17.953875+0000","last_peered":"2024-09-21T03:00:17.953875+0000","last_clean":"2024-09-21T03:00:17.953875+0000","last_became_active":"2024-09-21T02:58:15.041387+0000","last_became_peered":"2024-09-21T02:58:15.041387+0000","last_unstale":"2024-09-21T03:00:17.953875+0000","last_undegraded":"2024-09-21T03:00:17.953875+0000","last_fullsized":"2024-09-21T03:00:17.953875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.893510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76431,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":648,"num_read_kb":409,"num_write":185,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281500,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":462290,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972399,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1117537,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135924,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":466622,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332153,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":462446,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495678,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1059482,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659203,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":457702,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855431,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":1054045,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018957,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":463377,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":457896,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444119,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":526409,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":524566,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":459090,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:00:36.826 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T03:00:36.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:00:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:37.511 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:37 smithi081 ceph-mon[30991]: pgmap v366: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T03:00:37.511 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:37 smithi081 ceph-mon[30991]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 -- 172.21.15.81:0/905634523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec103b60 msgr2=0x7f5fec103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/905634523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec103b60 0x7f5fec103f70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009900 tx=0x7f5fdc02a410 comp rx=0 tx=0).stop 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 -- 172.21.15.81:0/905634523 shutdown_connections 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/905634523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fec1094a0 0x7f5fec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/905634523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec109df0 0x7f5fec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/905634523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec103b60 0x7f5fec103f70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 -- 172.21.15.81:0/905634523 >> 172.21.15.81:0/905634523 conn(0x7f5fec07b850 msgr2=0x7f5fec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 -- 172.21.15.81:0/905634523 shutdown_connections 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.509+0000 7f5ff27d2640 1 -- 172.21.15.81:0/905634523 wait complete. 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.510+0000 7f5ff27d2640 1 Processor -- start 2024-09-21T03:00:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.510+0000 7f5ff27d2640 1 -- start start 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5ff27d2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec103b60 0x7f5fec19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5ff27d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec1094a0 0x7f5fec19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5ff27d2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fec109df0 0x7f5fec19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5ff27d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec113960 con 0x7f5fec1094a0 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5ff27d2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec1137e0 con 0x7f5fec103b60 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5ff27d2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec113ae0 con 0x7f5fec109df0 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec1094a0 0x7f5fec19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec1094a0 0x7f5fec19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60756/0 (socket says 172.21.15.81:60756) 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 -- 172.21.15.81:0/2846480802 learned_addr learned my addr 172.21.15.81:0/2846480802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5ff0d6f640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fec109df0 0x7f5fec19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5febfff640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec103b60 0x7f5fec19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 -- 172.21.15.81:0/2846480802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fec109df0 msgr2=0x7f5fec19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fec109df0 0x7f5fec19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 -- 172.21.15.81:0/2846480802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec103b60 msgr2=0x7f5fec19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec103b60 0x7f5fec19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.511+0000 7f5feb7fe640 1 -- 172.21.15.81:0/2846480802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec1a03a0 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.512+0000 7f5feb7fe640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec1094a0 0x7f5fec19a9d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c970 tx=0x7f5fe000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.512+0000 7f5fe97fa640 1 -- 172.21.15.81:0/2846480802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0004220 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.512+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fec1a0690 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.512+0000 7f5fe97fa640 1 -- 172.21.15.81:0/2846480802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fe0007e40 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.512+0000 7f5fe97fa640 1 -- 172.21.15.81:0/2846480802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00047a0 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.512+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fec1a6df0 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.513+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fec103f70 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.515+0000 7f5fe97fa640 1 -- 172.21.15.81:0/2846480802 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5fe00079b0 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.516+0000 7f5fe97fa640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5fd40b6510 0x7f5fd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.516+0000 7f5febfff640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5fd40b6510 0x7f5fd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.516+0000 7f5fe97fa640 1 -- 172.21.15.81:0/2846480802 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5fe00e76e0 con 0x7f5fec1094a0 2024-09-21T03:00:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.517+0000 7f5febfff640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5fd40b6510 0x7f5fd40b8a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000c00 tx=0x7f5fdc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.519+0000 7f5fe97fa640 1 -- 172.21.15.81:0/2846480802 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fe0014030 con 0x7f5fec1094a0 2024-09-21T03:00:37.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:37 smithi164 ceph-mon[34236]: pgmap v366: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T03:00:37.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:37 smithi164 ceph-mon[34236]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:37.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.695+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 --> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5fec063800 con 0x7f5fd40b6510 2024-09-21T03:00:37.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.700+0000 7f5fe97fa640 1 -- 172.21.15.81:0/2846480802 <== mgr.14150 v2:172.21.15.81:6800/3007447899 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340734 (secure 0 0 0) 0x7f5fec063800 con 0x7f5fd40b6510 2024-09-21T03:00:37.705 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:37.706 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.703+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5fd40b6510 msgr2=0x7f5fd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.703+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5fd40b6510 0x7f5fd40b8a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000c00 tx=0x7f5fdc009680 comp rx=0 tx=0).stop 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.703+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec1094a0 msgr2=0x7f5fec19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.703+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec1094a0 0x7f5fec19a9d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c970 tx=0x7f5fe000ce30 comp rx=0 tx=0).stop 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 shutdown_connections 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5fd40b6510 0x7f5fd40b8a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5fec109df0 0x7f5fec19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec1094a0 0x7f5fec19a9d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 --2- 172.21.15.81:0/2846480802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fec103b60 0x7f5fec19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 >> 172.21.15.81:0/2846480802 conn(0x7f5fec07b850 msgr2=0x7f5fec1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 shutdown_connections 2024-09-21T03:00:37.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:37.704+0000 7f5ff27d2640 1 -- 172.21.15.81:0/2846480802 wait complete. 2024-09-21T03:00:37.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:37 smithi181 ceph-mon[34096]: pgmap v366: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T03:00:37.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:37 smithi181 ceph-mon[34096]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:38.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:38 smithi081 ceph-mon[30991]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:38.505 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-21T03:00:35.738992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667033,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":724,"num_read_kb":473,"num_write":310,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":751,"ondisk_log_size":751,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385232,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556592,"statfs":{"total":1151940427776,"available":1151545950208,"internally_reserved":0,"allocated":11288576,"data_stored":7511462,"data_compressed":389853,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5828,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":48,"num_write":10,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003472"},"pg_stats":[{"pgid":"2.1f","version":"82'9","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.159285+0000","last_change":"2024-09-21T02:58:13.017321+0000","last_active":"2024-09-21T02:58:52.159285+0000","last_peered":"2024-09-21T02:58:52.159285+0000","last_clean":"2024-09-21T02:58:52.159285+0000","last_became_active":"2024-09-21T02:58:13.017017+0000","last_became_peered":"2024-09-21T02:58:13.017017+0000","last_unstale":"2024-09-21T02:58:52.159285+0000","last_undegraded":"2024-09-21T02:58:52.159285+0000","last_fullsized":"2024-09-21T02:58:52.159285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:11.211966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945098+0000","last_change":"2024-09-21T02:58:15.043883+0000","last_active":"2024-09-21T03:00:17.945098+0000","last_peered":"2024-09-21T03:00:17.945098+0000","last_clean":"2024-09-21T03:00:17.945098+0000","last_became_active":"2024-09-21T02:58:15.043551+0000","last_became_peered":"2024-09-21T02:58:15.043551+0000","last_unstale":"2024-09-21T03:00:17.945098+0000","last_undegraded":"2024-09-21T03:00:17.945098+0000","last_fullsized":"2024-09-21T03:00:17.945098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:40.867181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224252+0000","last_change":"2024-09-21T02:58:22.084562+0000","last_active":"2024-09-21T02:58:49.224252+0000","last_peered":"2024-09-21T02:58:49.224252+0000","last_clean":"2024-09-21T02:58:49.224252+0000","last_became_active":"2024-09-21T02:58:22.084145+0000","last_became_peered":"2024-09-21T02:58:22.084145+0000","last_unstale":"2024-09-21T02:58:49.224252+0000","last_undegraded":"2024-09-21T02:58:49.224252+0000","last_fullsized":"2024-09-21T02:58:49.224252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:56.402375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.151240+0000","last_change":"2024-09-21T02:58:13.553479+0000","last_active":"2024-09-21T02:58:51.151240+0000","last_peered":"2024-09-21T02:58:51.151240+0000","last_clean":"2024-09-21T02:58:51.151240+0000","last_became_active":"2024-09-21T02:58:13.553117+0000","last_became_peered":"2024-09-21T02:58:13.553117+0000","last_unstale":"2024-09-21T02:58:51.151240+0000","last_undegraded":"2024-09-21T02:58:51.151240+0000","last_fullsized":"2024-09-21T02:58:51.151240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:34.301361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955348+0000","last_change":"2024-09-21T02:58:15.041724+0000","last_active":"2024-09-21T03:00:17.955348+0000","last_peered":"2024-09-21T03:00:17.955348+0000","last_clean":"2024-09-21T03:00:17.955348+0000","last_became_active":"2024-09-21T02:58:15.041355+0000","last_became_peered":"2024-09-21T02:58:15.041355+0000","last_unstale":"2024-09-21T03:00:17.955348+0000","last_undegraded":"2024-09-21T03:00:17.955348+0000","last_fullsized":"2024-09-21T03:00:17.955348+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:19.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226270+0000","last_change":"2024-09-21T02:58:22.085004+0000","last_active":"2024-09-21T02:58:49.226270+0000","last_peered":"2024-09-21T02:58:49.226270+0000","last_clean":"2024-09-21T02:58:49.226270+0000","last_became_active":"2024-09-21T02:58:22.084622+0000","last_became_peered":"2024-09-21T02:58:22.084622+0000","last_unstale":"2024-09-21T02:58:49.226270+0000","last_undegraded":"2024-09-21T02:58:49.226270+0000","last_fullsized":"2024-09-21T02:58:49.226270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:44.303286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152223+0000","last_change":"2024-09-21T02:58:49.237002+0000","last_active":"2024-09-21T02:58:51.152223+0000","last_peered":"2024-09-21T02:58:51.152223+0000","last_clean":"2024-09-21T02:58:51.152223+0000","last_became_active":"2024-09-21T02:58:49.233219+0000","last_became_peered":"2024-09-21T02:58:49.233219+0000","last_unstale":"2024-09-21T02:58:51.152223+0000","last_undegraded":"2024-09-21T02:58:51.152223+0000","last_fullsized":"2024-09-21T02:58:51.152223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:11:38.409153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955851+0000","last_change":"2024-09-21T02:58:15.051658+0000","last_active":"2024-09-21T03:00:17.955851+0000","last_peered":"2024-09-21T03:00:17.955851+0000","last_clean":"2024-09-21T03:00:17.955851+0000","last_became_active":"2024-09-21T02:58:15.048345+0000","last_became_peered":"2024-09-21T02:58:15.048345+0000","last_unstale":"2024-09-21T03:00:17.955851+0000","last_undegraded":"2024-09-21T03:00:17.955851+0000","last_fullsized":"2024-09-21T03:00:17.955851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:36.069051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.750150+0000","last_change":"2024-09-21T02:58:49.750028+0000","last_active":"2024-09-21T02:58:49.750150+0000","last_peered":"2024-09-21T02:58:49.750150+0000","last_clean":"2024-09-21T02:58:49.750150+0000","last_became_active":"2024-09-21T02:58:49.749587+0000","last_became_peered":"2024-09-21T02:58:49.749587+0000","last_unstale":"2024-09-21T02:58:49.750150+0000","last_undegraded":"2024-09-21T02:58:49.750150+0000","last_fullsized":"2024-09-21T02:58:49.750150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:33.018490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230873+0000","last_change":"2024-09-21T02:58:13.020762+0000","last_active":"2024-09-21T02:58:49.230873+0000","last_peered":"2024-09-21T02:58:49.230873+0000","last_clean":"2024-09-21T02:58:49.230873+0000","last_became_active":"2024-09-21T02:58:13.020263+0000","last_became_peered":"2024-09-21T02:58:13.020263+0000","last_unstale":"2024-09-21T02:58:49.230873+0000","last_undegraded":"2024-09-21T02:58:49.230873+0000","last_fullsized":"2024-09-21T02:58:49.230873+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:14.490179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.952394+0000","last_change":"2024-09-21T02:58:15.048732+0000","last_active":"2024-09-21T03:00:17.952394+0000","last_peered":"2024-09-21T03:00:17.952394+0000","last_clean":"2024-09-21T03:00:17.952394+0000","last_became_active":"2024-09-21T02:58:15.048393+0000","last_became_peered":"2024-09-21T02:58:15.048393+0000","last_unstale":"2024-09-21T03:00:17.952394+0000","last_undegraded":"2024-09-21T03:00:17.952394+0000","last_fullsized":"2024-09-21T03:00:17.952394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:03:07.430125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.225897+0000","last_change":"2024-09-21T02:58:22.087072+0000","last_active":"2024-09-21T02:58:49.225897+0000","last_peered":"2024-09-21T02:58:49.225897+0000","last_clean":"2024-09-21T02:58:49.225897+0000","last_became_active":"2024-09-21T02:58:22.086695+0000","last_became_peered":"2024-09-21T02:58:22.086695+0000","last_unstale":"2024-09-21T02:58:49.225897+0000","last_undegraded":"2024-09-21T02:58:49.225897+0000","last_fullsized":"2024-09-21T02:58:49.225897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:18.592656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953381+0000","last_change":"2024-09-21T02:58:15.043756+0000","last_active":"2024-09-21T03:00:17.953381+0000","last_peered":"2024-09-21T03:00:17.953381+0000","last_clean":"2024-09-21T03:00:17.953381+0000","last_became_active":"2024-09-21T02:58:15.043415+0000","last_became_peered":"2024-09-21T02:58:15.043415+0000","last_unstale":"2024-09-21T03:00:17.953381+0000","last_undegraded":"2024-09-21T03:00:17.953381+0000","last_fullsized":"2024-09-21T03:00:17.953381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:53.655906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156099+0000","last_change":"2024-09-21T02:58:13.017054+0000","last_active":"2024-09-21T02:58:52.156099+0000","last_peered":"2024-09-21T02:58:52.156099+0000","last_clean":"2024-09-21T02:58:52.156099+0000","last_became_active":"2024-09-21T02:58:13.016636+0000","last_became_peered":"2024-09-21T02:58:13.016636+0000","last_unstale":"2024-09-21T02:58:52.156099+0000","last_undegraded":"2024-09-21T02:58:52.156099+0000","last_fullsized":"2024-09-21T02:58:52.156099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:27.941501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226537+0000","last_change":"2024-09-21T02:58:22.229949+0000","last_active":"2024-09-21T02:58:49.226537+0000","last_peered":"2024-09-21T02:58:49.226537+0000","last_clean":"2024-09-21T02:58:49.226537+0000","last_became_active":"2024-09-21T02:58:22.229490+0000","last_became_peered":"2024-09-21T02:58:22.229490+0000","last_unstale":"2024-09-21T02:58:49.226537+0000","last_undegraded":"2024-09-21T02:58:49.226537+0000","last_fullsized":"2024-09-21T02:58:49.226537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:25.769004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.937881+0000","last_change":"2024-09-21T02:58:15.040559+0000","last_active":"2024-09-21T03:00:17.937881+0000","last_peered":"2024-09-21T03:00:17.937881+0000","last_clean":"2024-09-21T03:00:17.937881+0000","last_became_active":"2024-09-21T02:58:15.040220+0000","last_became_peered":"2024-09-21T02:58:15.040220+0000","last_unstale":"2024-09-21T03:00:17.937881+0000","last_undegraded":"2024-09-21T03:00:17.937881+0000","last_fullsized":"2024-09-21T03:00:17.937881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:55.853966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"82'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:24.684199+0000","last_change":"2024-09-21T02:58:13.017985+0000","last_active":"2024-09-21T03:00:24.684199+0000","last_peered":"2024-09-21T03:00:24.684199+0000","last_clean":"2024-09-21T03:00:24.684199+0000","last_became_active":"2024-09-21T02:58:13.017583+0000","last_became_peered":"2024-09-21T02:58:13.017583+0000","last_unstale":"2024-09-21T03:00:24.684199+0000","last_undegraded":"2024-09-21T03:00:24.684199+0000","last_fullsized":"2024-09-21T03:00:24.684199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:41.917960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226338+0000","last_change":"2024-09-21T02:58:22.077294+0000","last_active":"2024-09-21T02:58:49.226338+0000","last_peered":"2024-09-21T02:58:49.226338+0000","last_clean":"2024-09-21T02:58:49.226338+0000","last_became_active":"2024-09-21T02:58:22.076884+0000","last_became_peered":"2024-09-21T02:58:22.076884+0000","last_unstale":"2024-09-21T02:58:49.226338+0000","last_undegraded":"2024-09-21T02:58:49.226338+0000","last_fullsized":"2024-09-21T02:58:49.226338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:00.045383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941399+0000","last_change":"2024-09-21T02:58:15.045160+0000","last_active":"2024-09-21T03:00:17.941399+0000","last_peered":"2024-09-21T03:00:17.941399+0000","last_clean":"2024-09-21T03:00:17.941399+0000","last_became_active":"2024-09-21T02:58:15.044814+0000","last_became_peered":"2024-09-21T02:58:15.044814+0000","last_unstale":"2024-09-21T03:00:17.941399+0000","last_undegraded":"2024-09-21T03:00:17.941399+0000","last_fullsized":"2024-09-21T03:00:17.941399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:13.325320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.146885+0000","last_change":"2024-09-21T02:58:13.011081+0000","last_active":"2024-09-21T02:58:50.146885+0000","last_peered":"2024-09-21T02:58:50.146885+0000","last_clean":"2024-09-21T02:58:50.146885+0000","last_became_active":"2024-09-21T02:58:13.010682+0000","last_became_peered":"2024-09-21T02:58:13.010682+0000","last_unstale":"2024-09-21T02:58:50.146885+0000","last_undegraded":"2024-09-21T02:58:50.146885+0000","last_fullsized":"2024-09-21T02:58:50.146885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:18.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224126+0000","last_change":"2024-09-21T02:58:22.083449+0000","last_active":"2024-09-21T02:58:49.224126+0000","last_peered":"2024-09-21T02:58:49.224126+0000","last_clean":"2024-09-21T02:58:49.224126+0000","last_became_active":"2024-09-21T02:58:22.082996+0000","last_became_peered":"2024-09-21T02:58:22.082996+0000","last_unstale":"2024-09-21T02:58:49.224126+0000","last_undegraded":"2024-09-21T02:58:49.224126+0000","last_fullsized":"2024-09-21T02:58:49.224126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:21.667824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.936125+0000","last_change":"2024-09-21T02:58:15.039458+0000","last_active":"2024-09-21T03:00:17.936125+0000","last_peered":"2024-09-21T03:00:17.936125+0000","last_clean":"2024-09-21T03:00:17.936125+0000","last_became_active":"2024-09-21T02:58:15.039082+0000","last_became_peered":"2024-09-21T02:58:15.039082+0000","last_unstale":"2024-09-21T03:00:17.936125+0000","last_undegraded":"2024-09-21T03:00:17.936125+0000","last_fullsized":"2024-09-21T03:00:17.936125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:37.102212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147405+0000","last_change":"2024-09-21T02:58:49.982108+0000","last_active":"2024-09-21T02:58:50.147405+0000","last_peered":"2024-09-21T02:58:50.147405+0000","last_clean":"2024-09-21T02:58:50.147405+0000","last_became_active":"2024-09-21T02:58:49.981462+0000","last_became_peered":"2024-09-21T02:58:49.981462+0000","last_unstale":"2024-09-21T02:58:50.147405+0000","last_undegraded":"2024-09-21T02:58:50.147405+0000","last_fullsized":"2024-09-21T02:58:50.147405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:17.624627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226847+0000","last_change":"2024-09-21T02:58:22.231082+0000","last_active":"2024-09-21T02:58:49.226847+0000","last_peered":"2024-09-21T02:58:49.226847+0000","last_clean":"2024-09-21T02:58:49.226847+0000","last_became_active":"2024-09-21T02:58:22.229781+0000","last_became_peered":"2024-09-21T02:58:22.229781+0000","last_unstale":"2024-09-21T02:58:49.226847+0000","last_undegraded":"2024-09-21T02:58:49.226847+0000","last_fullsized":"2024-09-21T02:58:49.226847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:14.964809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951174+0000","last_change":"2024-09-21T02:58:15.033111+0000","last_active":"2024-09-21T03:00:17.951174+0000","last_peered":"2024-09-21T03:00:17.951174+0000","last_clean":"2024-09-21T03:00:17.951174+0000","last_became_active":"2024-09-21T02:58:15.032738+0000","last_became_peered":"2024-09-21T02:58:15.032738+0000","last_unstale":"2024-09-21T03:00:17.951174+0000","last_undegraded":"2024-09-21T03:00:17.951174+0000","last_fullsized":"2024-09-21T03:00:17.951174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:31.209451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.147612+0000","last_change":"2024-09-21T02:58:13.229717+0000","last_active":"2024-09-21T02:58:50.147612+0000","last_peered":"2024-09-21T02:58:50.147612+0000","last_clean":"2024-09-21T02:58:50.147612+0000","last_became_active":"2024-09-21T02:58:13.229376+0000","last_became_peered":"2024-09-21T02:58:13.229376+0000","last_unstale":"2024-09-21T02:58:50.147612+0000","last_undegraded":"2024-09-21T02:58:50.147612+0000","last_fullsized":"2024-09-21T02:58:50.147612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:05.436044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224498+0000","last_change":"2024-09-21T02:58:22.081140+0000","last_active":"2024-09-21T02:58:49.224498+0000","last_peered":"2024-09-21T02:58:49.224498+0000","last_clean":"2024-09-21T02:58:49.224498+0000","last_became_active":"2024-09-21T02:58:22.080670+0000","last_became_peered":"2024-09-21T02:58:22.080670+0000","last_unstale":"2024-09-21T02:58:49.224498+0000","last_undegraded":"2024-09-21T02:58:49.224498+0000","last_fullsized":"2024-09-21T02:58:49.224498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:43.078241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938803+0000","last_change":"2024-09-21T02:58:15.035927+0000","last_active":"2024-09-21T03:00:17.938803+0000","last_peered":"2024-09-21T03:00:17.938803+0000","last_clean":"2024-09-21T03:00:17.938803+0000","last_became_active":"2024-09-21T02:58:15.035529+0000","last_became_peered":"2024-09-21T02:58:15.035529+0000","last_unstale":"2024-09-21T03:00:17.938803+0000","last_undegraded":"2024-09-21T03:00:17.938803+0000","last_fullsized":"2024-09-21T03:00:17.938803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:03.449545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:24.351455+0000","last_change":"2024-09-21T02:58:13.016489+0000","last_active":"2024-09-21T03:00:24.351455+0000","last_peered":"2024-09-21T03:00:24.351455+0000","last_clean":"2024-09-21T03:00:24.351455+0000","last_became_active":"2024-09-21T02:58:13.016176+0000","last_became_peered":"2024-09-21T02:58:13.016176+0000","last_unstale":"2024-09-21T03:00:24.351455+0000","last_undegraded":"2024-09-21T03:00:24.351455+0000","last_fullsized":"2024-09-21T03:00:24.351455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:54.908933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227910+0000","last_change":"2024-09-21T02:58:22.229868+0000","last_active":"2024-09-21T02:58:49.227910+0000","last_peered":"2024-09-21T02:58:49.227910+0000","last_clean":"2024-09-21T02:58:49.227910+0000","last_became_active":"2024-09-21T02:58:22.229318+0000","last_became_peered":"2024-09-21T02:58:22.229318+0000","last_unstale":"2024-09-21T02:58:49.227910+0000","last_undegraded":"2024-09-21T02:58:49.227910+0000","last_fullsized":"2024-09-21T02:58:49.227910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:06.570174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944913+0000","last_change":"2024-09-21T02:58:15.037953+0000","last_active":"2024-09-21T03:00:17.944913+0000","last_peered":"2024-09-21T03:00:17.944913+0000","last_clean":"2024-09-21T03:00:17.944913+0000","last_became_active":"2024-09-21T02:58:15.036934+0000","last_became_peered":"2024-09-21T02:58:15.036934+0000","last_unstale":"2024-09-21T03:00:17.944913+0000","last_undegraded":"2024-09-21T03:00:17.944913+0000","last_fullsized":"2024-09-21T03:00:17.944913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:35.118295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.152171+0000","last_change":"2024-09-21T02:58:13.553861+0000","last_active":"2024-09-21T02:58:52.152171+0000","last_peered":"2024-09-21T02:58:52.152171+0000","last_clean":"2024-09-21T02:58:52.152171+0000","last_became_active":"2024-09-21T02:58:13.553016+0000","last_became_peered":"2024-09-21T02:58:13.553016+0000","last_unstale":"2024-09-21T02:58:52.152171+0000","last_undegraded":"2024-09-21T02:58:52.152171+0000","last_fullsized":"2024-09-21T02:58:52.152171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227080+0000","last_change":"2024-09-21T02:58:22.087306+0000","last_active":"2024-09-21T02:58:49.227080+0000","last_peered":"2024-09-21T02:58:49.227080+0000","last_clean":"2024-09-21T02:58:49.227080+0000","last_became_active":"2024-09-21T02:58:22.086800+0000","last_became_peered":"2024-09-21T02:58:22.086800+0000","last_unstale":"2024-09-21T02:58:49.227080+0000","last_undegraded":"2024-09-21T02:58:49.227080+0000","last_fullsized":"2024-09-21T02:58:49.227080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:28.652990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938678+0000","last_change":"2024-09-21T02:58:15.038383+0000","last_active":"2024-09-21T03:00:17.938678+0000","last_peered":"2024-09-21T03:00:17.938678+0000","last_clean":"2024-09-21T03:00:17.938678+0000","last_became_active":"2024-09-21T02:58:15.037878+0000","last_became_peered":"2024-09-21T02:58:15.037878+0000","last_unstale":"2024-09-21T03:00:17.938678+0000","last_undegraded":"2024-09-21T03:00:17.938678+0000","last_fullsized":"2024-09-21T03:00:17.938678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:14.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223927+0000","last_change":"2024-09-21T02:58:13.555218+0000","last_active":"2024-09-21T02:58:49.223927+0000","last_peered":"2024-09-21T02:58:49.223927+0000","last_clean":"2024-09-21T02:58:49.223927+0000","last_became_active":"2024-09-21T02:58:13.554831+0000","last_became_peered":"2024-09-21T02:58:13.554831+0000","last_unstale":"2024-09-21T02:58:49.223927+0000","last_undegraded":"2024-09-21T02:58:49.223927+0000","last_fullsized":"2024-09-21T02:58:49.223927+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:32.659118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230196+0000","last_change":"2024-09-21T02:58:22.229673+0000","last_active":"2024-09-21T02:58:49.230196+0000","last_peered":"2024-09-21T02:58:49.230196+0000","last_clean":"2024-09-21T02:58:49.230196+0000","last_became_active":"2024-09-21T02:58:22.229034+0000","last_became_peered":"2024-09-21T02:58:22.229034+0000","last_unstale":"2024-09-21T02:58:49.230196+0000","last_undegraded":"2024-09-21T02:58:49.230196+0000","last_fullsized":"2024-09-21T02:58:49.230196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:26.747988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.948504+0000","last_change":"2024-09-21T02:58:49.981660+0000","last_active":"2024-09-21T03:00:17.948504+0000","last_peered":"2024-09-21T03:00:17.948504+0000","last_clean":"2024-09-21T03:00:17.948504+0000","last_became_active":"2024-09-21T02:58:49.980972+0000","last_became_peered":"2024-09-21T02:58:49.980972+0000","last_unstale":"2024-09-21T03:00:17.948504+0000","last_undegraded":"2024-09-21T03:00:17.948504+0000","last_fullsized":"2024-09-21T03:00:17.948504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:26.493769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152564+0000","last_change":"2024-09-21T02:58:13.012751+0000","last_active":"2024-09-21T02:58:51.152564+0000","last_peered":"2024-09-21T02:58:51.152564+0000","last_clean":"2024-09-21T02:58:51.152564+0000","last_became_active":"2024-09-21T02:58:13.012341+0000","last_became_peered":"2024-09-21T02:58:13.012341+0000","last_unstale":"2024-09-21T02:58:51.152564+0000","last_undegraded":"2024-09-21T02:58:51.152564+0000","last_fullsized":"2024-09-21T02:58:51.152564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:40.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435102+0000","last_change":"2024-09-21T02:58:22.084620+0000","last_active":"2024-09-21T02:58:49.435102+0000","last_peered":"2024-09-21T02:58:49.435102+0000","last_clean":"2024-09-21T02:58:49.435102+0000","last_became_active":"2024-09-21T02:58:22.083935+0000","last_became_peered":"2024-09-21T02:58:22.083935+0000","last_unstale":"2024-09-21T02:58:49.435102+0000","last_undegraded":"2024-09-21T02:58:49.435102+0000","last_fullsized":"2024-09-21T02:58:49.435102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:37.033928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942732+0000","last_change":"2024-09-21T02:58:15.046935+0000","last_active":"2024-09-21T03:00:17.942732+0000","last_peered":"2024-09-21T03:00:17.942732+0000","last_clean":"2024-09-21T03:00:17.942732+0000","last_became_active":"2024-09-21T02:58:15.046572+0000","last_became_peered":"2024-09-21T02:58:15.046572+0000","last_unstale":"2024-09-21T03:00:17.942732+0000","last_undegraded":"2024-09-21T03:00:17.942732+0000","last_fullsized":"2024-09-21T03:00:17.942732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:45.942643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:32.373923+0000","last_change":"2024-09-21T02:58:13.553337+0000","last_active":"2024-09-21T03:00:32.373923+0000","last_peered":"2024-09-21T03:00:32.373923+0000","last_clean":"2024-09-21T03:00:32.373923+0000","last_became_active":"2024-09-21T02:58:13.552873+0000","last_became_peered":"2024-09-21T02:58:13.552873+0000","last_unstale":"2024-09-21T03:00:32.373923+0000","last_undegraded":"2024-09-21T03:00:32.373923+0000","last_fullsized":"2024-09-21T03:00:32.373923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:42.800873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435293+0000","last_change":"2024-09-21T02:58:22.230102+0000","last_active":"2024-09-21T02:58:49.435293+0000","last_peered":"2024-09-21T02:58:49.435293+0000","last_clean":"2024-09-21T02:58:49.435293+0000","last_became_active":"2024-09-21T02:58:22.229643+0000","last_became_peered":"2024-09-21T02:58:22.229643+0000","last_unstale":"2024-09-21T02:58:49.435293+0000","last_undegraded":"2024-09-21T02:58:49.435293+0000","last_fullsized":"2024-09-21T02:58:49.435293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:46.396292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938272+0000","last_change":"2024-09-21T02:58:15.043484+0000","last_active":"2024-09-21T03:00:17.938272+0000","last_peered":"2024-09-21T03:00:17.938272+0000","last_clean":"2024-09-21T03:00:17.938272+0000","last_became_active":"2024-09-21T02:58:15.042663+0000","last_became_peered":"2024-09-21T02:58:15.042663+0000","last_unstale":"2024-09-21T03:00:17.938272+0000","last_undegraded":"2024-09-21T03:00:17.938272+0000","last_fullsized":"2024-09-21T03:00:17.938272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:42.937814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152465+0000","last_change":"2024-09-21T02:58:13.018109+0000","last_active":"2024-09-21T02:58:51.152465+0000","last_peered":"2024-09-21T02:58:51.152465+0000","last_clean":"2024-09-21T02:58:51.152465+0000","last_became_active":"2024-09-21T02:58:13.017761+0000","last_became_peered":"2024-09-21T02:58:13.017761+0000","last_unstale":"2024-09-21T02:58:51.152465+0000","last_undegraded":"2024-09-21T02:58:51.152465+0000","last_fullsized":"2024-09-21T02:58:51.152465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:12.613051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748934+0000","last_change":"2024-09-21T02:58:22.230520+0000","last_active":"2024-09-21T02:58:49.748934+0000","last_peered":"2024-09-21T02:58:49.748934+0000","last_clean":"2024-09-21T02:58:49.748934+0000","last_became_active":"2024-09-21T02:58:22.229999+0000","last_became_peered":"2024-09-21T02:58:22.229999+0000","last_unstale":"2024-09-21T02:58:49.748934+0000","last_undegraded":"2024-09-21T02:58:49.748934+0000","last_fullsized":"2024-09-21T02:58:49.748934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:12.899892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944775+0000","last_change":"2024-09-21T02:58:15.040357+0000","last_active":"2024-09-21T03:00:17.944775+0000","last_peered":"2024-09-21T03:00:17.944775+0000","last_clean":"2024-09-21T03:00:17.944775+0000","last_became_active":"2024-09-21T02:58:15.040026+0000","last_became_peered":"2024-09-21T02:58:15.040026+0000","last_unstale":"2024-09-21T03:00:17.944775+0000","last_undegraded":"2024-09-21T03:00:17.944775+0000","last_fullsized":"2024-09-21T03:00:17.944775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:10.216541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156121+0000","last_change":"2024-09-21T02:58:13.014816+0000","last_active":"2024-09-21T02:58:52.156121+0000","last_peered":"2024-09-21T02:58:52.156121+0000","last_clean":"2024-09-21T02:58:52.156121+0000","last_became_active":"2024-09-21T02:58:13.013918+0000","last_became_peered":"2024-09-21T02:58:13.013918+0000","last_unstale":"2024-09-21T02:58:52.156121+0000","last_undegraded":"2024-09-21T02:58:52.156121+0000","last_fullsized":"2024-09-21T02:58:52.156121+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:20.892671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.230777+0000","last_change":"2024-09-21T02:57:01.191389+0000","last_active":"2024-09-21T02:58:49.230777+0000","last_peered":"2024-09-21T02:58:49.230777+0000","last_clean":"2024-09-21T02:58:49.230777+0000","last_became_active":"2024-09-21T02:57:01.185686+0000","last_became_peered":"2024-09-21T02:57:01.185686+0000","last_unstale":"2024-09-21T02:58:49.230777+0000","last_undegraded":"2024-09-21T02:58:49.230777+0000","last_fullsized":"2024-09-21T02:58:49.230777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:53:36.647024+0000","last_clean_scrub_stamp":"2024-09-21T02:53:36.647024+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:40.275496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:57.775841+0000","last_change":"2024-09-21T02:58:22.081891+0000","last_active":"2024-09-21T02:58:57.775841+0000","last_peered":"2024-09-21T02:58:57.775841+0000","last_clean":"2024-09-21T02:58:57.775841+0000","last_became_active":"2024-09-21T02:58:22.081435+0000","last_became_peered":"2024-09-21T02:58:22.081435+0000","last_unstale":"2024-09-21T02:58:57.775841+0000","last_undegraded":"2024-09-21T02:58:57.775841+0000","last_fullsized":"2024-09-21T02:58:57.775841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:51.161690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954916+0000","last_change":"2024-09-21T02:58:15.045013+0000","last_active":"2024-09-21T03:00:17.954916+0000","last_peered":"2024-09-21T03:00:17.954916+0000","last_clean":"2024-09-21T03:00:17.954916+0000","last_became_active":"2024-09-21T02:58:15.044650+0000","last_became_peered":"2024-09-21T02:58:15.044650+0000","last_unstale":"2024-09-21T03:00:17.954916+0000","last_undegraded":"2024-09-21T03:00:17.954916+0000","last_fullsized":"2024-09-21T03:00:17.954916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:39.087982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.159341+0000","last_change":"2024-09-21T02:58:13.553468+0000","last_active":"2024-09-21T02:58:52.159341+0000","last_peered":"2024-09-21T02:58:52.159341+0000","last_clean":"2024-09-21T02:58:52.159341+0000","last_became_active":"2024-09-21T02:58:13.552965+0000","last_became_peered":"2024-09-21T02:58:13.552965+0000","last_unstale":"2024-09-21T02:58:52.159341+0000","last_undegraded":"2024-09-21T02:58:52.159341+0000","last_fullsized":"2024-09-21T02:58:52.159341+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:23:35.224581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227428+0000","last_change":"2024-09-21T02:58:22.086994+0000","last_active":"2024-09-21T02:58:49.227428+0000","last_peered":"2024-09-21T02:58:49.227428+0000","last_clean":"2024-09-21T02:58:49.227428+0000","last_became_active":"2024-09-21T02:58:22.086506+0000","last_became_peered":"2024-09-21T02:58:22.086506+0000","last_unstale":"2024-09-21T02:58:49.227428+0000","last_undegraded":"2024-09-21T02:58:49.227428+0000","last_fullsized":"2024-09-21T02:58:49.227428+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:09.102495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941104+0000","last_change":"2024-09-21T02:58:15.040224+0000","last_active":"2024-09-21T03:00:17.941104+0000","last_peered":"2024-09-21T03:00:17.941104+0000","last_clean":"2024-09-21T03:00:17.941104+0000","last_became_active":"2024-09-21T02:58:15.039115+0000","last_became_peered":"2024-09-21T02:58:15.039115+0000","last_unstale":"2024-09-21T03:00:17.941104+0000","last_undegraded":"2024-09-21T03:00:17.941104+0000","last_fullsized":"2024-09-21T03:00:17.941104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:35.229809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156123+0000","last_change":"2024-09-21T02:58:13.021526+0000","last_active":"2024-09-21T02:58:52.156123+0000","last_peered":"2024-09-21T02:58:52.156123+0000","last_clean":"2024-09-21T02:58:52.156123+0000","last_became_active":"2024-09-21T02:58:13.020521+0000","last_became_peered":"2024-09-21T02:58:13.020521+0000","last_unstale":"2024-09-21T02:58:52.156123+0000","last_undegraded":"2024-09-21T02:58:52.156123+0000","last_fullsized":"2024-09-21T02:58:52.156123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:08.645141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.980132+0000","last_change":"2024-09-21T02:58:22.077862+0000","last_active":"2024-09-21T02:58:49.980132+0000","last_peered":"2024-09-21T02:58:49.980132+0000","last_clean":"2024-09-21T02:58:49.980132+0000","last_became_active":"2024-09-21T02:58:22.077410+0000","last_became_peered":"2024-09-21T02:58:22.077410+0000","last_unstale":"2024-09-21T02:58:49.980132+0000","last_undegraded":"2024-09-21T02:58:49.980132+0000","last_fullsized":"2024-09-21T02:58:49.980132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:06.549842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938738+0000","last_change":"2024-09-21T02:58:15.037775+0000","last_active":"2024-09-21T03:00:17.938738+0000","last_peered":"2024-09-21T03:00:17.938738+0000","last_clean":"2024-09-21T03:00:17.938738+0000","last_became_active":"2024-09-21T02:58:15.037036+0000","last_became_peered":"2024-09-21T02:58:15.037036+0000","last_unstale":"2024-09-21T03:00:17.938738+0000","last_undegraded":"2024-09-21T03:00:17.938738+0000","last_fullsized":"2024-09-21T03:00:17.938738+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:58.289785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435300+0000","last_change":"2024-09-21T02:58:13.015046+0000","last_active":"2024-09-21T02:58:49.435300+0000","last_peered":"2024-09-21T02:58:49.435300+0000","last_clean":"2024-09-21T02:58:49.435300+0000","last_became_active":"2024-09-21T02:58:13.014643+0000","last_became_peered":"2024-09-21T02:58:13.014643+0000","last_unstale":"2024-09-21T02:58:49.435300+0000","last_undegraded":"2024-09-21T02:58:49.435300+0000","last_fullsized":"2024-09-21T02:58:49.435300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:54.913187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.747960+0000","last_change":"2024-09-21T02:58:22.085805+0000","last_active":"2024-09-21T02:58:49.747960+0000","last_peered":"2024-09-21T02:58:49.747960+0000","last_clean":"2024-09-21T02:58:49.747960+0000","last_became_active":"2024-09-21T02:58:22.084752+0000","last_became_peered":"2024-09-21T02:58:22.084752+0000","last_unstale":"2024-09-21T02:58:49.747960+0000","last_undegraded":"2024-09-21T02:58:49.747960+0000","last_fullsized":"2024-09-21T02:58:49.747960+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:39.357089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941139+0000","last_change":"2024-09-21T02:58:15.046643+0000","last_active":"2024-09-21T03:00:17.941139+0000","last_peered":"2024-09-21T03:00:17.941139+0000","last_clean":"2024-09-21T03:00:17.941139+0000","last_became_active":"2024-09-21T02:58:15.046278+0000","last_became_peered":"2024-09-21T02:58:15.046278+0000","last_unstale":"2024-09-21T03:00:17.941139+0000","last_undegraded":"2024-09-21T03:00:17.941139+0000","last_fullsized":"2024-09-21T03:00:17.941139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:29.648084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156242+0000","last_change":"2024-09-21T02:58:13.022176+0000","last_active":"2024-09-21T02:58:52.156242+0000","last_peered":"2024-09-21T02:58:52.156242+0000","last_clean":"2024-09-21T02:58:52.156242+0000","last_became_active":"2024-09-21T02:58:13.020122+0000","last_became_peered":"2024-09-21T02:58:13.020122+0000","last_unstale":"2024-09-21T02:58:52.156242+0000","last_undegraded":"2024-09-21T02:58:52.156242+0000","last_fullsized":"2024-09-21T02:58:52.156242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:12.346056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748411+0000","last_change":"2024-09-21T02:58:22.084221+0000","last_active":"2024-09-21T02:58:49.748411+0000","last_peered":"2024-09-21T02:58:49.748411+0000","last_clean":"2024-09-21T02:58:49.748411+0000","last_became_active":"2024-09-21T02:58:22.083793+0000","last_became_peered":"2024-09-21T02:58:22.083793+0000","last_unstale":"2024-09-21T02:58:49.748411+0000","last_undegraded":"2024-09-21T02:58:49.748411+0000","last_fullsized":"2024-09-21T02:58:49.748411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:13.043641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947630+0000","last_change":"2024-09-21T02:58:49.233440+0000","last_active":"2024-09-21T03:00:17.947630+0000","last_peered":"2024-09-21T03:00:17.947630+0000","last_clean":"2024-09-21T03:00:17.947630+0000","last_became_active":"2024-09-21T02:58:49.232996+0000","last_became_peered":"2024-09-21T02:58:49.232996+0000","last_unstale":"2024-09-21T03:00:17.947630+0000","last_undegraded":"2024-09-21T03:00:17.947630+0000","last_fullsized":"2024-09-21T03:00:17.947630+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:13.181861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156163+0000","last_change":"2024-09-21T02:58:13.553866+0000","last_active":"2024-09-21T02:58:52.156163+0000","last_peered":"2024-09-21T02:58:52.156163+0000","last_clean":"2024-09-21T02:58:52.156163+0000","last_became_active":"2024-09-21T02:58:13.553001+0000","last_became_peered":"2024-09-21T02:58:13.553001+0000","last_unstale":"2024-09-21T02:58:52.156163+0000","last_undegraded":"2024-09-21T02:58:52.156163+0000","last_fullsized":"2024-09-21T02:58:52.156163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:43.995773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.435231+0000","last_change":"2024-09-21T02:58:22.090253+0000","last_active":"2024-09-21T02:58:49.435231+0000","last_peered":"2024-09-21T02:58:49.435231+0000","last_clean":"2024-09-21T02:58:49.435231+0000","last_became_active":"2024-09-21T02:58:22.089818+0000","last_became_peered":"2024-09-21T02:58:22.089818+0000","last_unstale":"2024-09-21T02:58:49.435231+0000","last_undegraded":"2024-09-21T02:58:49.435231+0000","last_fullsized":"2024-09-21T02:58:49.435231+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:09.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.940533+0000","last_change":"2024-09-21T02:58:15.042479+0000","last_active":"2024-09-21T03:00:17.940533+0000","last_peered":"2024-09-21T03:00:17.940533+0000","last_clean":"2024-09-21T03:00:17.940533+0000","last_became_active":"2024-09-21T02:58:15.042087+0000","last_became_peered":"2024-09-21T02:58:15.042087+0000","last_unstale":"2024-09-21T03:00:17.940533+0000","last_undegraded":"2024-09-21T03:00:17.940533+0000","last_fullsized":"2024-09-21T03:00:17.940533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:12.427736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:31.372600+0000","last_change":"2024-09-21T02:58:13.012559+0000","last_active":"2024-09-21T03:00:31.372600+0000","last_peered":"2024-09-21T03:00:31.372600+0000","last_clean":"2024-09-21T03:00:31.372600+0000","last_became_active":"2024-09-21T02:58:13.011062+0000","last_became_peered":"2024-09-21T02:58:13.011062+0000","last_unstale":"2024-09-21T03:00:31.372600+0000","last_undegraded":"2024-09-21T03:00:31.372600+0000","last_fullsized":"2024-09-21T03:00:31.372600+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:17.839898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224241+0000","last_change":"2024-09-21T02:58:22.081196+0000","last_active":"2024-09-21T02:58:49.224241+0000","last_peered":"2024-09-21T02:58:49.224241+0000","last_clean":"2024-09-21T02:58:49.224241+0000","last_became_active":"2024-09-21T02:58:22.080787+0000","last_became_peered":"2024-09-21T02:58:22.080787+0000","last_unstale":"2024-09-21T02:58:49.224241+0000","last_undegraded":"2024-09-21T02:58:49.224241+0000","last_fullsized":"2024-09-21T02:58:49.224241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:03.283112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951437+0000","last_change":"2024-09-21T02:58:15.046322+0000","last_active":"2024-09-21T03:00:17.951437+0000","last_peered":"2024-09-21T03:00:17.951437+0000","last_clean":"2024-09-21T03:00:17.951437+0000","last_became_active":"2024-09-21T02:58:15.045936+0000","last_became_peered":"2024-09-21T02:58:15.045936+0000","last_unstale":"2024-09-21T03:00:17.951437+0000","last_undegraded":"2024-09-21T03:00:17.951437+0000","last_fullsized":"2024-09-21T03:00:17.951437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:01:08.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145891+0000","last_change":"2024-09-21T02:58:13.022277+0000","last_active":"2024-09-21T02:58:50.145891+0000","last_peered":"2024-09-21T02:58:50.145891+0000","last_clean":"2024-09-21T02:58:50.145891+0000","last_became_active":"2024-09-21T02:58:13.021901+0000","last_became_peered":"2024-09-21T02:58:13.021901+0000","last_unstale":"2024-09-21T02:58:50.145891+0000","last_undegraded":"2024-09-21T02:58:50.145891+0000","last_fullsized":"2024-09-21T02:58:50.145891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:01.029435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.226991+0000","last_change":"2024-09-21T02:58:22.088951+0000","last_active":"2024-09-21T02:58:49.226991+0000","last_peered":"2024-09-21T02:58:49.226991+0000","last_clean":"2024-09-21T02:58:49.226991+0000","last_became_active":"2024-09-21T02:58:22.088427+0000","last_became_peered":"2024-09-21T02:58:22.088427+0000","last_unstale":"2024-09-21T02:58:49.226991+0000","last_undegraded":"2024-09-21T02:58:49.226991+0000","last_fullsized":"2024-09-21T02:58:49.226991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:52.700517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.934441+0000","last_change":"2024-09-21T02:58:15.038390+0000","last_active":"2024-09-21T03:00:17.934441+0000","last_peered":"2024-09-21T03:00:17.934441+0000","last_clean":"2024-09-21T03:00:17.934441+0000","last_became_active":"2024-09-21T02:58:15.037368+0000","last_became_peered":"2024-09-21T02:58:15.037368+0000","last_unstale":"2024-09-21T03:00:17.934441+0000","last_undegraded":"2024-09-21T03:00:17.934441+0000","last_fullsized":"2024-09-21T03:00:17.934441+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:54.736444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:52.156157+0000","last_change":"2024-09-21T02:58:13.013246+0000","last_active":"2024-09-21T02:58:52.156157+0000","last_peered":"2024-09-21T02:58:52.156157+0000","last_clean":"2024-09-21T02:58:52.156157+0000","last_became_active":"2024-09-21T02:58:13.012830+0000","last_became_peered":"2024-09-21T02:58:13.012830+0000","last_unstale":"2024-09-21T02:58:52.156157+0000","last_undegraded":"2024-09-21T02:58:52.156157+0000","last_fullsized":"2024-09-21T02:58:52.156157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:31.406565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748517+0000","last_change":"2024-09-21T02:58:22.086799+0000","last_active":"2024-09-21T02:58:49.748517+0000","last_peered":"2024-09-21T02:58:49.748517+0000","last_clean":"2024-09-21T02:58:49.748517+0000","last_became_active":"2024-09-21T02:58:22.086395+0000","last_became_peered":"2024-09-21T02:58:22.086395+0000","last_unstale":"2024-09-21T02:58:49.748517+0000","last_undegraded":"2024-09-21T02:58:49.748517+0000","last_fullsized":"2024-09-21T02:58:49.748517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:38.985072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.935637+0000","last_change":"2024-09-21T02:58:15.037346+0000","last_active":"2024-09-21T03:00:17.935637+0000","last_peered":"2024-09-21T03:00:17.935637+0000","last_clean":"2024-09-21T03:00:17.935637+0000","last_became_active":"2024-09-21T02:58:15.036984+0000","last_became_peered":"2024-09-21T02:58:15.036984+0000","last_unstale":"2024-09-21T03:00:17.935637+0000","last_undegraded":"2024-09-21T03:00:17.935637+0000","last_fullsized":"2024-09-21T03:00:17.935637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:43.856844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'38","reported_seq":294,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:35.335004+0000","last_change":"2024-09-21T02:58:13.018287+0000","last_active":"2024-09-21T03:00:35.335004+0000","last_peered":"2024-09-21T03:00:35.335004+0000","last_clean":"2024-09-21T03:00:35.335004+0000","last_became_active":"2024-09-21T02:58:13.017908+0000","last_became_peered":"2024-09-21T02:58:13.017908+0000","last_unstale":"2024-09-21T03:00:35.335004+0000","last_undegraded":"2024-09-21T03:00:35.335004+0000","last_fullsized":"2024-09-21T03:00:35.335004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:30.422946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":181,"num_write":39,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.223420+0000","last_change":"2024-09-21T02:58:22.078106+0000","last_active":"2024-09-21T02:58:49.223420+0000","last_peered":"2024-09-21T02:58:49.223420+0000","last_clean":"2024-09-21T02:58:49.223420+0000","last_became_active":"2024-09-21T02:58:22.077675+0000","last_became_peered":"2024-09-21T02:58:22.077675+0000","last_unstale":"2024-09-21T02:58:49.223420+0000","last_undegraded":"2024-09-21T02:58:49.223420+0000","last_fullsized":"2024-09-21T02:58:49.223420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:24:08.965865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955019+0000","last_change":"2024-09-21T02:58:15.045911+0000","last_active":"2024-09-21T03:00:17.955019+0000","last_peered":"2024-09-21T03:00:17.955019+0000","last_clean":"2024-09-21T03:00:17.955019+0000","last_became_active":"2024-09-21T02:58:15.045506+0000","last_became_peered":"2024-09-21T02:58:15.045506+0000","last_unstale":"2024-09-21T03:00:17.955019+0000","last_undegraded":"2024-09-21T03:00:17.955019+0000","last_fullsized":"2024-09-21T03:00:17.955019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.982730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.144087+0000","last_change":"2024-09-21T02:58:13.555132+0000","last_active":"2024-09-21T02:58:50.144087+0000","last_peered":"2024-09-21T02:58:50.144087+0000","last_clean":"2024-09-21T02:58:50.144087+0000","last_became_active":"2024-09-21T02:58:13.554582+0000","last_became_peered":"2024-09-21T02:58:13.554582+0000","last_unstale":"2024-09-21T02:58:50.144087+0000","last_undegraded":"2024-09-21T02:58:50.144087+0000","last_fullsized":"2024-09-21T02:58:50.144087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:56.621099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.234599+0000","last_change":"2024-09-21T02:58:49.234443+0000","last_active":"2024-09-21T02:58:49.234599+0000","last_peered":"2024-09-21T02:58:49.234599+0000","last_clean":"2024-09-21T02:58:49.234599+0000","last_became_active":"2024-09-21T02:58:49.233758+0000","last_became_peered":"2024-09-21T02:58:49.233758+0000","last_unstale":"2024-09-21T02:58:49.234599+0000","last_undegraded":"2024-09-21T02:58:49.234599+0000","last_fullsized":"2024-09-21T02:58:49.234599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:06.821726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944745+0000","last_change":"2024-09-21T02:58:15.033598+0000","last_active":"2024-09-21T03:00:17.944745+0000","last_peered":"2024-09-21T03:00:17.944745+0000","last_clean":"2024-09-21T03:00:17.944745+0000","last_became_active":"2024-09-21T02:58:15.033268+0000","last_became_peered":"2024-09-21T02:58:15.033268+0000","last_unstale":"2024-09-21T03:00:17.944745+0000","last_undegraded":"2024-09-21T03:00:17.944745+0000","last_fullsized":"2024-09-21T03:00:17.944745+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:25.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:50.145942+0000","last_change":"2024-09-21T02:58:13.018159+0000","last_active":"2024-09-21T02:58:50.145942+0000","last_peered":"2024-09-21T02:58:50.145942+0000","last_clean":"2024-09-21T02:58:50.145942+0000","last_became_active":"2024-09-21T02:58:13.017263+0000","last_became_peered":"2024-09-21T02:58:13.017263+0000","last_unstale":"2024-09-21T02:58:50.145942+0000","last_undegraded":"2024-09-21T02:58:50.145942+0000","last_fullsized":"2024-09-21T02:58:50.145942+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:47.981435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.982319+0000","last_change":"2024-09-21T02:58:49.981593+0000","last_active":"2024-09-21T02:58:49.982319+0000","last_peered":"2024-09-21T02:58:49.982319+0000","last_clean":"2024-09-21T02:58:49.982319+0000","last_became_active":"2024-09-21T02:58:49.980890+0000","last_became_peered":"2024-09-21T02:58:49.980890+0000","last_unstale":"2024-09-21T02:58:49.982319+0000","last_undegraded":"2024-09-21T02:58:49.982319+0000","last_fullsized":"2024-09-21T02:58:49.982319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:59.251327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,2,4],"acting":[10,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.955362+0000","last_change":"2024-09-21T02:58:15.049561+0000","last_active":"2024-09-21T03:00:17.955362+0000","last_peered":"2024-09-21T03:00:17.955362+0000","last_clean":"2024-09-21T03:00:17.955362+0000","last_became_active":"2024-09-21T02:58:15.049205+0000","last_became_peered":"2024-09-21T02:58:15.049205+0000","last_unstale":"2024-09-21T03:00:17.955362+0000","last_undegraded":"2024-09-21T03:00:17.955362+0000","last_fullsized":"2024-09-21T03:00:17.955362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:56.617698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":143,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:34.321727+0000","last_change":"2024-09-21T02:58:13.018964+0000","last_active":"2024-09-21T03:00:34.321727+0000","last_peered":"2024-09-21T03:00:34.321727+0000","last_clean":"2024-09-21T03:00:34.321727+0000","last_became_active":"2024-09-21T02:58:13.017420+0000","last_became_peered":"2024-09-21T02:58:13.017420+0000","last_unstale":"2024-09-21T03:00:34.321727+0000","last_undegraded":"2024-09-21T03:00:34.321727+0000","last_fullsized":"2024-09-21T03:00:34.321727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:56.933671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.233600+0000","last_change":"2024-09-21T02:58:49.233486+0000","last_active":"2024-09-21T02:58:49.233600+0000","last_peered":"2024-09-21T02:58:49.233600+0000","last_clean":"2024-09-21T02:58:49.233600+0000","last_became_active":"2024-09-21T02:58:49.232940+0000","last_became_peered":"2024-09-21T02:58:49.232940+0000","last_unstale":"2024-09-21T02:58:49.233600+0000","last_undegraded":"2024-09-21T02:58:49.233600+0000","last_fullsized":"2024-09-21T02:58:49.233600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:19.283141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.979795+0000","last_change":"2024-09-21T02:58:22.085163+0000","last_active":"2024-09-21T02:58:49.979795+0000","last_peered":"2024-09-21T02:58:49.979795+0000","last_clean":"2024-09-21T02:58:49.979795+0000","last_became_active":"2024-09-21T02:58:22.084768+0000","last_became_peered":"2024-09-21T02:58:22.084768+0000","last_unstale":"2024-09-21T02:58:49.979795+0000","last_undegraded":"2024-09-21T02:58:49.979795+0000","last_fullsized":"2024-09-21T02:58:49.979795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:46.892421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947197+0000","last_change":"2024-09-21T02:58:15.035051+0000","last_active":"2024-09-21T03:00:17.947197+0000","last_peered":"2024-09-21T03:00:17.947197+0000","last_clean":"2024-09-21T03:00:17.947197+0000","last_became_active":"2024-09-21T02:58:15.034692+0000","last_became_peered":"2024-09-21T02:58:15.034692+0000","last_unstale":"2024-09-21T03:00:17.947197+0000","last_undegraded":"2024-09-21T03:00:17.947197+0000","last_fullsized":"2024-09-21T03:00:17.947197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:16:14.605154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.748786+0000","last_change":"2024-09-21T02:58:13.018102+0000","last_active":"2024-09-21T02:58:49.748786+0000","last_peered":"2024-09-21T02:58:49.748786+0000","last_clean":"2024-09-21T02:58:49.748786+0000","last_became_active":"2024-09-21T02:58:13.017537+0000","last_became_peered":"2024-09-21T02:58:13.017537+0000","last_unstale":"2024-09-21T02:58:49.748786+0000","last_undegraded":"2024-09-21T02:58:49.748786+0000","last_fullsized":"2024-09-21T02:58:49.748786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:40.096326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.227485+0000","last_change":"2024-09-21T02:58:22.084362+0000","last_active":"2024-09-21T02:58:49.227485+0000","last_peered":"2024-09-21T02:58:49.227485+0000","last_clean":"2024-09-21T02:58:49.227485+0000","last_became_active":"2024-09-21T02:58:22.083895+0000","last_became_peered":"2024-09-21T02:58:22.083895+0000","last_unstale":"2024-09-21T02:58:49.227485+0000","last_undegraded":"2024-09-21T02:58:49.227485+0000","last_fullsized":"2024-09-21T02:58:49.227485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:54.101588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.932312+0000","last_change":"2024-09-21T02:58:15.034768+0000","last_active":"2024-09-21T03:00:17.932312+0000","last_peered":"2024-09-21T03:00:17.932312+0000","last_clean":"2024-09-21T03:00:17.932312+0000","last_became_active":"2024-09-21T02:58:15.034420+0000","last_became_peered":"2024-09-21T02:58:15.034420+0000","last_unstale":"2024-09-21T03:00:17.932312+0000","last_undegraded":"2024-09-21T03:00:17.932312+0000","last_fullsized":"2024-09-21T03:00:17.932312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:25.750158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.152269+0000","last_change":"2024-09-21T02:58:13.015026+0000","last_active":"2024-09-21T02:58:51.152269+0000","last_peered":"2024-09-21T02:58:51.152269+0000","last_clean":"2024-09-21T02:58:51.152269+0000","last_became_active":"2024-09-21T02:58:13.014668+0000","last_became_peered":"2024-09-21T02:58:13.014668+0000","last_unstale":"2024-09-21T02:58:51.152269+0000","last_undegraded":"2024-09-21T02:58:51.152269+0000","last_fullsized":"2024-09-21T02:58:51.152269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:20.117518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:51.153234+0000","last_change":"2024-09-21T02:58:13.018044+0000","last_active":"2024-09-21T02:58:51.153234+0000","last_peered":"2024-09-21T02:58:51.153234+0000","last_clean":"2024-09-21T02:58:51.153234+0000","last_became_active":"2024-09-21T02:58:13.017628+0000","last_became_peered":"2024-09-21T02:58:13.017628+0000","last_unstale":"2024-09-21T02:58:51.153234+0000","last_undegraded":"2024-09-21T02:58:51.153234+0000","last_fullsized":"2024-09-21T02:58:51.153234+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:24:38.749379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942552+0000","last_change":"2024-09-21T02:58:15.048160+0000","last_active":"2024-09-21T03:00:17.942552+0000","last_peered":"2024-09-21T03:00:17.942552+0000","last_clean":"2024-09-21T03:00:17.942552+0000","last_became_active":"2024-09-21T02:58:15.046371+0000","last_became_peered":"2024-09-21T02:58:15.046371+0000","last_unstale":"2024-09-21T03:00:17.942552+0000","last_undegraded":"2024-09-21T03:00:17.942552+0000","last_fullsized":"2024-09-21T03:00:17.942552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:49.386799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224497+0000","last_change":"2024-09-21T02:58:22.089918+0000","last_active":"2024-09-21T02:58:49.224497+0000","last_peered":"2024-09-21T02:58:49.224497+0000","last_clean":"2024-09-21T02:58:49.224497+0000","last_became_active":"2024-09-21T02:58:22.089457+0000","last_became_peered":"2024-09-21T02:58:22.089457+0000","last_unstale":"2024-09-21T02:58:49.224497+0000","last_undegraded":"2024-09-21T02:58:49.224497+0000","last_fullsized":"2024-09-21T02:58:49.224497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:28.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:31.316323+0000","last_change":"2024-09-21T02:58:13.021192+0000","last_active":"2024-09-21T03:00:31.316323+0000","last_peered":"2024-09-21T03:00:31.316323+0000","last_clean":"2024-09-21T03:00:31.316323+0000","last_became_active":"2024-09-21T02:58:13.020746+0000","last_became_peered":"2024-09-21T02:58:13.020746+0000","last_unstale":"2024-09-21T03:00:31.316323+0000","last_undegraded":"2024-09-21T03:00:31.316323+0000","last_fullsized":"2024-09-21T03:00:31.316323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:11.996713+0000","last_clean_scrub_stamp":"2024-09-21T02:58:11.996713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:13.260225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.946573+0000","last_change":"2024-09-21T02:58:15.038375+0000","last_active":"2024-09-21T03:00:17.946573+0000","last_peered":"2024-09-21T03:00:17.946573+0000","last_clean":"2024-09-21T03:00:17.946573+0000","last_became_active":"2024-09-21T02:58:15.038011+0000","last_became_peered":"2024-09-21T02:58:15.038011+0000","last_unstale":"2024-09-21T03:00:17.946573+0000","last_undegraded":"2024-09-21T03:00:17.946573+0000","last_fullsized":"2024-09-21T03:00:17.946573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:50.820554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T02:58:49.224842+0000","last_change":"2024-09-21T02:58:22.088436+0000","last_active":"2024-09-21T02:58:49.224842+0000","last_peered":"2024-09-21T02:58:49.224842+0000","last_clean":"2024-09-21T02:58:49.224842+0000","last_became_active":"2024-09-21T02:58:22.087857+0000","last_became_peered":"2024-09-21T02:58:22.087857+0000","last_unstale":"2024-09-21T02:58:49.224842+0000","last_undegraded":"2024-09-21T02:58:49.224842+0000","last_fullsized":"2024-09-21T02:58:49.224842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:21.060203+0000","last_clean_scrub_stamp":"2024-09-21T02:58:21.060203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:40.314833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.942098+0000","last_change":"2024-09-21T02:58:15.041490+0000","last_active":"2024-09-21T03:00:17.942098+0000","last_peered":"2024-09-21T03:00:17.942098+0000","last_clean":"2024-09-21T03:00:17.942098+0000","last_became_active":"2024-09-21T02:58:15.041106+0000","last_became_peered":"2024-09-21T02:58:15.041106+0000","last_unstale":"2024-09-21T03:00:17.942098+0000","last_undegraded":"2024-09-21T03:00:17.942098+0000","last_fullsized":"2024-09-21T03:00:17.942098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:57.228254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.951748+0000","last_change":"2024-09-21T02:58:15.041375+0000","last_active":"2024-09-21T03:00:17.951748+0000","last_peered":"2024-09-21T03:00:17.951748+0000","last_clean":"2024-09-21T03:00:17.951748+0000","last_became_active":"2024-09-21T02:58:15.041041+0000","last_became_peered":"2024-09-21T02:58:15.041041+0000","last_unstale":"2024-09-21T03:00:17.951748+0000","last_undegraded":"2024-09-21T03:00:17.951748+0000","last_fullsized":"2024-09-21T03:00:17.951748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:49.376203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938040+0000","last_change":"2024-09-21T02:58:15.036772+0000","last_active":"2024-09-21T03:00:17.938040+0000","last_peered":"2024-09-21T03:00:17.938040+0000","last_clean":"2024-09-21T03:00:17.938040+0000","last_became_active":"2024-09-21T02:58:15.036390+0000","last_became_peered":"2024-09-21T02:58:15.036390+0000","last_unstale":"2024-09-21T03:00:17.938040+0000","last_undegraded":"2024-09-21T03:00:17.938040+0000","last_fullsized":"2024-09-21T03:00:17.938040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:49.169184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.950999+0000","last_change":"2024-09-21T02:58:15.035375+0000","last_active":"2024-09-21T03:00:17.950999+0000","last_peered":"2024-09-21T03:00:17.950999+0000","last_clean":"2024-09-21T03:00:17.950999+0000","last_became_active":"2024-09-21T02:58:15.035015+0000","last_became_peered":"2024-09-21T02:58:15.035015+0000","last_unstale":"2024-09-21T03:00:17.950999+0000","last_undegraded":"2024-09-21T03:00:17.950999+0000","last_fullsized":"2024-09-21T03:00:17.950999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:32.980690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.938021+0000","last_change":"2024-09-21T02:58:15.046431+0000","last_active":"2024-09-21T03:00:17.938021+0000","last_peered":"2024-09-21T03:00:17.938021+0000","last_clean":"2024-09-21T03:00:17.938021+0000","last_became_active":"2024-09-21T02:58:15.046048+0000","last_became_peered":"2024-09-21T02:58:15.046048+0000","last_unstale":"2024-09-21T03:00:17.938021+0000","last_undegraded":"2024-09-21T03:00:17.938021+0000","last_fullsized":"2024-09-21T03:00:17.938021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:42.079020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.943370+0000","last_change":"2024-09-21T02:58:15.043192+0000","last_active":"2024-09-21T03:00:17.943370+0000","last_peered":"2024-09-21T03:00:17.943370+0000","last_clean":"2024-09-21T03:00:17.943370+0000","last_became_active":"2024-09-21T02:58:15.042413+0000","last_became_peered":"2024-09-21T02:58:15.042413+0000","last_unstale":"2024-09-21T03:00:17.943370+0000","last_undegraded":"2024-09-21T03:00:17.943370+0000","last_fullsized":"2024-09-21T03:00:17.943370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:31.491311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945252+0000","last_change":"2024-09-21T02:58:15.040194+0000","last_active":"2024-09-21T03:00:17.945252+0000","last_peered":"2024-09-21T03:00:17.945252+0000","last_clean":"2024-09-21T03:00:17.945252+0000","last_became_active":"2024-09-21T02:58:15.039803+0000","last_became_peered":"2024-09-21T02:58:15.039803+0000","last_unstale":"2024-09-21T03:00:17.945252+0000","last_undegraded":"2024-09-21T03:00:17.945252+0000","last_fullsized":"2024-09-21T03:00:17.945252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:21.357004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939815+0000","last_change":"2024-09-21T02:58:15.043038+0000","last_active":"2024-09-21T03:00:17.939815+0000","last_peered":"2024-09-21T03:00:17.939815+0000","last_clean":"2024-09-21T03:00:17.939815+0000","last_became_active":"2024-09-21T02:58:15.042643+0000","last_became_peered":"2024-09-21T02:58:15.042643+0000","last_unstale":"2024-09-21T03:00:17.939815+0000","last_undegraded":"2024-09-21T03:00:17.939815+0000","last_fullsized":"2024-09-21T03:00:17.939815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:14.639995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944730+0000","last_change":"2024-09-21T02:58:15.037015+0000","last_active":"2024-09-21T03:00:17.944730+0000","last_peered":"2024-09-21T03:00:17.944730+0000","last_clean":"2024-09-21T03:00:17.944730+0000","last_became_active":"2024-09-21T02:58:15.036628+0000","last_became_peered":"2024-09-21T02:58:15.036628+0000","last_unstale":"2024-09-21T03:00:17.944730+0000","last_undegraded":"2024-09-21T03:00:17.944730+0000","last_fullsized":"2024-09-21T03:00:17.944730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:07.823178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.940728+0000","last_change":"2024-09-21T02:58:15.041768+0000","last_active":"2024-09-21T03:00:17.940728+0000","last_peered":"2024-09-21T03:00:17.940728+0000","last_clean":"2024-09-21T03:00:17.940728+0000","last_became_active":"2024-09-21T02:58:15.041374+0000","last_became_peered":"2024-09-21T02:58:15.041374+0000","last_unstale":"2024-09-21T03:00:17.940728+0000","last_undegraded":"2024-09-21T03:00:17.940728+0000","last_fullsized":"2024-09-21T03:00:17.940728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:25.145949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.952784+0000","last_change":"2024-09-21T02:58:15.047263+0000","last_active":"2024-09-21T03:00:17.952784+0000","last_peered":"2024-09-21T03:00:17.952784+0000","last_clean":"2024-09-21T03:00:17.952784+0000","last_became_active":"2024-09-21T02:58:15.046490+0000","last_became_peered":"2024-09-21T02:58:15.046490+0000","last_unstale":"2024-09-21T03:00:17.952784+0000","last_undegraded":"2024-09-21T03:00:17.952784+0000","last_fullsized":"2024-09-21T03:00:17.952784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:45.413510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939463+0000","last_change":"2024-09-21T02:58:15.034115+0000","last_active":"2024-09-21T03:00:17.939463+0000","last_peered":"2024-09-21T03:00:17.939463+0000","last_clean":"2024-09-21T03:00:17.939463+0000","last_became_active":"2024-09-21T02:58:15.033709+0000","last_became_peered":"2024-09-21T02:58:15.033709+0000","last_unstale":"2024-09-21T03:00:17.939463+0000","last_undegraded":"2024-09-21T03:00:17.939463+0000","last_fullsized":"2024-09-21T03:00:17.939463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:54.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.943614+0000","last_change":"2024-09-21T02:58:15.047154+0000","last_active":"2024-09-21T03:00:17.943614+0000","last_peered":"2024-09-21T03:00:17.943614+0000","last_clean":"2024-09-21T03:00:17.943614+0000","last_became_active":"2024-09-21T02:58:15.046777+0000","last_became_peered":"2024-09-21T02:58:15.046777+0000","last_unstale":"2024-09-21T03:00:17.943614+0000","last_undegraded":"2024-09-21T03:00:17.943614+0000","last_fullsized":"2024-09-21T03:00:17.943614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:28:56.703109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.939462+0000","last_change":"2024-09-21T02:58:15.036867+0000","last_active":"2024-09-21T03:00:17.939462+0000","last_peered":"2024-09-21T03:00:17.939462+0000","last_clean":"2024-09-21T03:00:17.939462+0000","last_became_active":"2024-09-21T02:58:15.036228+0000","last_became_peered":"2024-09-21T02:58:15.036228+0000","last_unstale":"2024-09-21T03:00:17.939462+0000","last_undegraded":"2024-09-21T03:00:17.939462+0000","last_fullsized":"2024-09-21T03:00:17.939462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:11.245917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.947421+0000","last_change":"2024-09-21T02:58:15.037311+0000","last_active":"2024-09-21T03:00:17.947421+0000","last_peered":"2024-09-21T03:00:17.947421+0000","last_clean":"2024-09-21T03:00:17.947421+0000","last_became_active":"2024-09-21T02:58:15.036909+0000","last_became_peered":"2024-09-21T02:58:15.036909+0000","last_unstale":"2024-09-21T03:00:17.947421+0000","last_undegraded":"2024-09-21T03:00:17.947421+0000","last_fullsized":"2024-09-21T03:00:17.947421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:35.250000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954821+0000","last_change":"2024-09-21T02:58:15.042678+0000","last_active":"2024-09-21T03:00:17.954821+0000","last_peered":"2024-09-21T03:00:17.954821+0000","last_clean":"2024-09-21T03:00:17.954821+0000","last_became_active":"2024-09-21T02:58:15.042334+0000","last_became_peered":"2024-09-21T02:58:15.042334+0000","last_unstale":"2024-09-21T03:00:17.954821+0000","last_undegraded":"2024-09-21T03:00:17.954821+0000","last_fullsized":"2024-09-21T03:00:17.954821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:09.302354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953098+0000","last_change":"2024-09-21T02:58:15.040741+0000","last_active":"2024-09-21T03:00:17.953098+0000","last_peered":"2024-09-21T03:00:17.953098+0000","last_clean":"2024-09-21T03:00:17.953098+0000","last_became_active":"2024-09-21T02:58:15.040357+0000","last_became_peered":"2024-09-21T02:58:15.040357+0000","last_unstale":"2024-09-21T03:00:17.953098+0000","last_undegraded":"2024-09-21T03:00:17.953098+0000","last_fullsized":"2024-09-21T03:00:17.953098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.950877+0000","last_change":"2024-09-21T02:58:15.029780+0000","last_active":"2024-09-21T03:00:17.950877+0000","last_peered":"2024-09-21T03:00:17.950877+0000","last_clean":"2024-09-21T03:00:17.950877+0000","last_became_active":"2024-09-21T02:58:15.029259+0000","last_became_peered":"2024-09-21T02:58:15.029259+0000","last_unstale":"2024-09-21T03:00:17.950877+0000","last_undegraded":"2024-09-21T03:00:17.950877+0000","last_fullsized":"2024-09-21T03:00:17.950877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:35.683337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945010+0000","last_change":"2024-09-21T02:58:15.040557+0000","last_active":"2024-09-21T03:00:17.945010+0000","last_peered":"2024-09-21T03:00:17.945010+0000","last_clean":"2024-09-21T03:00:17.945010+0000","last_became_active":"2024-09-21T02:58:15.040178+0000","last_became_peered":"2024-09-21T02:58:15.040178+0000","last_unstale":"2024-09-21T03:00:17.945010+0000","last_undegraded":"2024-09-21T03:00:17.945010+0000","last_fullsized":"2024-09-21T03:00:17.945010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:50.712628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.925448+0000","last_change":"2024-09-21T02:58:15.041717+0000","last_active":"2024-09-21T03:00:17.925448+0000","last_peered":"2024-09-21T03:00:17.925448+0000","last_clean":"2024-09-21T03:00:17.925448+0000","last_became_active":"2024-09-21T02:58:15.041375+0000","last_became_peered":"2024-09-21T02:58:15.041375+0000","last_unstale":"2024-09-21T03:00:17.925448+0000","last_undegraded":"2024-09-21T03:00:17.925448+0000","last_fullsized":"2024-09-21T03:00:17.925448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:22.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.924845+0000","last_change":"2024-09-21T02:58:15.042001+0000","last_active":"2024-09-21T03:00:17.924845+0000","last_peered":"2024-09-21T03:00:17.924845+0000","last_clean":"2024-09-21T03:00:17.924845+0000","last_became_active":"2024-09-21T02:58:15.038585+0000","last_became_peered":"2024-09-21T02:58:15.038585+0000","last_unstale":"2024-09-21T03:00:17.924845+0000","last_undegraded":"2024-09-21T03:00:17.924845+0000","last_fullsized":"2024-09-21T03:00:17.924845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954646+0000","last_change":"2024-09-21T02:58:15.046636+0000","last_active":"2024-09-21T03:00:17.954646+0000","last_peered":"2024-09-21T03:00:17.954646+0000","last_clean":"2024-09-21T03:00:17.954646+0000","last_became_active":"2024-09-21T02:58:15.046103+0000","last_became_peered":"2024-09-21T02:58:15.046103+0000","last_unstale":"2024-09-21T03:00:17.954646+0000","last_undegraded":"2024-09-21T03:00:17.954646+0000","last_fullsized":"2024-09-21T03:00:17.954646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.579641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.946646+0000","last_change":"2024-09-21T02:58:15.045461+0000","last_active":"2024-09-21T03:00:17.946646+0000","last_peered":"2024-09-21T03:00:17.946646+0000","last_clean":"2024-09-21T03:00:17.946646+0000","last_became_active":"2024-09-21T02:58:15.045091+0000","last_became_peered":"2024-09-21T02:58:15.045091+0000","last_unstale":"2024-09-21T03:00:17.946646+0000","last_undegraded":"2024-09-21T03:00:17.946646+0000","last_fullsized":"2024-09-21T03:00:17.946646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:33.078860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954069+0000","last_change":"2024-09-21T02:58:15.042454+0000","last_active":"2024-09-21T03:00:17.954069+0000","last_peered":"2024-09-21T03:00:17.954069+0000","last_clean":"2024-09-21T03:00:17.954069+0000","last_became_active":"2024-09-21T02:58:15.042071+0000","last_became_peered":"2024-09-21T02:58:15.042071+0000","last_unstale":"2024-09-21T03:00:17.954069+0000","last_undegraded":"2024-09-21T03:00:17.954069+0000","last_fullsized":"2024-09-21T03:00:17.954069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:09.798110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941111+0000","last_change":"2024-09-21T02:58:15.039238+0000","last_active":"2024-09-21T03:00:17.941111+0000","last_peered":"2024-09-21T03:00:17.941111+0000","last_clean":"2024-09-21T03:00:17.941111+0000","last_became_active":"2024-09-21T02:58:15.037883+0000","last_became_peered":"2024-09-21T02:58:15.037883+0000","last_unstale":"2024-09-21T03:00:17.941111+0000","last_undegraded":"2024-09-21T03:00:17.941111+0000","last_fullsized":"2024-09-21T03:00:17.941111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:13.418696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.941466+0000","last_change":"2024-09-21T02:58:15.040236+0000","last_active":"2024-09-21T03:00:17.941466+0000","last_peered":"2024-09-21T03:00:17.941466+0000","last_clean":"2024-09-21T03:00:17.941466+0000","last_became_active":"2024-09-21T02:58:15.039895+0000","last_became_peered":"2024-09-21T02:58:15.039895+0000","last_unstale":"2024-09-21T03:00:17.941466+0000","last_undegraded":"2024-09-21T03:00:17.941466+0000","last_fullsized":"2024-09-21T03:00:17.941466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:48.099127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.949016+0000","last_change":"2024-09-21T02:58:15.044804+0000","last_active":"2024-09-21T03:00:17.949016+0000","last_peered":"2024-09-21T03:00:17.949016+0000","last_clean":"2024-09-21T03:00:17.949016+0000","last_became_active":"2024-09-21T02:58:15.044446+0000","last_became_peered":"2024-09-21T02:58:15.044446+0000","last_unstale":"2024-09-21T03:00:17.949016+0000","last_undegraded":"2024-09-21T03:00:17.949016+0000","last_fullsized":"2024-09-21T03:00:17.949016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:37.298938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.917965+0000","last_change":"2024-09-21T02:58:15.034219+0000","last_active":"2024-09-21T03:00:17.917965+0000","last_peered":"2024-09-21T03:00:17.917965+0000","last_clean":"2024-09-21T03:00:17.917965+0000","last_became_active":"2024-09-21T02:58:15.033775+0000","last_became_peered":"2024-09-21T02:58:15.033775+0000","last_unstale":"2024-09-21T03:00:17.917965+0000","last_undegraded":"2024-09-21T03:00:17.917965+0000","last_fullsized":"2024-09-21T03:00:17.917965+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:12.534737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.945403+0000","last_change":"2024-09-21T02:58:49.231259+0000","last_active":"2024-09-21T03:00:17.945403+0000","last_peered":"2024-09-21T03:00:17.945403+0000","last_clean":"2024-09-21T03:00:17.945403+0000","last_became_active":"2024-09-21T02:58:49.230867+0000","last_became_peered":"2024-09-21T02:58:49.230867+0000","last_unstale":"2024-09-21T03:00:17.945403+0000","last_undegraded":"2024-09-21T03:00:17.945403+0000","last_fullsized":"2024-09-21T03:00:17.945403+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:11.163458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.954842+0000","last_change":"2024-09-21T02:58:15.037273+0000","last_active":"2024-09-21T03:00:17.954842+0000","last_peered":"2024-09-21T03:00:17.954842+0000","last_clean":"2024-09-21T03:00:17.954842+0000","last_became_active":"2024-09-21T02:58:15.036879+0000","last_became_peered":"2024-09-21T02:58:15.036879+0000","last_unstale":"2024-09-21T03:00:17.954842+0000","last_undegraded":"2024-09-21T03:00:17.954842+0000","last_fullsized":"2024-09-21T03:00:17.954842+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:50.721998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.944928+0000","last_change":"2024-09-21T02:58:15.035716+0000","last_active":"2024-09-21T03:00:17.944928+0000","last_peered":"2024-09-21T03:00:17.944928+0000","last_clean":"2024-09-21T03:00:17.944928+0000","last_became_active":"2024-09-21T02:58:15.035356+0000","last_became_peered":"2024-09-21T02:58:15.035356+0000","last_unstale":"2024-09-21T03:00:17.944928+0000","last_undegraded":"2024-09-21T03:00:17.944928+0000","last_fullsized":"2024-09-21T03:00:17.944928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.704178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"82'8","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T03:00:17.953875+0000","last_change":"2024-09-21T02:58:15.041737+0000","last_active":"2024-09-21T03:00:17.953875+0000","last_peered":"2024-09-21T03:00:17.953875+0000","last_clean":"2024-09-21T03:00:17.953875+0000","last_became_active":"2024-09-21T02:58:15.041387+0000","last_became_peered":"2024-09-21T02:58:15.041387+0000","last_unstale":"2024-09-21T03:00:17.953875+0000","last_undegraded":"2024-09-21T03:00:17.953875+0000","last_fullsized":"2024-09-21T03:00:17.953875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:58:14.009345+0000","last_clean_scrub_stamp":"2024-09-21T02:58:14.009345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.893510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76431,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":648,"num_read_kb":409,"num_write":185,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":220595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281500,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":462290,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972399,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1117537,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135924,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":466622,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332153,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":462446,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495678,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1059482,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659203,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":457702,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855431,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":1054045,"data_compressed":59334,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018957,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":463377,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":457896,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444119,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":526409,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":524566,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":459090,"data_compressed":23539,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34175,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35795,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":73906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:00:38.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:00:38.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:38 smithi164 ceph-mon[34236]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:38.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:38 smithi181 ceph-mon[34096]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:00:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:39.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 -- 172.21.15.81:0/2500426421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a30106c40 msgr2=0x7f8a301106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:39.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 --2- 172.21.15.81:0/2500426421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a30106c40 0x7f8a301106b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009ca0 tx=0x7f8a2802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 -- 172.21.15.81:0/2500426421 shutdown_connections 2024-09-21T03:00:39.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 --2- 172.21.15.81:0/2500426421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a30106c40 0x7f8a301106b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 --2- 172.21.15.81:0/2500426421 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a301062f0 0x7f8a30106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 --2- 172.21.15.81:0/2500426421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a301020a0 0x7f8a301024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 -- 172.21.15.81:0/2500426421 >> 172.21.15.81:0/2500426421 conn(0x7f8a30079f90 msgr2=0x7f8a3007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 -- 172.21.15.81:0/2500426421 shutdown_connections 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.260+0000 7f8a35f65640 1 -- 172.21.15.81:0/2500426421 wait complete. 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 Processor -- start 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 -- start start 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a301020a0 0x7f8a3019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a301062f0 0x7f8a3019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a30106c40 0x7f8a3019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a301139c0 con 0x7f8a301062f0 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30113840 con 0x7f8a301020a0 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a35f65640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30113b40 con 0x7f8a30106c40 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a2effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a301062f0 0x7f8a3019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a2effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a301062f0 0x7f8a3019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60772/0 (socket says 172.21.15.81:60772) 2024-09-21T03:00:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a2effd640 1 -- 172.21.15.81:0/4050592869 learned_addr learned my addr 172.21.15.81:0/4050592869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a2ffff640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a30106c40 0x7f8a3019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.261+0000 7f8a2f7fe640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a301020a0 0x7f8a3019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2effd640 1 -- 172.21.15.81:0/4050592869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a30106c40 msgr2=0x7f8a3019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2effd640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a30106c40 0x7f8a3019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2effd640 1 -- 172.21.15.81:0/4050592869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a301020a0 msgr2=0x7f8a3019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2effd640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a301020a0 0x7f8a3019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2effd640 1 -- 172.21.15.81:0/4050592869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a301a03e0 con 0x7f8a301062f0 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2ffff640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a30106c40 0x7f8a3019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2effd640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a301062f0 0x7f8a3019aa10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400d740 tx=0x7f8a2400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2cff9640 1 -- 172.21.15.81:0/4050592869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24017070 con 0x7f8a301062f0 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a301a06d0 con 0x7f8a301062f0 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2cff9640 1 -- 172.21.15.81:0/4050592869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a2400de50 con 0x7f8a301062f0 2024-09-21T03:00:39.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a2cff9640 1 -- 172.21.15.81:0/4050592869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400f620 con 0x7f8a301062f0 2024-09-21T03:00:39.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.262+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a301a6e30 con 0x7f8a301062f0 2024-09-21T03:00:39.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.263+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a301024b0 con 0x7f8a301062f0 2024-09-21T03:00:39.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.265+0000 7f8a2cff9640 1 -- 172.21.15.81:0/4050592869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8a2401a070 con 0x7f8a301062f0 2024-09-21T03:00:39.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.266+0000 7f8a2cff9640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8a180b6510 0x7f8a180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:39.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.266+0000 7f8a2f7fe640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8a180b6510 0x7f8a180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:39.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.266+0000 7f8a2cff9640 1 -- 172.21.15.81:0/4050592869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f8a240e7030 con 0x7f8a301062f0 2024-09-21T03:00:39.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.266+0000 7f8a2f7fe640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8a180b6510 0x7f8a180b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8a200058c0 tx=0x7f8a2000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:39.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.269+0000 7f8a2cff9640 1 -- 172.21.15.81:0/4050592869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a240ad580 con 0x7f8a301062f0 2024-09-21T03:00:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.486+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a3019b5a0 con 0x7f8a301062f0 2024-09-21T03:00:39.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:39 smithi081 ceph-mon[30991]: pgmap v367: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:00:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.487+0000 7f8a2cff9640 1 -- 172.21.15.81:0/4050592869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f8a240b1960 con 0x7f8a301062f0 2024-09-21T03:00:39.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:39.489 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:00:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8a180b6510 msgr2=0x7f8a180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8a180b6510 0x7f8a180b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8a200058c0 tx=0x7f8a2000a4c0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a301062f0 msgr2=0x7f8a3019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a301062f0 0x7f8a3019aa10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400d740 tx=0x7f8a2400dc00 comp rx=0 tx=0).stop 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 shutdown_connections 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f8a180b6510 0x7f8a180b8a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a30106c40 0x7f8a3019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a301062f0 0x7f8a3019aa10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 --2- 172.21.15.81:0/4050592869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a301020a0 0x7f8a3019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 >> 172.21.15.81:0/4050592869 conn(0x7f8a30079f90 msgr2=0x7f8a301055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:39.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.489+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 shutdown_connections 2024-09-21T03:00:39.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:39.490+0000 7f8a35f65640 1 -- 172.21.15.81:0/4050592869 wait complete. 2024-09-21T03:00:39.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:39 smithi164 ceph-mon[34236]: pgmap v367: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:00:39.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:39 smithi181 ceph-mon[34096]: pgmap v367: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:00:40.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:00:40.388 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:40.495 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:40 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4050592869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:40.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:40 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4050592869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:40.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:40 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4050592869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/706035965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e141094a0 msgr2=0x7f3e141098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/706035965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e141094a0 0x7f3e141098b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009900 tx=0x7f3e0802a410 comp rx=0 tx=0).stop 2024-09-21T03:00:40.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/706035965 shutdown_connections 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/706035965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e14109df0 0x7f3e14110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/706035965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e141094a0 0x7f3e141098b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/706035965 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e14103b60 0x7f3e14103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/706035965 >> 172.21.15.81:0/706035965 conn(0x7f3e1407b850 msgr2=0x7f3e1407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/706035965 shutdown_connections 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.863+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/706035965 wait complete. 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 Processor -- start 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 -- start start 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e14103b60 0x7f3e1419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e141094a0 0x7f3e1419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e14109df0 0x7f3e1419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14113960 con 0x7f3e14103b60 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141137e0 con 0x7f3e141094a0 2024-09-21T03:00:40.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e1a0cc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14113ae0 con 0x7f3e14109df0 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.864+0000 7f3e137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e14103b60 0x7f3e1419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e14103b60 0x7f3e1419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60792/0 (socket says 172.21.15.81:60792) 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 -- 172.21.15.81:0/2178962115 learned_addr learned my addr 172.21.15.81:0/2178962115 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e12ffd640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e141094a0 0x7f3e1419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e13fff640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e14109df0 0x7f3e1419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 -- 172.21.15.81:0/2178962115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e14109df0 msgr2=0x7f3e1419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e14109df0 0x7f3e1419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 -- 172.21.15.81:0/2178962115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e141094a0 msgr2=0x7f3e1419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e141094a0 0x7f3e1419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 -- 172.21.15.81:0/2178962115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e141a0380 con 0x7f3e14103b60 2024-09-21T03:00:40.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e137fe640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e14103b60 0x7f3e1419a410 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c970 tx=0x7f3e0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e10ff9640 1 -- 172.21.15.81:0/2178962115 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04007bb0 con 0x7f3e14103b60 2024-09-21T03:00:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e141a0670 con 0x7f3e14103b60 2024-09-21T03:00:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e10ff9640 1 -- 172.21.15.81:0/2178962115 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e04007d50 con 0x7f3e14103b60 2024-09-21T03:00:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e10ff9640 1 -- 172.21.15.81:0/2178962115 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004e40 con 0x7f3e14103b60 2024-09-21T03:00:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.865+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e140755f0 con 0x7f3e14103b60 2024-09-21T03:00:40.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.866+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e14104de0 con 0x7f3e14103b60 2024-09-21T03:00:40.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.869+0000 7f3e10ff9640 1 -- 172.21.15.81:0/2178962115 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3e04005000 con 0x7f3e14103b60 2024-09-21T03:00:40.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.869+0000 7f3e10ff9640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:40.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.870+0000 7f3e12ffd640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:40.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.870+0000 7f3e10ff9640 1 -- 172.21.15.81:0/2178962115 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f3e040e76a0 con 0x7f3e14103b60 2024-09-21T03:00:40.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.870+0000 7f3e12ffd640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005940 tx=0x7f3e080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:40.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:40.873+0000 7f3e10ff9640 1 -- 172.21.15.81:0/2178962115 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e04014030 con 0x7f3e14103b60 2024-09-21T03:00:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.086+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e14103f70 con 0x7f3e14103b60 2024-09-21T03:00:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.087+0000 7f3e10ff9640 1 -- 172.21.15.81:0/2178962115 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f3e040b1fd0 con 0x7f3e14103b60 2024-09-21T03:00:41.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:41.089 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:00:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3dfc0b6510 msgr2=0x7f3dfc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005940 tx=0x7f3e080058d0 comp rx=0 tx=0).stop 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e14103b60 msgr2=0x7f3e1419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e14103b60 0x7f3e1419a410 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c970 tx=0x7f3e0400ce30 comp rx=0 tx=0).stop 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 shutdown_connections 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3dfc0b6510 0x7f3dfc0b8a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3e14109df0 0x7f3e1419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e141094a0 0x7f3e1419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 --2- 172.21.15.81:0/2178962115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e14103b60 0x7f3e1419a410 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 >> 172.21.15.81:0/2178962115 conn(0x7f3e1407b850 msgr2=0x7f3e141055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 shutdown_connections 2024-09-21T03:00:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:41.089+0000 7f3e1a0cc640 1 -- 172.21.15.81:0/2178962115 wait complete. 2024-09-21T03:00:41.671 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:41 smithi081 ceph-mon[30991]: pgmap v368: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:00:41.671 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:41 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2178962115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:41.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:41 smithi164 ceph-mon[34236]: pgmap v368: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:00:41.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:41 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2178962115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:41.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:00:41.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:41 smithi181 ceph-mon[34096]: pgmap v368: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:00:41.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:41 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2178962115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:41.950 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:42.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 -- 172.21.15.81:0/2569477180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 msgr2=0x7fb73c10d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:42.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 --2- 172.21.15.81:0/2569477180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c10d900 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb730009900 tx=0x7fb73002a410 comp rx=0 tx=0).stop 2024-09-21T03:00:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 -- 172.21.15.81:0/2569477180 shutdown_connections 2024-09-21T03:00:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 --2- 172.21.15.81:0/2569477180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb73c10dec0 0x7fb73c1103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 --2- 172.21.15.81:0/2569477180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c10d900 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 --2- 172.21.15.81:0/2569477180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb73c104a60 0x7fb73c104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 -- 172.21.15.81:0/2569477180 >> 172.21.15.81:0/2569477180 conn(0x7fb73c0796d0 msgr2=0x7fb73c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 -- 172.21.15.81:0/2569477180 shutdown_connections 2024-09-21T03:00:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.471+0000 7fb743ef9640 1 -- 172.21.15.81:0/2569477180 wait complete. 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 Processor -- start 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 -- start start 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb73c104a60 0x7fb73c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb73c10dec0 0x7fb73c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1139d0 con 0x7fb73c1053b0 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c113850 con 0x7fb73c104a60 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb743ef9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c113b50 con 0x7fb73c10dec0 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb741494640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb741494640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53900/0 (socket says 172.21.15.81:53900) 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb741494640 1 -- 172.21.15.81:0/332917614 learned_addr learned my addr 172.21.15.81:0/332917614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb742496640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb73c10dec0 0x7fb73c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.472+0000 7fb741c95640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb73c104a60 0x7fb73c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb741494640 1 -- 172.21.15.81:0/332917614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb73c10dec0 msgr2=0x7fb73c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb741494640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb73c10dec0 0x7fb73c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb741494640 1 -- 172.21.15.81:0/332917614 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb73c104a60 msgr2=0x7fb73c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb741494640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb73c104a60 0x7fb73c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb741494640 1 -- 172.21.15.81:0/332917614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c1a0450 con 0x7fb73c1053b0 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb742496640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb73c10dec0 0x7fb73c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb741494640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c19aa80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb730005940 tx=0x7fb7300040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb73affd640 1 -- 172.21.15.81:0/332917614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73003f030 con 0x7fb73c1053b0 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73c1a06e0 con 0x7fb73c1053b0 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb73affd640 1 -- 172.21.15.81:0/332917614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb730003a80 con 0x7fb73c1053b0 2024-09-21T03:00:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb73affd640 1 -- 172.21.15.81:0/332917614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730035070 con 0x7fb73c1053b0 2024-09-21T03:00:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.473+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73c1a6ea0 con 0x7fb73c1053b0 2024-09-21T03:00:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.474+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73c06c260 con 0x7fb73c1053b0 2024-09-21T03:00:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.475+0000 7fb73affd640 1 -- 172.21.15.81:0/332917614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb730042030 con 0x7fb73c1053b0 2024-09-21T03:00:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.476+0000 7fb73affd640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb7240b6510 0x7fb7240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:42.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.476+0000 7fb741c95640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb7240b6510 0x7fb7240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:42.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.476+0000 7fb73affd640 1 -- 172.21.15.81:0/332917614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb730108000 con 0x7fb73c1053b0 2024-09-21T03:00:42.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.477+0000 7fb741c95640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb7240b6510 0x7fb7240b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005fd0 tx=0x7fb72c009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:42.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.480+0000 7fb73affd640 1 -- 172.21.15.81:0/332917614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7300ce550 con 0x7fb73c1053b0 2024-09-21T03:00:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.658+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb73c104e70 con 0x7fb73c1053b0 2024-09-21T03:00:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.659+0000 7fb73affd640 1 -- 172.21.15.81:0/332917614 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7fb73c104e70 con 0x7fb73c1053b0 2024-09-21T03:00:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:42.661 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.661+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb7240b6510 msgr2=0x7fb7240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.661+0000 7fb743ef9640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb7240b6510 0x7fb7240b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005fd0 tx=0x7fb72c009870 comp rx=0 tx=0).stop 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.661+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 msgr2=0x7fb73c19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.661+0000 7fb743ef9640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c19aa80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb730005940 tx=0x7fb7300040e0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 shutdown_connections 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb7240b6510 0x7fb7240b8a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb73c10dec0 0x7fb73c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb73c1053b0 0x7fb73c19aa80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 --2- 172.21.15.81:0/332917614 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb73c104a60 0x7fb73c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 >> 172.21.15.81:0/332917614 conn(0x7fb73c0796d0 msgr2=0x7fb73c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 shutdown_connections 2024-09-21T03:00:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:42.662+0000 7fb743ef9640 1 -- 172.21.15.81:0/332917614 wait complete. 2024-09-21T03:00:43.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T03:00:43.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:43 smithi081 ceph-mon[30991]: pgmap v369: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-21T03:00:43.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:43 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/332917614' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:00:43.581 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:43.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:43 smithi164 ceph-mon[34236]: pgmap v369: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-21T03:00:43.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:43 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/332917614' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:00:43.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:43 smithi181 ceph-mon[34096]: pgmap v369: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-21T03:00:43.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:43 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/332917614' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:00:44.818 INFO:teuthology.orchestra.run.smithi081.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T03:00:44.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T03:00:44.819 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T03:00:44.819 DEBUG:tasks.quiescer:Yielding 2024-09-21T03:00:44.819 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T03:00:44.836 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:00:44.836 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T03:00:44.836 INFO:tasks.workunit:timeout=3h 2024-09-21T03:00:44.836 INFO:tasks.workunit:cleanup=True 2024-09-21T03:00:44.837 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:44.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 02:58:57.755270796 +0000 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 02:58:57.755270796 +0000 2024-09-21T03:00:44.854 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 03:00:32.112485413 +0000 2024-09-21T03:00:44.855 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-21T03:00:44.855 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T03:00:44.855 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T03:00:44.925 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:00:44.982 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T03:00:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:45.494 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:45 smithi081 ceph-mon[30991]: pgmap v370: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T03:00:45.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 -- 172.21.15.81:0/3652663372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130107b30 msgr2=0x7f8130107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:45.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 --2- 172.21.15.81:0/3652663372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130107b30 0x7f8130107f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8124009900 tx=0x7f812402a410 comp rx=0 tx=0).stop 2024-09-21T03:00:45.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 -- 172.21.15.81:0/3652663372 shutdown_connections 2024-09-21T03:00:45.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 --2- 172.21.15.81:0/3652663372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8130108480 0x7f813010ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 --2- 172.21.15.81:0/3652663372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130107b30 0x7f8130107f40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 --2- 172.21.15.81:0/3652663372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f81301021f0 0x7f8130102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 -- 172.21.15.81:0/3652663372 >> 172.21.15.81:0/3652663372 conn(0x7f8130077c60 msgr2=0x7f81300780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 -- 172.21.15.81:0/3652663372 shutdown_connections 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.581+0000 7f8137258640 1 -- 172.21.15.81:0/3652663372 wait complete. 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 Processor -- start 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 -- start start 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81301021f0 0x7f813019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130107b30 0x7f813019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130108480 0x7f813019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81301128a0 con 0x7f8130108480 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8130112720 con 0x7f8130107b30 2024-09-21T03:00:45.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8137258640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f8130112a20 con 0x7f81301021f0 2024-09-21T03:00:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130108480 0x7f813019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130108480 0x7f813019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53932/0 (socket says 172.21.15.81:53932) 2024-09-21T03:00:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 -- 172.21.15.81:0/1628647243 learned_addr learned my addr 172.21.15.81:0/1628647243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f812ffff640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130107b30 0x7f813019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f8134ff4640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81301021f0 0x7f813019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 -- 172.21.15.81:0/1628647243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81301021f0 msgr2=0x7f813019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81301021f0 0x7f813019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 -- 172.21.15.81:0/1628647243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130107b30 msgr2=0x7f813019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130107b30 0x7f813019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.582+0000 7f81357f5640 1 -- 172.21.15.81:0/1628647243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81301a6530 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.583+0000 7f81357f5640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130108480 0x7f813019bdb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f812800c970 tx=0x7f812800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.583+0000 7f812dffb640 1 -- 172.21.15.81:0/1628647243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128007bb0 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.583+0000 7f812dffb640 1 -- 172.21.15.81:0/1628647243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8128007d50 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.583+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81301a6820 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.583+0000 7f812dffb640 1 -- 172.21.15.81:0/1628647243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128018660 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.583+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81301a6d30 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.584+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8130102600 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.587+0000 7f812dffb640 1 -- 172.21.15.81:0/1628647243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f812800f970 con 0x7f8130108480 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.587+0000 7f812dffb640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81180b65c0 0x7f81180b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.587+0000 7f8134ff4640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81180b65c0 0x7f81180b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.587+0000 7f812dffb640 1 -- 172.21.15.81:0/1628647243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f81280e77c0 con 0x7f8130108480 2024-09-21T03:00:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.588+0000 7f8134ff4640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81180b65c0 0x7f81180b8ad0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f813010fed0 tx=0x7f8120007310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.590+0000 7f812dffb640 1 -- 172.21.15.81:0/1628647243 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8128056710 con 0x7f8130108480 2024-09-21T03:00:45.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:45 smithi164 ceph-mon[34236]: pgmap v370: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T03:00:45.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:45 smithi181 ceph-mon[34096]: pgmap v370: 129 pgs: 129 active+clean; 651 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T03:00:45.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.808+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f813010f780 con 0x7f8130108480 2024-09-21T03:00:45.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.808+0000 7f812dffb640 1 -- 172.21.15.81:0/1628647243 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f8128014030 con 0x7f8130108480 2024-09-21T03:00:45.810 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:00:45.810 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:00:45.810 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:00:45.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81180b65c0 msgr2=0x7f81180b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:45.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81180b65c0 0x7f81180b8ad0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f813010fed0 tx=0x7f8120007310 comp rx=0 tx=0).stop 2024-09-21T03:00:45.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130108480 msgr2=0x7f813019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:45.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130108480 0x7f813019bdb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f812800c970 tx=0x7f812800ce30 comp rx=0 tx=0).stop 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 shutdown_connections 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f81180b65c0 0x7f81180b8ad0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8130108480 0x7f813019bdb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8130107b30 0x7f813019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 --2- 172.21.15.81:0/1628647243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f81301021f0 0x7f813019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 >> 172.21.15.81:0/1628647243 conn(0x7f8130077c60 msgr2=0x7f8130105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 shutdown_connections 2024-09-21T03:00:45.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:45.811+0000 7f8137258640 1 -- 172.21.15.81:0/1628647243 wait complete. 2024-09-21T03:00:46.500 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:46 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1628647243' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:46.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:58:15.629942+0000', 'modified': '2024-09-21T03:00:32.488820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24599, 'mds_1': 24572, 'mds_2': 24568}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24547': {'gid': 24547, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6835/3990133631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6834', 'nonce': 3990133631}, {'type': 'v1', 'addr': '172.21.15.181:6835', 'nonce': 3990133631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24551': {'gid': 24551, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.164:6835/1947556688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1947556688}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 1947556688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24553': {'gid': 24553, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6837/3046788185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6836', 'nonce': 3046788185}, {'type': 'v1', 'addr': '172.21.15.181:6837', 'nonce': 3046788185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.181:6839/1458541171', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6838', 'nonce': 1458541171}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 1458541171}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24572': {'gid': 24572, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.164:6837/3749524162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6836', 'nonce': 3749524162}, {'type': 'v1', 'addr': '172.21.15.164:6837', 'nonce': 3749524162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.164:6839/399869191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6838', 'nonce': 399869191}, {'type': 'v1', 'addr': '172.21.15.164:6839', 'nonce': 399869191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24599, 'qdb_cluster': [24599, 24572, 24568]} 2024-09-21T03:00:46.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T03:00:46.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 -- 172.21.15.81:0/4167551127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d20103620 msgr2=0x7f5d20103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 --2- 172.21.15.81:0/4167551127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d20103620 0x7f5d20103a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009900 tx=0x7f5d0c02a410 comp rx=0 tx=0).stop 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 -- 172.21.15.81:0/4167551127 shutdown_connections 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 --2- 172.21.15.81:0/4167551127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d20103fc0 0x7f5d2010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 --2- 172.21.15.81:0/4167551127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d20103620 0x7f5d20103a30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 --2- 172.21.15.81:0/4167551127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d201025a0 0x7f5d20102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 -- 172.21.15.81:0/4167551127 >> 172.21.15.81:0/4167551127 conn(0x7f5d200fdee0 msgr2=0x7f5d20100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 -- 172.21.15.81:0/4167551127 shutdown_connections 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.540+0000 7f5d270a9640 1 -- 172.21.15.81:0/4167551127 wait complete. 2024-09-21T03:00:46.543 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 Processor -- start 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 -- start start 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201025a0 0x7f5d20199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d20103620 0x7f5d2019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d20103fc0 0x7f5d2019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2010e0b0 con 0x7f5d201025a0 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2010df30 con 0x7f5d20103620 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d270a9640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2010e230 con 0x7f5d20103fc0 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201025a0 0x7f5d20199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201025a0 0x7f5d20199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53958/0 (socket says 172.21.15.81:53958) 2024-09-21T03:00:46.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 -- 172.21.15.81:0/1700531293 learned_addr learned my addr 172.21.15.81:0/1700531293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d25646640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d20103fc0 0x7f5d2019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d20103620 0x7f5d2019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 -- 172.21.15.81:0/1700531293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d20103fc0 msgr2=0x7f5d2019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d20103fc0 0x7f5d2019b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 -- 172.21.15.81:0/1700531293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d20103620 msgr2=0x7f5d2019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d20103620 0x7f5d2019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d24e45640 1 -- 172.21.15.81:0/1700531293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2019b870 con 0x7f5d201025a0 2024-09-21T03:00:46.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.541+0000 7f5d25646640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d20103fc0 0x7f5d2019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.542+0000 7f5d24e45640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201025a0 0x7f5d20199ec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d770 tx=0x7f5d1400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.542+0000 7f5d1dffb640 1 -- 172.21.15.81:0/1700531293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14017070 con 0x7f5d201025a0 2024-09-21T03:00:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.542+0000 7f5d1dffb640 1 -- 172.21.15.81:0/1700531293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d140054b0 con 0x7f5d201025a0 2024-09-21T03:00:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.542+0000 7f5d1dffb640 1 -- 172.21.15.81:0/1700531293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14004c60 con 0x7f5d201025a0 2024-09-21T03:00:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.542+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2019bb60 con 0x7f5d201025a0 2024-09-21T03:00:46.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.542+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d201a2100 con 0x7f5d201025a0 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.544+0000 7f5d1dffb640 1 -- 172.21.15.81:0/1700531293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5d14004e00 con 0x7f5d201025a0 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.544+0000 7f5d2e01c740 1 Processor -- start 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d2e01c740 1 -- start start 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b40f4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d274d0 0x55d7b40f5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d7b40626f0 con 0x55d7b3d481b0 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d7b4051b20 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d7b4055930 con 0x55d7b3d274d0 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b40f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b40f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53974/0 (socket says 172.21.15.81:53974) 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 -- 172.21.15.81:0/564857394 learned_addr learned my addr 172.21.15.81:0/564857394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d24e45640 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d274d0 0x55d7b40f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 -- 172.21.15.81:0/564857394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d274d0 msgr2=0x55d7b40f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d274d0 0x55d7b40f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 -- 172.21.15.81:0/564857394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 msgr2=0x55d7b40f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 -- 172.21.15.81:0/564857394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b4017530 con 0x55d7b3d481b0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d274d0 0x55d7b40f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d1dffb640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5d100b6510 0x7f5d100b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.545+0000 7f5d25646640 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b40f4260 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5d18007ef0 tx=0x7f5d1800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b13309d256f10a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.546+0000 7f5d24e45640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5d100b6510 0x7f5d100b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.546+0000 7f5d0affd640 1 -- 172.21.15.81:0/564857394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d18014070 con 0x55d7b3d481b0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.546+0000 7f5d0affd640 1 -- 172.21.15.81:0/564857394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d18004d70 con 0x55d7b3d481b0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.546+0000 7f5d0affd640 1 -- 172.21.15.81:0/564857394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d180053d0 con 0x55d7b3d481b0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.546+0000 7f5d1dffb640 1 -- 172.21.15.81:0/1700531293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5d140e7150 con 0x7f5d201025a0 2024-09-21T03:00:46.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 -- 172.21.15.81:0/564857394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 msgr2=0x55d7b40f4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b40f4260 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5d18007ef0 tx=0x7f5d1800e720 comp rx=0 tx=0).stop 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d24e45640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5d100b6510 0x7f5d100b8a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d140acf30 tx=0x7f5d140eac30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 -- 172.21.15.81:0/564857394 shutdown_connections 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d274d0 0x55d7b40f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/564857394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b40f4260 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 -- 172.21.15.81:0/564857394 >> 172.21.15.81:0/564857394 conn(0x55d7b3d3c300 msgr2=0x55d7b40eb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 -- 172.21.15.81:0/564857394 shutdown_connections 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 -- 172.21.15.81:0/564857394 wait complete. 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 -- start start 2024-09-21T03:00:46.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.547+0000 7f5d2e01c740 1 Processor -- start 2024-09-21T03:00:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40fda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d274d0 0x55d7b40fe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d7b3f89ab0 con 0x55d7b3d274d0 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d7b3ff7730 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55d7b40f5f40 con 0x55d7b3d481b0 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d2e01c740 10 client.0 _ll_register_callbacks cb 0x55d7b404b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d274d0 0x55d7b40fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d274d0 0x55d7b40fe100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53982/0 (socket says 172.21.15.81:53982) 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 -- 172.21.15.81:0/2930773242 learned_addr learned my addr 172.21.15.81:0/2930773242 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d25646640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d25646640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 -- 172.21.15.81:0/2930773242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 msgr2=0x55d7b40fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 -- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 msgr2=0x55d7b40fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 -- 172.21.15.81:0/2930773242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b3db3790 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d25646640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d274d0 0x55d7b40fe100 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0057c0 tx=0x7f5d0c031820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca37d2be04fd84d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.548+0000 7f5cfffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5cfffff640 1 -- 172.21.15.81:0/2930773242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c035030 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5cfffff640 1 -- 172.21.15.81:0/2930773242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5d0c004240 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d18004d70 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5cfffff640 1 -- 172.21.15.81:0/2930773242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d0c004440 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 10 client.15477 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7b3e2c620 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5cfffff640 1 -- 172.21.15.81:0/2930773242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d18004d70 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5cfffff640 1 -- 172.21.15.81:0/2930773242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5d0c03c6d0 con 0x55d7b3d274d0 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 10 client.15477 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 20 client.15477 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3d06d80 0x55d7b410b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 4 client.15477 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.549+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7b4064640 con 0x55d7b3d06d80 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.550+0000 7f5d25646640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3d06d80 0x55d7b410b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.550+0000 7f5cfffff640 10 client.15477 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.550+0000 7f5d25646640 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3d06d80 0x55d7b410b160 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a021985bfaaf8e64 server_cookie=d1ad5f7653faa352 in_seq=0 out_seq=0 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5cfffff640 1 -- 172.21.15.81:0/2930773242 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7b4064640 con 0x55d7b3d06d80 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5cfffff640 10 client.15477 handle_command_reply: tid=0 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 client.15477 shutdown 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d274d0 msgr2=0x55d7b40fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d274d0 0x55d7b40fe100 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0057c0 tx=0x7f5d0c031820 comp rx=0 tx=0).stop 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 shutdown_connections 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3d06d80 0x55d7b410b160 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d274d0 0x55d7b40fe100 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5cfffff640 0 client.15477 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/2930773242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 >> 172.21.15.81:0/2930773242 conn(0x55d7b3d3c300 msgr2=0x55d7b40e9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 shutdown_connections 2024-09-21T03:00:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 1 -- 172.21.15.81:0/2930773242 wait complete. 2024-09-21T03:00:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.551+0000 7f5d2e01c740 20 client.15477 trim_cache size 0 max 16384 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 Processor -- start 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 -- start start 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b40fda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d201aca80 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5d201aa350 con 0x55d7b3d274d0 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d201a81a0 con 0x55d7b3d481b0 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.566+0000 7f5d25646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53992/0 (socket says 172.21.15.81:53992) 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 -- 172.21.15.81:0/1149281970 learned_addr learned my addr 172.21.15.81:0/1149281970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b40fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 -- 172.21.15.81:0/1149281970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 msgr2=0x55d7b40fdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 -- 172.21.15.81:0/1149281970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 msgr2=0x55d7b40fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b40fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 -- 172.21.15.81:0/1149281970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b4105f10 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d25646640 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f4910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5d18007ec0 tx=0x7f5d1800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4d4a310551f8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d0a7fc640 1 -- 172.21.15.81:0/1149281970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d18032020 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d0a7fc640 1 -- 172.21.15.81:0/1149281970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d18004c90 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.567+0000 7f5d0a7fc640 1 -- 172.21.15.81:0/1149281970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d18014040 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 -- 172.21.15.81:0/1149281970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d1f2f0 msgr2=0x55d7b40f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f4910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5d18007ec0 tx=0x7f5d1800ec40 comp rx=0 tx=0).stop 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 -- 172.21.15.81:0/1149281970 shutdown_connections 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d481b0 0x55d7b40fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b40fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/1149281970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d1f2f0 0x55d7b40f4910 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 -- 172.21.15.81:0/1149281970 >> 172.21.15.81:0/1149281970 conn(0x55d7b3d3c300 msgr2=0x55d7b40f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 -- 172.21.15.81:0/1149281970 shutdown_connections 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 -- 172.21.15.81:0/1149281970 wait complete. 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.568+0000 7f5d2e01c740 1 -- start start 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 1 Processor -- start 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d1f2f0 0x55d7b4102d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b41033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b4103f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d201a8810 con 0x55d7b3d481b0 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5d201a9c80 con 0x55d7b3d274d0 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5d201a8ee0 con 0x55d7b3d1f2f0 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d2e01c740 10 client.0 _ll_register_callbacks cb 0x7f5d0c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b4103f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b4103f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54004/0 (socket says 172.21.15.81:54004) 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 -- 172.21.15.81:0/212560233 learned_addr learned my addr 172.21.15.81:0/212560233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b41033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d1f2f0 0x55d7b4102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 -- 172.21.15.81:0/212560233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d1f2f0 msgr2=0x55d7b4102d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d1f2f0 0x55d7b4102d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 -- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 msgr2=0x55d7b41033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b41033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.569+0000 7f5d25646640 1 -- 172.21.15.81:0/212560233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b4104690 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d25646640 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b4103f30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5d18007700 tx=0x7f5d180072a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4cb848867cb8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5cfffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5cfffff640 1 -- 172.21.15.81:0/212560233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d18032070 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5cfffff640 1 -- 172.21.15.81:0/212560233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5d18037450 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d18004c90 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5cfffff640 1 -- 172.21.15.81:0/212560233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d18014040 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 10 client.15483 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7b4105960 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5cfffff640 1 -- 172.21.15.81:0/212560233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d18004c90 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5cfffff640 1 -- 172.21.15.81:0/212560233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5d18039700 con 0x55d7b3d481b0 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 10 client.15483 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:00:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 20 client.15483 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3cdc1c0 0x55d7b4177d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 4 client.15483 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:00:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.570+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d7b40600f0 con 0x55d7b3cdc1c0 2024-09-21T03:00:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.571+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3cdc1c0 0x55d7b4177d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.571+0000 7f5cfffff640 10 client.15483 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.571+0000 7f5d1ffff640 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3cdc1c0 0x55d7b4177d40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d8251bad78009a1 server_cookie=67d4524d297ee401 in_seq=0 out_seq=0 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5cfffff640 1 -- 172.21.15.81:0/212560233 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d7b40600f0 con 0x55d7b3cdc1c0 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5cfffff640 10 client.15483 handle_command_reply: tid=0 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 client.15483 shutdown 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 msgr2=0x55d7b4103f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b4103f30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5d18007700 tx=0x7f5d180072a0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 shutdown_connections 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55d7b3cdc1c0 0x55d7b4177d40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d7b3d481b0 0x55d7b4103f30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d7b3d274d0 0x55d7b41033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5cfffff640 0 client.15483 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 --2- 172.21.15.81:0/212560233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7b3d1f2f0 0x55d7b4102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 >> 172.21.15.81:0/212560233 conn(0x55d7b3d3c300 msgr2=0x55d7b40fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 shutdown_connections 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.586+0000 7f5d2e01c740 1 -- 172.21.15.81:0/212560233 wait complete. 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d2e01c740 20 client.15483 trim_cache size 0 max 16384 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:00:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5d100b6510 msgr2=0x7f5d100b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5d100b6510 0x7f5d100b8a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d140acf30 tx=0x7f5d140eac30 comp rx=0 tx=0).stop 2024-09-21T03:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201025a0 msgr2=0x7f5d20199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201025a0 0x7f5d20199ec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d770 tx=0x7f5d1400dc30 comp rx=0 tx=0).stop 2024-09-21T03:00:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 shutdown_connections 2024-09-21T03:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5d100b6510 0x7f5d100b8a20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d20103fc0 0x7f5d2019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d20103620 0x7f5d2019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 --2- 172.21.15.81:0/1700531293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201025a0 0x7f5d20199ec0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 >> 172.21.15.81:0/1700531293 conn(0x7f5d200fdee0 msgr2=0x7f5d200ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 shutdown_connections 2024-09-21T03:00:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:46.587+0000 7f5d270a9640 1 -- 172.21.15.81:0/1700531293 wait complete. 2024-09-21T03:00:46.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:46 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1628647243' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:46.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:46 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1628647243' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:00:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:47.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 -- 172.21.15.81:0/2396811978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a01049b0 msgr2=0x7f83a0104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 --2- 172.21.15.81:0/2396811978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a01049b0 0x7f83a0104dc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8390009ca0 tx=0x7f839002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 -- 172.21.15.81:0/2396811978 shutdown_connections 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 --2- 172.21.15.81:0/2396811978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83a010de10 0x7f83a0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 --2- 172.21.15.81:0/2396811978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a0105300 0x7f83a010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 --2- 172.21.15.81:0/2396811978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a01049b0 0x7f83a0104dc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 -- 172.21.15.81:0/2396811978 >> 172.21.15.81:0/2396811978 conn(0x7f83a0079730 msgr2=0x7f83a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 -- 172.21.15.81:0/2396811978 shutdown_connections 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.234+0000 7f83a54f3640 1 -- 172.21.15.81:0/2396811978 wait complete. 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 Processor -- start 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 -- start start 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83a01049b0 0x7f83a01026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a0105300 0x7f83a0102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a010de10 0x7f83a0103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0113970 con 0x7f83a010de10 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f83a01137f0 con 0x7f83a0105300 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f83a54f3640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0113af0 con 0x7f83a01049b0 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a010de10 0x7f83a0103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a010de10 0x7f83a0103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54008/0 (socket says 172.21.15.81:54008) 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f839f7fe640 1 -- 172.21.15.81:0/1311659228 learned_addr learned my addr 172.21.15.81:0/1311659228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f839effd640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83a01049b0 0x7f83a01026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.235+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a0105300 0x7f83a0102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f839f7fe640 1 -- 172.21.15.81:0/1311659228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83a01049b0 msgr2=0x7f83a01026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f839f7fe640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83a01049b0 0x7f83a01026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f839f7fe640 1 -- 172.21.15.81:0/1311659228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a0105300 msgr2=0x7f83a0102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f839f7fe640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a0105300 0x7f83a0102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f839f7fe640 1 -- 172.21.15.81:0/1311659228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a01a86e0 con 0x7f83a010de10 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f839f7fe640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a010de10 0x7f83a0103170 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f839800c970 tx=0x7f839800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f8397fff640 1 -- 172.21.15.81:0/1311659228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398007bb0 con 0x7f83a010de10 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f8397fff640 1 -- 172.21.15.81:0/1311659228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8398007d50 con 0x7f83a010de10 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a01a89d0 con 0x7f83a010de10 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f8397fff640 1 -- 172.21.15.81:0/1311659228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398004d50 con 0x7f83a010de10 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.236+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a01a8ec0 con 0x7f83a010de10 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f8397fff640 1 -- 172.21.15.81:0/1311659228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f839800f450 con 0x7f83a010de10 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 Processor -- start 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 -- start start 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb38f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb39440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb39980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55678cab0c10 con 0x55678c76a0a0 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55678caa0040 con 0x55678c792f60 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f83aba67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55678caa3e50 con 0x55678c772280 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f839effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb39440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f839effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb39440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54012/0 (socket says 172.21.15.81:54012) 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.239+0000 7f839effd640 1 -- 172.21.15.81:0/1908218709 learned_addr learned my addr 172.21.15.81:0/1908218709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb38f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb39980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f8397fff640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f838c0b6510 0x7f838c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839effd640 1 -- 172.21.15.81:0/1908218709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 msgr2=0x55678cb39980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839effd640 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb39980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839effd640 1 -- 172.21.15.81:0/1908218709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 msgr2=0x55678cb38f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839effd640 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb38f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839effd640 1 -- 172.21.15.81:0/1908218709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678c7fe540 con 0x55678c76a0a0 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839f7fe640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f838c0b6510 0x7f838c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f839effd640 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb39440 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8390009ca0 tx=0x7f8390005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505918cc517329a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f8397fff640 1 -- 172.21.15.81:0/1311659228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f83980e7340 con 0x7f83a010de10 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f83957fa640 1 -- 172.21.15.81:0/1908218709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390031980 con 0x55678c76a0a0 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f83957fa640 1 -- 172.21.15.81:0/1908218709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8390036030 con 0x55678c76a0a0 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.240+0000 7f83957fa640 1 -- 172.21.15.81:0/1908218709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390004370 con 0x55678c76a0a0 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 -- 172.21.15.81:0/1908218709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 msgr2=0x55678cb39440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f839f7fe640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f838c0b6510 0x7f838c0b8a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f83980e4e70 tx=0x7f8398005780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb39440 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8390009ca0 tx=0x7f8390005fd0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 -- 172.21.15.81:0/1908218709 shutdown_connections 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb39980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb39440 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 --2- 172.21.15.81:0/1908218709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb38f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 -- 172.21.15.81:0/1908218709 >> 172.21.15.81:0/1908218709 conn(0x55678c787350 msgr2=0x55678cb36df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 -- 172.21.15.81:0/1908218709 shutdown_connections 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.241+0000 7f83aba67740 1 -- 172.21.15.81:0/1908218709 wait complete. 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 -- start start 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 Processor -- start 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb44790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb44d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb50820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55678c9015f0 con 0x55678c76a0a0 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55678ca3b010 con 0x55678c792f60 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55678cb47500 con 0x55678c772280 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f83aba67740 10 client.0 _ll_register_callbacks cb 0x55678ca9a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f839e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb44790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f839e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb44790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54016/0 (socket says 172.21.15.81:54016) 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f839e7fc640 1 -- 172.21.15.81:0/3601179822 learned_addr learned my addr 172.21.15.81:0/3601179822 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.242+0000 7f839effd640 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb44d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f839e7fc640 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb50820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f839e7fc640 1 -- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 msgr2=0x55678cb44d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f839e7fc640 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb44d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f839e7fc640 1 -- 172.21.15.81:0/3601179822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 msgr2=0x55678cb50820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f839e7fc640 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb50820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f839e7fc640 1 -- 172.21.15.81:0/3601179822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55678ca68a00 con 0x55678c76a0a0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f839e7fc640 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb44790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f838800ce40 tx=0x7f8388016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460f878b32da9da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83867fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83867fc640 1 -- 172.21.15.81:0/3601179822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388012ce0 con 0x55678c76a0a0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83867fc640 1 -- 172.21.15.81:0/3601179822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f8388004030 con 0x55678c76a0a0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8390036030 con 0x55678c76a0a0 2024-09-21T03:00:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83867fc640 1 -- 172.21.15.81:0/3601179822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8388004230 con 0x55678c76a0a0 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83aba67740 10 client.15495 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55678cb53450 con 0x55678c76a0a0 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.243+0000 7f83867fc640 1 -- 172.21.15.81:0/3601179822 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8390036030 con 0x55678c76a0a0 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83867fc640 1 -- 172.21.15.81:0/3601179822 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f8388011440 con 0x55678c76a0a0 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83aba67740 10 client.15495 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83aba67740 10 client.15495 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83aba67740 20 client.15495 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83aba67740 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c7518e0 0x55678cb56f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83aba67740 4 client.15495 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 --> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55678cab2b60 con 0x55678c7518e0 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f839effd640 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c7518e0 0x55678cb56f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f83867fc640 10 client.15495 ms_handle_connect on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.244+0000 7f839effd640 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c7518e0 0x55678cb56f10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=212a054296d7320a server_cookie=65ac427a89d19772 in_seq=0 out_seq=0 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.245+0000 7f83867fc640 1 -- 172.21.15.81:0/3601179822 <== mds.2 v2:172.21.15.181:6838/1458541171 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55678cab2b60 con 0x55678c7518e0 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.245+0000 7f83867fc640 10 client.15495 handle_command_reply: tid=0 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.245+0000 7f83aba67740 1 client.15495 shutdown 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.245+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 msgr2=0x55678cb44790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.245+0000 7f83aba67740 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb44790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f838800ce40 tx=0x7f8388016040 comp rx=0 tx=0).stop 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.245+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 shutdown_connections 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.245+0000 7f83aba67740 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c7518e0 0x55678cb56f10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83aba67740 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb44d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83aba67740 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb50820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83867fc640 0 client.15495 ms_handle_reset on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83aba67740 1 --2- 172.21.15.81:0/3601179822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb44790 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 >> 172.21.15.81:0/3601179822 conn(0x55678c787350 msgr2=0x55678cb3c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 shutdown_connections 2024-09-21T03:00:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83aba67740 1 -- 172.21.15.81:0/3601179822 wait complete. 2024-09-21T03:00:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.246+0000 7f83aba67740 20 client.15495 trim_cache size 0 max 16384 2024-09-21T03:00:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.263+0000 7f83aba67740 1 Processor -- start 2024-09-21T03:00:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.263+0000 7f83aba67740 1 -- start start 2024-09-21T03:00:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f83aba67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb31ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f83aba67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb50790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f83aba67740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb50cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f83aba67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55678cb55250 con 0x55678c76a0a0 2024-09-21T03:00:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f83aba67740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55678cb55920 con 0x55678c792f60 2024-09-21T03:00:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f83aba67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55678cb55ff0 con 0x55678c772280 2024-09-21T03:00:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb31ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb31ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54018/0 (socket says 172.21.15.81:54018) 2024-09-21T03:00:47.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 -- 172.21.15.81:0/3521271521 learned_addr learned my addr 172.21.15.81:0/3521271521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839effd640 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb50790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 -- 172.21.15.81:0/3521271521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 msgr2=0x55678cb50790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb50790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 -- 172.21.15.81:0/3521271521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 msgr2=0x55678cb50cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb50cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.264+0000 7f839e7fc640 1 -- 172.21.15.81:0/3521271521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55678cb42c90 con 0x55678c76a0a0 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.265+0000 7f839e7fc640 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb31ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f83880059f0 tx=0x7f83880057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddd3f32d94ed1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.265+0000 7f8394ff9640 1 -- 172.21.15.81:0/3521271521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388030030 con 0x55678c76a0a0 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.265+0000 7f8394ff9640 1 -- 172.21.15.81:0/3521271521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83880043d0 con 0x55678c76a0a0 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.265+0000 7f8394ff9640 1 -- 172.21.15.81:0/3521271521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388011570 con 0x55678c76a0a0 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- 172.21.15.81:0/3521271521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 msgr2=0x55678cb31ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb31ad0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f83880059f0 tx=0x7f83880057d0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- 172.21.15.81:0/3521271521 shutdown_connections 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb50790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c792f60 0x55678cb50cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 --2- 172.21.15.81:0/3521271521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c76a0a0 0x55678cb31ad0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- 172.21.15.81:0/3521271521 >> 172.21.15.81:0/3521271521 conn(0x55678c787350 msgr2=0x55678cb3f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- 172.21.15.81:0/3521271521 shutdown_connections 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- 172.21.15.81:0/3521271521 wait complete. 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- start start 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 Processor -- start 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c76a0a0 0x55678cb5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb59db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c792f60 0x55678cb5a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55678cb56d90 con 0x55678c792f60 2024-09-21T03:00:47.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55678cb566c0 con 0x55678c76a0a0 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.266+0000 7f83aba67740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55678cb57460 con 0x55678c772280 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f83aba67740 10 client.0 _ll_register_callbacks cb 0x7f838800cd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c792f60 0x55678cb5a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c792f60 0x55678cb5a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54032/0 (socket says 172.21.15.81:54032) 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921103971 learned_addr learned my addr 172.21.15.81:0/1921103971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839effd640 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb59db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c76a0a0 0x55678cb5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 msgr2=0x55678cb59db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb59db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921103971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c76a0a0 msgr2=0x55678cb5f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c76a0a0 0x55678cb5f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921103971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55678cb5a9e0 con 0x55678c792f60 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c792f60 0x55678cb5a2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f83880114a0 tx=0x7f8388014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cca5f83c167a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:47.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f83867fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f83867fc640 1 -- 172.21.15.81:0/1921103971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388030070 con 0x55678c792f60 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f83867fc640 1 -- 172.21.15.81:0/1921103971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f838802c460 con 0x55678c792f60 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.267+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83880043d0 con 0x55678c792f60 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83867fc640 1 -- 172.21.15.81:0/1921103971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f838802c660 con 0x55678c792f60 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 10 client.15501 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55678cbc3280 con 0x55678c792f60 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83867fc640 1 -- 172.21.15.81:0/1921103971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83880043d0 con 0x55678c792f60 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83867fc640 1 -- 172.21.15.81:0/1921103971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f8388012ce0 con 0x55678c792f60 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 10 client.15501 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 10 client.15501 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 20 client.15501 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c726c90 0x55678cbc6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 4 client.15501 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:47.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 --> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] -- command(tid 0: {"prefix": "status"}) -- 0x55678caae610 con 0x55678c726c90 2024-09-21T03:00:47.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.268+0000 7f839effd640 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c726c90 0x55678cbc6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f839effd640 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c726c90 0x55678cbc6890 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba278f850de35795 server_cookie=dfde6f5f094d863b in_seq=0 out_seq=0 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83867fc640 10 client.15501 ms_handle_connect on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83867fc640 1 -- 172.21.15.81:0/1921103971 <== mds.2 v2:172.21.15.181:6838/1458541171 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55678caae610 con 0x55678c726c90 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83867fc640 10 client.15501 handle_command_reply: tid=0 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 client.15501 shutdown 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c792f60 msgr2=0x55678cb5a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c792f60 0x55678cb5a2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f83880114a0 tx=0x7f8388014f90 comp rx=0 tx=0).stop 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 shutdown_connections 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:6838/1458541171,v1:172.21.15.181:6839/1458541171] conn(0x55678c726c90 0x55678cbc6890 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55678c772280 0x55678cb59db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55678c792f60 0x55678cb5a2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83867fc640 0 client.15501 ms_handle_reset on v2:172.21.15.181:6838/1458541171 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 --2- 172.21.15.81:0/1921103971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55678c76a0a0 0x55678cb5f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 >> 172.21.15.81:0/1921103971 conn(0x55678c787350 msgr2=0x55678cb3f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 shutdown_connections 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.269+0000 7f83aba67740 1 -- 172.21.15.81:0/1921103971 wait complete. 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83aba67740 20 client.15501 trim_cache size 0 max 16384 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24568, 2024-09-21T03:00:47.276 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 116.12757616899999, 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 25, 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 170.76944729300001 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:47.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f838c0b6510 msgr2=0x7f838c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f838c0b6510 0x7f838c0b8a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f83980e4e70 tx=0x7f8398005780 comp rx=0 tx=0).stop 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a010de10 msgr2=0x7f83a0103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a010de10 0x7f83a0103170 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f839800c970 tx=0x7f839800ce30 comp rx=0 tx=0).stop 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 shutdown_connections 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f838c0b6510 0x7f838c0b8a20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83a010de10 0x7f83a0103170 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83a0105300 0x7f83a0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 --2- 172.21.15.81:0/1311659228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f83a01049b0 0x7f83a01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 >> 172.21.15.81:0/1311659228 conn(0x7f83a0079730 msgr2=0x7f83a0100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 shutdown_connections 2024-09-21T03:00:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:47.270+0000 7f83a54f3640 1 -- 172.21.15.81:0/1311659228 wait complete. 2024-09-21T03:00:47.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:47 smithi081 ceph-mon[30991]: pgmap v371: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:00:47.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:47 smithi164 ceph-mon[34236]: pgmap v371: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:00:47.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:47 smithi181 ceph-mon[34096]: pgmap v371: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:00:47.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T03:00:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 -- 172.21.15.81:0/3007475084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 msgr2=0x7f4144102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 --2- 172.21.15.81:0/3007475084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f4144102e70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4134009900 tx=0x7f413402a410 comp rx=0 tx=0).stop 2024-09-21T03:00:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 -- 172.21.15.81:0/3007475084 shutdown_connections 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 --2- 172.21.15.81:0/3007475084 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f41441083a0 0x7f41441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 --2- 172.21.15.81:0/3007475084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4144108cf0 0x7f414410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 --2- 172.21.15.81:0/3007475084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f4144102e70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 -- 172.21.15.81:0/3007475084 >> 172.21.15.81:0/3007475084 conn(0x7f4144079730 msgr2=0x7f4144079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 -- 172.21.15.81:0/3007475084 shutdown_connections 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.752+0000 7f414b1d0640 1 -- 172.21.15.81:0/3007475084 wait complete. 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 Processor -- start 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 -- start start 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f414419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41441083a0 0x7f414419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4144108cf0 0x7f414419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4144113970 con 0x7f4144102a60 2024-09-21T03:00:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f41441137f0 con 0x7f41441083a0 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f414b1d0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4144113af0 con 0x7f4144108cf0 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f4148f6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f414419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f4148f6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f414419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54042/0 (socket says 172.21.15.81:54042) 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.753+0000 7f4148f6c640 1 -- 172.21.15.81:0/656534482 learned_addr learned my addr 172.21.15.81:0/656534482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4143fff640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41441083a0 0x7f414419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f414976d640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4144108cf0 0x7f414419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4148f6c640 1 -- 172.21.15.81:0/656534482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4144108cf0 msgr2=0x7f414419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4148f6c640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4144108cf0 0x7f414419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4148f6c640 1 -- 172.21.15.81:0/656534482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41441083a0 msgr2=0x7f414419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4148f6c640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41441083a0 0x7f414419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4148f6c640 1 -- 172.21.15.81:0/656534482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41441a0390 con 0x7f4144102a60 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f414976d640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4144108cf0 0x7f414419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4148f6c640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f414419a420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4134009230 tx=0x7f4134004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4141ffb640 1 -- 172.21.15.81:0/656534482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413403f030 con 0x7f4144102a60 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4141ffb640 1 -- 172.21.15.81:0/656534482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4134003a80 con 0x7f4144102a60 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41441a0620 con 0x7f4144102a60 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f4141ffb640 1 -- 172.21.15.81:0/656534482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4134035070 con 0x7f4144102a60 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.754+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41441a6de0 con 0x7f4144102a60 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4141ffb640 1 -- 172.21.15.81:0/656534482 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4134042030 con 0x7f4144102a60 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 Processor -- start 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 -- start start 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fe0f60 0x564ad7386f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fb80a0 0x564ad7387440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fc0280 0x564ad7387980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ad72fec10 con 0x564ad6fe0f60 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564ad72ee040 con 0x564ad6fb80a0 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f4151744740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ad72f1e50 con 0x564ad6fc0280 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.757+0000 7f414976d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fe0f60 0x564ad7386f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fe0f60 0x564ad7386f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54054/0 (socket says 172.21.15.81:54054) 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 -- 172.21.15.81:0/138418202 learned_addr learned my addr 172.21.15.81:0/138418202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f4148f6c640 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fb80a0 0x564ad7387440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f4143fff640 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fc0280 0x564ad7387980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 -- 172.21.15.81:0/138418202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fc0280 msgr2=0x564ad7387980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fc0280 0x564ad7387980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 -- 172.21.15.81:0/138418202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fb80a0 msgr2=0x564ad7387440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fb80a0 0x564ad7387440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 -- 172.21.15.81:0/138418202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad704c540 con 0x564ad6fe0f60 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f4148f6c640 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fb80a0 0x564ad7387440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f4141ffb640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41300b6510 0x7f41300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f414976d640 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fe0f60 0x564ad7386f00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a990 tx=0x7f413c00ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be82c7c9fe0ceeff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f4148f6c640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41300b6510 0x7f41300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f413affd640 1 -- 172.21.15.81:0/138418202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c015070 con 0x564ad6fe0f60 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f4141ffb640 1 -- 172.21.15.81:0/656534482 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f4134107db0 con 0x7f4144102a60 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f413affd640 1 -- 172.21.15.81:0/138418202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f413c00cb80 con 0x564ad6fe0f60 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.758+0000 7f413affd640 1 -- 172.21.15.81:0/138418202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c0105b0 con 0x564ad6fe0f60 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 -- 172.21.15.81:0/138418202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fe0f60 msgr2=0x564ad7386f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4148f6c640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41300b6510 0x7f41300b8a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x564ad7385b80 tx=0x7f4134009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fe0f60 0x564ad7386f00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a990 tx=0x7f413c00ae50 comp rx=0 tx=0).stop 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 -- 172.21.15.81:0/138418202 shutdown_connections 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fc0280 0x564ad7387980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fb80a0 0x564ad7387440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 --2- 172.21.15.81:0/138418202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fe0f60 0x564ad7386f00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 -- 172.21.15.81:0/138418202 >> 172.21.15.81:0/138418202 conn(0x564ad6fd5350 msgr2=0x564ad7384df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 -- 172.21.15.81:0/138418202 shutdown_connections 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.759+0000 7f4151744740 1 -- 172.21.15.81:0/138418202 wait complete. 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 -- start start 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 Processor -- start 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7396bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad7397190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fe0f60 0x564ad73a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ad714f5f0 con 0x564ad6fb80a0 2024-09-21T03:00:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564ad7289010 con 0x564ad6fc0280 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ad7399a40 con 0x564ad6fe0f60 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f414976d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7396bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4151744740 10 client.0 _ll_register_callbacks cb 0x564ad72e8340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f414976d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7396bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54062/0 (socket says 172.21.15.81:54062) 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f414976d640 1 -- 172.21.15.81:0/3406414286 learned_addr learned my addr 172.21.15.81:0/3406414286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f4143fff640 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad7397190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.760+0000 7f414976d640 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fe0f60 0x564ad73a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f414976d640 1 -- 172.21.15.81:0/3406414286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fe0f60 msgr2=0x564ad73a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f414976d640 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fe0f60 0x564ad73a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f414976d640 1 -- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 msgr2=0x564ad7397190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f414976d640 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad7397190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f414976d640 1 -- 172.21.15.81:0/3406414286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad72b6a00 con 0x564ad6fb80a0 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f414976d640 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7396bb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a140 tx=0x7f413c00a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f633f79bc2cdda6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4123fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4123fff640 1 -- 172.21.15.81:0/3406414286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c02b060 con 0x564ad6fb80a0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4123fff640 1 -- 172.21.15.81:0/3406414286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f413c01a860 con 0x564ad6fb80a0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f413c00cb80 con 0x564ad6fb80a0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4123fff640 1 -- 172.21.15.81:0/3406414286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f413c015040 con 0x564ad6fb80a0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4151744740 10 client.15513 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ad73a59a0 con 0x564ad6fb80a0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.761+0000 7f4123fff640 1 -- 172.21.15.81:0/3406414286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f413c00cb80 con 0x564ad6fb80a0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4123fff640 1 -- 172.21.15.81:0/3406414286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f413c025030 con 0x564ad6fb80a0 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4151744740 10 client.15513 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4151744740 10 client.15513 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4151744740 20 client.15513 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4151744740 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6f9f8e0 0x564ad73a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4151744740 4 client.15513 mds_command: new command op to 24572 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 --> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ad7300b60 con 0x564ad6f9f8e0 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.762+0000 7f4143fff640 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6f9f8e0 0x564ad73a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.763+0000 7f4123fff640 10 client.15513 ms_handle_connect on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.763+0000 7f4143fff640 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6f9f8e0 0x564ad73a8fe0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6ff80af84b8c050 server_cookie=d89371178d8125ef in_seq=0 out_seq=0 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.763+0000 7f4123fff640 1 -- 172.21.15.81:0/3406414286 <== mds.1 v2:172.21.15.164:6836/3749524162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ad7300b60 con 0x564ad6f9f8e0 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.763+0000 7f4123fff640 10 client.15513 handle_command_reply: tid=0 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.763+0000 7f4151744740 1 client.15513 shutdown 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 msgr2=0x564ad7396bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7396bb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a140 tx=0x7f413c00a270 comp rx=0 tx=0).stop 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 shutdown_connections 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6f9f8e0 0x564ad73a8fe0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6fe0f60 0x564ad73a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad7397190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4123fff640 0 client.15513 ms_handle_reset on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 --2- 172.21.15.81:0/3406414286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7396bb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 >> 172.21.15.81:0/3406414286 conn(0x564ad6fd5350 msgr2=0x564ad73888f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 shutdown_connections 2024-09-21T03:00:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 1 -- 172.21.15.81:0/3406414286 wait complete. 2024-09-21T03:00:48.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.764+0000 7f4151744740 20 client.15513 trim_cache size 0 max 16384 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 Processor -- start 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 -- start start 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad738cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7391d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ad73a7320 con 0x564ad6fb80a0 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564ad73a79f0 con 0x564ad6fc0280 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4151744740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ad73a80c0 con 0x564ad6f9f8e0 2024-09-21T03:00:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7391d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7391d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54066/0 (socket says 172.21.15.81:54066) 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 -- 172.21.15.81:0/3369750026 learned_addr learned my addr 172.21.15.81:0/3369750026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f414976d640 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f414976d640 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad738cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 -- 172.21.15.81:0/3369750026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 msgr2=0x564ad738cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad738cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 -- 172.21.15.81:0/3369750026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 msgr2=0x564ad73922a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73922a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f4143fff640 1 -- 172.21.15.81:0/3369750026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad73950b0 con 0x564ad6fb80a0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.782+0000 7f414976d640 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad738cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.783+0000 7f4143fff640 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7391d60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4144079be0 tx=0x7f412c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e08f259a29c379b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.783+0000 7f413a7fc640 1 -- 172.21.15.81:0/3369750026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c01f070 con 0x564ad6fb80a0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.783+0000 7f413a7fc640 1 -- 172.21.15.81:0/3369750026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f412c011c50 con 0x564ad6fb80a0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.783+0000 7f413a7fc640 1 -- 172.21.15.81:0/3369750026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c010cd0 con 0x564ad6fb80a0 2024-09-21T03:00:48.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 -- 172.21.15.81:0/3369750026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 msgr2=0x564ad7391d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7391d60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4144079be0 tx=0x7f412c009680 comp rx=0 tx=0).stop 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 -- 172.21.15.81:0/3369750026 shutdown_connections 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73922a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad7391d60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 --2- 172.21.15.81:0/3369750026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad738cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 -- 172.21.15.81:0/3369750026 >> 172.21.15.81:0/3369750026 conn(0x564ad6fd5350 msgr2=0x564ad738c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 -- 172.21.15.81:0/3369750026 shutdown_connections 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 -- 172.21.15.81:0/3369750026 wait complete. 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 -- start start 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.784+0000 7f4151744740 1 Processor -- start 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4151744740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad73ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4151744740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad73ac570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4151744740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4151744740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564ad73a8e60 con 0x564ad6fb80a0 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4151744740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564ad73a8790 con 0x564ad6fc0280 2024-09-21T03:00:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4151744740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564ad73a9530 con 0x564ad6f9f8e0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4151744740 10 client.0 _ll_register_callbacks cb 0x7f413c00a7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad73ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad73ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54076/0 (socket says 172.21.15.81:54076) 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 -- 172.21.15.81:0/2244523564 learned_addr learned my addr 172.21.15.81:0/2244523564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f414976d640 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f414976d640 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad73ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 -- 172.21.15.81:0/2244523564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 msgr2=0x564ad73ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad73ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 -- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 msgr2=0x564ad73acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 -- 172.21.15.81:0/2244523564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad73b1230 con 0x564ad6fb80a0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4143fff640 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad73ac570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f412c009f90 tx=0x7f412c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4360983567d06a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4123fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.785+0000 7f4123fff640 1 -- 172.21.15.81:0/2244523564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c031060 con 0x564ad6fb80a0 2024-09-21T03:00:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4123fff640 1 -- 172.21.15.81:0/2244523564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f412c010c50 con 0x564ad6fb80a0 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412c011c50 con 0x564ad6fb80a0 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4123fff640 1 -- 172.21.15.81:0/2244523564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f412c038050 con 0x564ad6fb80a0 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 10 client.15519 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ad74147f0 con 0x564ad6fb80a0 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4123fff640 1 -- 172.21.15.81:0/2244523564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f412c011c50 con 0x564ad6fb80a0 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4123fff640 1 -- 172.21.15.81:0/2244523564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f412c00f040 con 0x564ad6fb80a0 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 10 client.15519 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 10 client.15519 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 20 client.15519 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6fe0f60 0x564ad7417cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 4 client.15519 mds_command: new command op to 24572 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 --> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] -- command(tid 0: {"prefix": "status"}) -- 0x564ad72fc610 con 0x564ad6fe0f60 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.786+0000 7f414976d640 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6fe0f60 0x564ad7417cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4123fff640 10 client.15519 ms_handle_connect on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:48.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f414976d640 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6fe0f60 0x564ad7417cd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=270ca46441c75c42 server_cookie=c91c300b8ebee30 in_seq=0 out_seq=0 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4123fff640 1 -- 172.21.15.81:0/2244523564 <== mds.1 v2:172.21.15.164:6836/3749524162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564ad72fc610 con 0x564ad6fe0f60 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4123fff640 10 client.15519 handle_command_reply: tid=0 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 client.15519 shutdown 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 msgr2=0x564ad73ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad73ac570 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f412c009f90 tx=0x7f412c011e80 comp rx=0 tx=0).stop 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 shutdown_connections 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:6836/3749524162,v1:172.21.15.164:6837/3749524162] conn(0x564ad6fe0f60 0x564ad7417cd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564ad6fc0280 0x564ad73acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ad6fb80a0 0x564ad73ac570 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 --2- 172.21.15.81:0/2244523564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564ad6f9f8e0 0x564ad73ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 >> 172.21.15.81:0/2244523564 conn(0x564ad6fd5350 msgr2=0x564ad7396b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4123fff640 0 client.15519 ms_handle_reset on v2:172.21.15.164:6836/3749524162 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.787+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 shutdown_connections 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f4151744740 1 -- 172.21.15.81:0/2244523564 wait complete. 2024-09-21T03:00:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f4151744740 20 client.15519 trim_cache size 0 max 16384 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24572, 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 118.65446454400001, 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 25, 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:48.796 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 174.85033303899999 2024-09-21T03:00:48.797 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:48.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41300b6510 msgr2=0x7f41300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41300b6510 0x7f41300b8a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x564ad7385b80 tx=0x7f4134009260 comp rx=0 tx=0).stop 2024-09-21T03:00:48.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 msgr2=0x7f414419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:48.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f414419a420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4134009230 tx=0x7f4134004270 comp rx=0 tx=0).stop 2024-09-21T03:00:48.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 shutdown_connections 2024-09-21T03:00:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f41300b6510 0x7f41300b8a20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4144108cf0 0x7f414419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41441083a0 0x7f414419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 --2- 172.21.15.81:0/656534482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4144102a60 0x7f414419a420 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 >> 172.21.15.81:0/656534482 conn(0x7f4144079730 msgr2=0x7f4144101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.788+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 shutdown_connections 2024-09-21T03:00:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:48.789+0000 7f414b1d0640 1 -- 172.21.15.81:0/656534482 wait complete. 2024-09-21T03:00:49.529 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:49 smithi081 ceph-mon[30991]: pgmap v372: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T03:00:49.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:00:49.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:49 smithi164 ceph-mon[34236]: pgmap v372: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T03:00:49.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:49 smithi181 ceph-mon[34096]: pgmap v372: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T03:00:49.804 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:00:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 -- 172.21.15.81:0/2022118008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec1020d0 msgr2=0x7fdfec1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/2022118008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec1020d0 0x7fdfec1024e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009900 tx=0x7fdfdc02a410 comp rx=0 tx=0).stop 2024-09-21T03:00:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 -- 172.21.15.81:0/2022118008 shutdown_connections 2024-09-21T03:00:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/2022118008 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec1062c0 0x7fdfec1066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/2022118008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec106c10 0x7fdfec110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/2022118008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec1020d0 0x7fdfec1024e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 -- 172.21.15.81:0/2022118008 >> 172.21.15.81:0/2022118008 conn(0x7fdfec077cc0 msgr2=0x7fdfec078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 -- 172.21.15.81:0/2022118008 shutdown_connections 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.299+0000 7fdff1cf5640 1 -- 172.21.15.81:0/2022118008 wait complete. 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 Processor -- start 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 -- start start 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec1020d0 0x7fdfec19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec1062c0 0x7fdfec19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec106c10 0x7fdfec19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec113990 con 0x7fdfec106c10 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec113810 con 0x7fdfec1020d0 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdff1cf5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec113b10 con 0x7fdfec1062c0 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.300+0000 7fdfebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec106c10 0x7fdfec19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec106c10 0x7fdfec19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54088/0 (socket says 172.21.15.81:54088) 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 -- 172.21.15.81:0/1373445147 learned_addr learned my addr 172.21.15.81:0/1373445147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec1062c0 0x7fdfec19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec1020d0 0x7fdfec19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 -- 172.21.15.81:0/1373445147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec1062c0 msgr2=0x7fdfec19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec1062c0 0x7fdfec19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 -- 172.21.15.81:0/1373445147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec1020d0 msgr2=0x7fdfec19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec1020d0 0x7fdfec19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 -- 172.21.15.81:0/1373445147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec1a0350 con 0x7fdfec106c10 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfebfff640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec106c10 0x7fdfec19fc20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400eb10 tx=0x7fdfe400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfe97fa640 1 -- 172.21.15.81:0/1373445147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4004b20 con 0x7fdfec106c10 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec1a0640 con 0x7fdfec106c10 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfe97fa640 1 -- 172.21.15.81:0/1373445147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfe4004cc0 con 0x7fdfec106c10 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdfe97fa640 1 -- 172.21.15.81:0/1373445147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4010690 con 0x7fdfec106c10 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.301+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec1a6da0 con 0x7fdfec106c10 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdfe97fa640 1 -- 172.21.15.81:0/1373445147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdfe4005020 con 0x7fdfec106c10 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 Processor -- start 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 -- start start 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d170cf60 0x55a4d1ab2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16e40a0 0x55a4d1ab3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ab3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1a2ac10 con 0x55a4d16ec280 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1a1a040 con 0x55a4d170cf60 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdff8269740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1a1de50 con 0x55a4d16e40a0 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdfe2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ab3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdfe2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ab3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54090/0 (socket says 172.21.15.81:54090) 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.304+0000 7fdfe2ffd640 1 -- 172.21.15.81:0/3128117164 learned_addr learned my addr 172.21.15.81:0/3128117164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe97fa640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfcc0b6510 0x7fdfcc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d170cf60 0x55a4d1ab2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16e40a0 0x55a4d1ab3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfebfff640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfcc0b6510 0x7fdfcc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe2ffd640 1 -- 172.21.15.81:0/3128117164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16e40a0 msgr2=0x55a4d1ab3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16e40a0 0x55a4d1ab3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe2ffd640 1 -- 172.21.15.81:0/3128117164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d170cf60 msgr2=0x55a4d1ab2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d170cf60 0x55a4d1ab2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe2ffd640 1 -- 172.21.15.81:0/3128117164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4d1778540 con 0x55a4d16ec280 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe97fa640 1 -- 172.21.15.81:0/1373445147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fdfe40e7cb0 con 0x7fdfec106c10 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ab3980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4005d00 tx=0x7fdfd4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523f82a6c638943d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfebfff640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfcc0b6510 0x7fdfcc0b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40ad800 tx=0x7fdfe407ae30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe1ffb640 1 -- 172.21.15.81:0/3128117164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4012ca0 con 0x55a4d16ec280 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe1ffb640 1 -- 172.21.15.81:0/3128117164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfd4012e40 con 0x55a4d16ec280 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.305+0000 7fdfe1ffb640 1 -- 172.21.15.81:0/3128117164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4004a00 con 0x55a4d16ec280 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 -- 172.21.15.81:0/3128117164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 msgr2=0x55a4d1ab3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ab3980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4005d00 tx=0x7fdfd4005c90 comp rx=0 tx=0).stop 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 -- 172.21.15.81:0/3128117164 shutdown_connections 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16e40a0 0x55a4d1ab3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ab3980 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 --2- 172.21.15.81:0/3128117164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d170cf60 0x55a4d1ab2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 -- 172.21.15.81:0/3128117164 >> 172.21.15.81:0/3128117164 conn(0x55a4d1701350 msgr2=0x55a4d1ab0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 -- 172.21.15.81:0/3128117164 shutdown_connections 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.306+0000 7fdff8269740 1 -- 172.21.15.81:0/3128117164 wait complete. 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 -- start start 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 Processor -- start 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16e40a0 0x55a4d1ac2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ac3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d170cf60 0x55a4d1aced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4d187b5f0 con 0x55a4d16ec280 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a4d19b5010 con 0x55a4d16e40a0 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1ac59e0 con 0x55a4d170cf60 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdff8269740 10 client.0 _ll_register_callbacks cb 0x55a4d1a14340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdfeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ac3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdfeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ac3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54104/0 (socket says 172.21.15.81:54104) 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.307+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1363223763 learned_addr learned my addr 172.21.15.81:0/1363223763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d170cf60 0x55a4d1aced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16e40a0 0x55a4d1ac2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1363223763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d170cf60 msgr2=0x55a4d1aced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d170cf60 0x55a4d1aced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16e40a0 msgr2=0x55a4d1ac2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16e40a0 0x55a4d1ac2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1363223763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4d19e2a00 con 0x55a4d16ec280 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ac3310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009900 tx=0x7fdfdc0316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491f7674bcb72cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1363223763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc035040 con 0x55a4d16ec280 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1363223763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fdfdc004040 con 0x55a4d16ec280 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4d1a2cb60 con 0x55a4d16ec280 2024-09-21T03:00:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1363223763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdfdc004240 con 0x55a4d16ec280 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdff8269740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.308+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a4d1ad1940 con 0x55a4d16ec280 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1363223763 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a4d1a2cb60 con 0x55a4d16ec280 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1363223763 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdfdc004930 con 0x55a4d16ec280 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdff8269740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdff8269740 10 client.15531 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdff8269740 20 client.15531 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdff8269740 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d16cb8e0 0x55a4d1ad53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdff8269740 4 client.15531 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4d1a28610 con 0x55a4d16cb8e0 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.309+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d16cb8e0 0x55a4d1ad53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.310+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d16cb8e0 0x55a4d1ad53f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e5ac152f72a1e40 server_cookie=df8feadbc4cbed67 in_seq=0 out_seq=0 2024-09-21T03:00:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.310+0000 7fdfdaffd640 10 client.15531 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:50.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.310+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1363223763 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4d1a28610 con 0x55a4d16cb8e0 2024-09-21T03:00:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.310+0000 7fdfdaffd640 10 client.15531 handle_command_reply: tid=0 2024-09-21T03:00:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 client.15531 shutdown 2024-09-21T03:00:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 msgr2=0x55a4d1ac3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ac3310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009900 tx=0x7fdfdc0316a0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 shutdown_connections 2024-09-21T03:00:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d16cb8e0 0x55a4d1ad53f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdfdaffd640 0 client.15531 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d170cf60 0x55a4d1aced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16ec280 0x55a4d1ac3310 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 --2- 172.21.15.81:0/1363223763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16e40a0 0x55a4d1ac2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 >> 172.21.15.81:0/1363223763 conn(0x55a4d1701350 msgr2=0x55a4d1ab48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 shutdown_connections 2024-09-21T03:00:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 1 -- 172.21.15.81:0/1363223763 wait complete. 2024-09-21T03:00:50.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.311+0000 7fdff8269740 20 client.15531 trim_cache size 0 max 16384 2024-09-21T03:00:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 Processor -- start 2024-09-21T03:00:50.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 -- start start 2024-09-21T03:00:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16cb8e0 0x55a4d1acecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1acf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16ec280 0x55a4d1ac2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1ad3730 con 0x55a4d16e40a0 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1ad3e00 con 0x55a4d16cb8e0 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdff8269740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1ad44d0 con 0x55a4d16ec280 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1acf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1acf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54108/0 (socket says 172.21.15.81:54108) 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/331421097 learned_addr learned my addr 172.21.15.81:0/331421097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16cb8e0 0x55a4d1acecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/331421097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16ec280 msgr2=0x55a4d1ac2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16ec280 0x55a4d1ac2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/331421097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16cb8e0 msgr2=0x55a4d1acecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16cb8e0 0x55a4d1acecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.329+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/331421097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4d1ac5450 con 0x55a4d16e40a0 2024-09-21T03:00:50.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.330+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1acf1f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009850 tx=0x7fdfdc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83f41eba108a2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.330+0000 7fdfe17fa640 1 -- 172.21.15.81:0/331421097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc057070 con 0x55a4d16e40a0 2024-09-21T03:00:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.330+0000 7fdfe17fa640 1 -- 172.21.15.81:0/331421097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfdc0035f0 con 0x55a4d16e40a0 2024-09-21T03:00:50.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.330+0000 7fdfe17fa640 1 -- 172.21.15.81:0/331421097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc035070 con 0x55a4d16e40a0 2024-09-21T03:00:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 -- 172.21.15.81:0/331421097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 msgr2=0x55a4d1acf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1acf1f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009850 tx=0x7fdfdc001e70 comp rx=0 tx=0).stop 2024-09-21T03:00:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 -- 172.21.15.81:0/331421097 shutdown_connections 2024-09-21T03:00:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16ec280 0x55a4d1ac2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1acf1f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 --2- 172.21.15.81:0/331421097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16cb8e0 0x55a4d1acecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 -- 172.21.15.81:0/331421097 >> 172.21.15.81:0/331421097 conn(0x55a4d1701350 msgr2=0x55a4d1abdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 -- 172.21.15.81:0/331421097 shutdown_connections 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 -- 172.21.15.81:0/331421097 wait complete. 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 -- start start 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.331+0000 7fdff8269740 1 Processor -- start 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdff8269740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16cb8e0 0x55a4d1adde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdff8269740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1ad72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdff8269740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16ec280 0x55a4d1ad77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdff8269740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1ad5270 con 0x55a4d16e40a0 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdff8269740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1ad4ba0 con 0x55a4d16ec280 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdff8269740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a4d1ad5940 con 0x55a4d16cb8e0 2024-09-21T03:00:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdff8269740 10 client.0 _ll_register_callbacks cb 0x7fdfdc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1ad72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1ad72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54120/0 (socket says 172.21.15.81:54120) 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1158416899 learned_addr learned my addr 172.21.15.81:0/1158416899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16ec280 0x55a4d1ad77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16cb8e0 0x55a4d1adde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1158416899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16cb8e0 msgr2=0x55a4d1adde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16cb8e0 0x55a4d1adde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16ec280 msgr2=0x55a4d1ad77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16ec280 0x55a4d1ad77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 -- 172.21.15.81:0/1158416899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4d1ad7f00 con 0x55a4d16e40a0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfeb7fe640 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1ad72b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc032f10 tx=0x7fdfdc0092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b974d5c26547942 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.332+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1158416899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc060060 con 0x55a4d16e40a0 2024-09-21T03:00:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1158416899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fdfdc0048c0 con 0x55a4d16e40a0 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfdc0035f0 con 0x55a4d16e40a0 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1158416899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdfdc067050 con 0x55a4d16e40a0 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 10 client.15537 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a4d1b408c0 con 0x55a4d16e40a0 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1158416899 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfdc0035f0 con 0x55a4d16e40a0 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1158416899 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdfdc005030 con 0x55a4d16e40a0 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 10 client.15537 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 10 client.15537 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 20 client.15537 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d170cf60 0x55a4d1b43c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 4 client.15537 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.333+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "status"}) -- 0x55a4d1a25a40 con 0x55a4d170cf60 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d170cf60 0x55a4d1b43c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdfe2ffd640 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d170cf60 0x55a4d1b43c80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b80023bfc2585f6e server_cookie=629102863236fa15 in_seq=0 out_seq=0 2024-09-21T03:00:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdfdaffd640 10 client.15537 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdfdaffd640 1 -- 172.21.15.81:0/1158416899 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a4d1a25a40 con 0x55a4d170cf60 2024-09-21T03:00:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdfdaffd640 10 client.15537 handle_command_reply: tid=0 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 client.15537 shutdown 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 msgr2=0x55a4d1ad72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1ad72b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc032f10 tx=0x7fdfdc0092a0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 shutdown_connections 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a4d170cf60 0x55a4d1b43c80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a4d16ec280 0x55a4d1ad77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4d16e40a0 0x55a4d1ad72b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdfdaffd640 0 client.15537 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.334+0000 7fdff8269740 1 --2- 172.21.15.81:0/1158416899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a4d16cb8e0 0x55a4d1adde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 >> 172.21.15.81:0/1158416899 conn(0x55a4d1701350 msgr2=0x55a4d1ac2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 shutdown_connections 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff8269740 1 -- 172.21.15.81:0/1158416899 wait complete. 2024-09-21T03:00:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff8269740 20 client.15537 trim_cache size 0 max 16384 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0bfe3ac0-77c4-11ef-baf5-efdc52797490", 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24599, 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 154.30115803499999, 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 25, 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 82, 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 165.09951138700001 2024-09-21T03:00:50.341 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:00:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfcc0b6510 msgr2=0x7fdfcc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfcc0b6510 0x7fdfcc0b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40ad800 tx=0x7fdfe407ae30 comp rx=0 tx=0).stop 2024-09-21T03:00:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec106c10 msgr2=0x7fdfec19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec106c10 0x7fdfec19fc20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400eb10 tx=0x7fdfe400c2d0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 shutdown_connections 2024-09-21T03:00:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfcc0b6510 0x7fdfcc0b8a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfec1062c0 0x7fdfec19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfec106c10 0x7fdfec19fc20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 --2- 172.21.15.81:0/1373445147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec1020d0 0x7fdfec19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.335+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 >> 172.21.15.81:0/1373445147 conn(0x7fdfec077cc0 msgr2=0x7fdfec107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.336+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 shutdown_connections 2024-09-21T03:00:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:00:50.336+0000 7fdff1cf5640 1 -- 172.21.15.81:0/1373445147 wait complete. 2024-09-21T03:00:51.216 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T03:00:51.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:51 smithi164 ceph-mon[34236]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-21T03:00:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:51 smithi181 ceph-mon[34096]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-21T03:00:51.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:51 smithi081 ceph-mon[30991]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-21T03:00:53.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:53 smithi164 ceph-mon[34236]: pgmap v374: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-09-21T03:00:53.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:53 smithi181 ceph-mon[34096]: pgmap v374: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-09-21T03:00:53.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:53 smithi081 ceph-mon[30991]: pgmap v374: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-09-21T03:00:55.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:55 smithi164 ceph-mon[34236]: pgmap v375: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-09-21T03:00:55.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:55 smithi181 ceph-mon[34096]: pgmap v375: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-09-21T03:00:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:55 smithi081 ceph-mon[30991]: pgmap v375: 129 pgs: 129 active+clean; 662 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-09-21T03:00:57.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:57 smithi164 ceph-mon[34236]: pgmap v376: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-21T03:00:57.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:57 smithi181 ceph-mon[34096]: pgmap v376: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-21T03:00:57.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:57 smithi081 ceph-mon[30991]: pgmap v376: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-21T03:00:59.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:00:59 smithi164 ceph-mon[34236]: pgmap v377: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 -- 172.21.15.81:0/112872264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac108300 msgr2=0x7fe6ac10a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 --2- 172.21.15.81:0/112872264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac108300 0x7fe6ac10a810 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009ca0 tx=0x7fe6a402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 -- 172.21.15.81:0/112872264 shutdown_connections 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 --2- 172.21.15.81:0/112872264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6ac1056e0 0x7fe6ac107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 --2- 172.21.15.81:0/112872264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac108300 0x7fe6ac10a810 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 --2- 172.21.15.81:0/112872264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6ac102c60 0x7fe6ac1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 -- 172.21.15.81:0/112872264 >> 172.21.15.81:0/112872264 conn(0x7fe6ac0fd6d0 msgr2=0x7fe6ac0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 -- 172.21.15.81:0/112872264 shutdown_connections 2024-09-21T03:00:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 -- 172.21.15.81:0/112872264 wait complete. 2024-09-21T03:00:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.694+0000 7fe6b372b640 1 Processor -- start 2024-09-21T03:00:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b372b640 1 -- start start 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b372b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6ac102c60 0x7fe6ac198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b372b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac1056e0 0x7fe6ac199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b372b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6ac108300 0x7fe6ac199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b372b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac10e110 con 0x7fe6ac1056e0 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b372b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac10df90 con 0x7fe6ac102c60 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b372b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac10e290 con 0x7fe6ac108300 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac1056e0 0x7fe6ac199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac1056e0 0x7fe6ac199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51452/0 (socket says 172.21.15.81:51452) 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/1253558502 learned_addr learned my addr 172.21.15.81:0/1253558502 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6ac108300 0x7fe6ac199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6ac102c60 0x7fe6ac198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/1253558502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6ac108300 msgr2=0x7fe6ac199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6ac108300 0x7fe6ac199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/1253558502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6ac102c60 msgr2=0x7fe6ac198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6ac102c60 0x7fe6ac198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/1253558502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac19a740 con 0x7fe6ac1056e0 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6ac102c60 0x7fe6ac198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.695+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac1056e0 0x7fe6ac199370 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009860 tx=0x7fe69c009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.696+0000 7fe6a27fc640 1 -- 172.21.15.81:0/1253558502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c005020 con 0x7fe6ac1056e0 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.696+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac19aa30 con 0x7fe6ac1056e0 2024-09-21T03:00:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.696+0000 7fe6a27fc640 1 -- 172.21.15.81:0/1253558502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe69c0047a0 con 0x7fe6ac1056e0 2024-09-21T03:00:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.696+0000 7fe6a27fc640 1 -- 172.21.15.81:0/1253558502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c007a00 con 0x7fe6ac1056e0 2024-09-21T03:00:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.696+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac101a90 con 0x7fe6ac1056e0 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 Processor -- start 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 -- start start 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb3b81b0 0x560adb75fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb38f2f0 0x560adb7604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 0x560adb761010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560adb6d26f0 con 0x560adb38f2f0 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560adb6c1b20 con 0x560adb3b81b0 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.698+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560adb6c5930 con 0x560adb3974d0 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb38f2f0 0x560adb7604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb38f2f0 0x560adb7604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51460/0 (socket says 172.21.15.81:51460) 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 -- 172.21.15.81:0/131391152 learned_addr learned my addr 172.21.15.81:0/131391152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb3b81b0 0x560adb75fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6a27fc640 1 -- 172.21.15.81:0/1253558502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe69c007ba0 con 0x7fe6ac1056e0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 -- 172.21.15.81:0/131391152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 msgr2=0x560adb761010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 0x560adb761010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 -- 172.21.15.81:0/131391152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb3b81b0 msgr2=0x560adb75fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb3b81b0 0x560adb75fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 -- 172.21.15.81:0/131391152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560adb687530 con 0x560adb38f2f0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb3b81b0 0x560adb75fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb38f2f0 0x560adb7604c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009c30 tx=0x7fe6a8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e409783ac3673f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6977fe640 1 -- 172.21.15.81:0/131391152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8004030 con 0x560adb38f2f0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6977fe640 1 -- 172.21.15.81:0/131391152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a80035f0 con 0x560adb38f2f0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.699+0000 7fe6977fe640 1 -- 172.21.15.81:0/131391152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8012650 con 0x560adb38f2f0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6a27fc640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6980b6510 0x7fe6980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6980b6510 0x7fe6980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6a27fc640 1 -- 172.21.15.81:0/1253558502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe69c0e8bc0 con 0x7fe6ac1056e0 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 -- 172.21.15.81:0/131391152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb38f2f0 msgr2=0x560adb7604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6980b6510 0x7fe6980b8a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4031920 tx=0x7fe6a4031980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb38f2f0 0x560adb7604c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009c30 tx=0x7fe6a8010740 comp rx=0 tx=0).stop 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 -- 172.21.15.81:0/131391152 shutdown_connections 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 0x560adb761010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb38f2f0 0x560adb7604c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/131391152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb3b81b0 0x560adb75fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 -- 172.21.15.81:0/131391152 >> 172.21.15.81:0/131391152 conn(0x560adb3ac300 msgr2=0x560adb75b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 -- 172.21.15.81:0/131391152 shutdown_connections 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.700+0000 7fe6ba69b740 1 -- 172.21.15.81:0/131391152 wait complete. 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 -- start start 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 Processor -- start 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 0x560adb769d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3b81b0 0x560adb76a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560adb5f9ab0 con 0x560adb3b81b0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560adb667730 con 0x560adb38f2f0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560adb761b30 con 0x560adb3974d0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6ba69b740 10 client.0 _ll_register_callbacks cb 0x560adb6bb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6b1cc8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3b81b0 0x560adb76a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6b1cc8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3b81b0 0x560adb76a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51470/0 (socket says 172.21.15.81:51470) 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.701+0000 7fe6b1cc8640 1 -- 172.21.15.81:0/2639957356 learned_addr learned my addr 172.21.15.81:0/2639957356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 0x560adb769d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b1cc8640 1 -- 172.21.15.81:0/2639957356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 msgr2=0x560adb769d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 0x560adb769d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b1cc8640 1 -- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 msgr2=0x560adb7696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b1cc8640 1 -- 172.21.15.81:0/2639957356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560adb423790 con 0x560adb3b81b0 2024-09-21T03:00:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3b81b0 0x560adb76a890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4035000 tx=0x7fe6a402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2185f4b33d254ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe694ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe694ff9640 1 -- 172.21.15.81:0/2639957356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4009360 con 0x560adb3b81b0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe694ff9640 1 -- 172.21.15.81:0/2639957356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe6a4004250 con 0x560adb3b81b0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a80035f0 con 0x560adb3b81b0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.702+0000 7fe694ff9640 1 -- 172.21.15.81:0/2639957356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6a4004450 con 0x560adb3b81b0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 10 client.15549 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560adb49c620 con 0x560adb3b81b0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe694ff9640 1 -- 172.21.15.81:0/2639957356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a80035f0 con 0x560adb3b81b0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe694ff9640 1 -- 172.21.15.81:0/2639957356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe6a4051070 con 0x560adb3b81b0 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 10 client.15549 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 20 client.15549 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb376d80 0x560adb776dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 4 client.15549 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560adb6d4640 con 0x560adb376d80 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.703+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb376d80 0x560adb776dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.704+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb376d80 0x560adb776dd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fbf076a0e0416ea server_cookie=44ac8e04a68ea7d7 in_seq=0 out_seq=0 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.704+0000 7fe694ff9640 10 client.15549 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.704+0000 7fe694ff9640 1 -- 172.21.15.81:0/2639957356 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560adb6d4640 con 0x560adb376d80 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.704+0000 7fe694ff9640 10 client.15549 handle_command_reply: tid=0 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.704+0000 7fe6ba69b740 1 client.15549 shutdown 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3b81b0 msgr2=0x560adb76a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3b81b0 0x560adb76a890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4035000 tx=0x7fe6a402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 shutdown_connections 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb376d80 0x560adb776dd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3974d0 0x560adb769d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3b81b0 0x560adb76a890 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2639957356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe694ff9640 0 client.15549 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 >> 172.21.15.81:0/2639957356 conn(0x560adb3ac300 msgr2=0x560adb75c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 shutdown_connections 2024-09-21T03:00:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2639957356 wait complete. 2024-09-21T03:00:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.705+0000 7fe6ba69b740 20 client.15549 trim_cache size 0 max 16384 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.719+0000 7fe6ba69b740 1 Processor -- start 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.719+0000 7fe6ba69b740 1 -- start start 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.719+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb75b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb75b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1acae0 con 0x560adb3974d0 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1aa3b0 con 0x560adb38f2f0 2024-09-21T03:00:59.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1a8200 con 0x560adb3b81b0 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb75b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb75b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51476/0 (socket says 172.21.15.81:51476) 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/2780373006 learned_addr learned my addr 172.21.15.81:0/2780373006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/2780373006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 msgr2=0x560adb75b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb75b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/2780373006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 msgr2=0x560adb7682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/2780373006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560adb767860 con 0x560adb3974d0 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb75b220 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0aafe0 tx=0x7fe69c0ae240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2d9ea1a95f8cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:59.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe696ffd640 1 -- 172.21.15.81:0/2780373006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0ae520 con 0x560adb3974d0 2024-09-21T03:00:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe696ffd640 1 -- 172.21.15.81:0/2780373006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe69c0af110 con 0x560adb3974d0 2024-09-21T03:00:59.724 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.720+0000 7fe696ffd640 1 -- 172.21.15.81:0/2780373006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0aac80 con 0x560adb3974d0 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2780373006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 msgr2=0x560adb75b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb75b220 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0aafe0 tx=0x7fe69c0ae240 comp rx=0 tx=0).stop 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2780373006 shutdown_connections 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb75b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb75b220 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/2780373006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb7682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2780373006 >> 172.21.15.81:0/2780373006 conn(0x560adb3ac300 msgr2=0x560adb767be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:59.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2780373006 shutdown_connections 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 -- 172.21.15.81:0/2780373006 wait complete. 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 -- start start 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.721+0000 7fe6ba69b740 1 Processor -- start 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb771540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb770200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6ba69b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb770850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1a8870 con 0x560adb3974d0 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1a9ce0 con 0x560adb38f2f0 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6ba69b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1a8f40 con 0x560adb3b81b0 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6ba69b740 10 client.0 _ll_register_callbacks cb 0x7fe6a4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb770200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb770200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51492/0 (socket says 172.21.15.81:51492) 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/4195622964 learned_addr learned my addr 172.21.15.81:0/4195622964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:00:59.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb770850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb771540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/4195622964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 msgr2=0x560adb770850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb770850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 msgr2=0x560adb771540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb771540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 -- 172.21.15.81:0/4195622964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560adb770fc0 con 0x560adb3974d0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b1cc8640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb770850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe6b0cc6640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb770200 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0b3460 tx=0x7fe69c0b8430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156540bfff674f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.722+0000 7fe694ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe694ff9640 1 -- 172.21.15.81:0/4195622964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0ade70 con 0x560adb3974d0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe694ff9640 1 -- 172.21.15.81:0/4195622964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe69c0aa360 con 0x560adb3974d0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe69c0af110 con 0x560adb3974d0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe694ff9640 1 -- 172.21.15.81:0/4195622964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe69c0b34f0 con 0x560adb3974d0 2024-09-21T03:00:59.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 10 client.15555 fetch_fsmap learned FSMap version 25 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560adb7e17f0 con 0x560adb3974d0 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe694ff9640 1 -- 172.21.15.81:0/4195622964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe69c0af110 con 0x560adb3974d0 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe694ff9640 1 -- 172.21.15.81:0/4195622964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe69c0b4680 con 0x560adb3974d0 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 10 client.15555 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 20 client.15555 populate_metadata read hostname 'smithi081' 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb34c1c0 0x560adb7e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 4 client.15555 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560adb6d00f0 con 0x560adb34c1c0 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.723+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb34c1c0 0x560adb7e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.724+0000 7fe694ff9640 10 client.15555 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.724+0000 7fe6b14c7640 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb34c1c0 0x560adb7e40a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a379f6d4aa92cbcd server_cookie=d03a37707b35fe19 in_seq=0 out_seq=0 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe694ff9640 1 -- 172.21.15.81:0/4195622964 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560adb6d00f0 con 0x560adb34c1c0 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe694ff9640 10 client.15555 handle_command_reply: tid=0 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 client.15555 shutdown 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 msgr2=0x560adb770200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb770200 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0b3460 tx=0x7fe69c0b8430 comp rx=0 tx=0).stop 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 shutdown_connections 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560adb34c1c0 0x560adb7e40a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560adb3b81b0 0x560adb770850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe694ff9640 0 client.15555 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560adb3974d0 0x560adb770200 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 --2- 172.21.15.81:0/4195622964 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560adb38f2f0 0x560adb771540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 >> 172.21.15.81:0/4195622964 conn(0x560adb3ac300 msgr2=0x560adb763f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 shutdown_connections 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 1 -- 172.21.15.81:0/4195622964 wait complete. 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.732+0000 7fe6ba69b740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:00:59.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:00:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6980b6510 msgr2=0x7fe6980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6980b6510 0x7fe6980b8a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4031920 tx=0x7fe6a4031980 comp rx=0 tx=0).stop 2024-09-21T03:00:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac1056e0 msgr2=0x7fe6ac199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:00:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac1056e0 0x7fe6ac199370 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009860 tx=0x7fe69c009d20 comp rx=0 tx=0).stop 2024-09-21T03:00:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 shutdown_connections 2024-09-21T03:00:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe6980b6510 0x7fe6980b8a20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6ac108300 0x7fe6ac199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac1056e0 0x7fe6ac199370 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 --2- 172.21.15.81:0/1253558502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6ac102c60 0x7fe6ac198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:00:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 >> 172.21.15.81:0/1253558502 conn(0x7fe6ac0fd6d0 msgr2=0x7fe6ac103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:00:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 shutdown_connections 2024-09-21T03:00:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:00:59.733+0000 7fe6b372b640 1 -- 172.21.15.81:0/1253558502 wait complete. 2024-09-21T03:00:59.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:00:59 smithi181 ceph-mon[34096]: pgmap v377: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-21T03:00:59.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:00:59 smithi081 ceph-mon[30991]: pgmap v377: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-21T03:01:01.625 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:01 smithi181 ceph-mon[34096]: pgmap v378: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T03:01:01.626 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:01 smithi164 ceph-mon[34236]: pgmap v378: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T03:01:01.681 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:01 smithi081 ceph-mon[30991]: pgmap v378: 129 pgs: 129 active+clean; 670 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T03:01:03.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:03 smithi164 ceph-mon[34236]: pgmap v379: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T03:01:03.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:03 smithi181 ceph-mon[34096]: pgmap v379: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T03:01:03.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:03 smithi081 ceph-mon[30991]: pgmap v379: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-21T03:01:05.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:05 smithi164 ceph-mon[34236]: pgmap v380: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:01:05.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:05 smithi181 ceph-mon[34096]: pgmap v380: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:01:05.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:05 smithi081 ceph-mon[30991]: pgmap v380: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:01:06.217 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T03:01:06.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:01:06.470 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 -- 172.21.15.81:0/152657815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102a60 msgr2=0x7f2f94102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 --2- 172.21.15.81:0/152657815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102a60 0x7f2f94102e70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009ca0 tx=0x7f2f9002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 -- 172.21.15.81:0/152657815 shutdown_connections 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 --2- 172.21.15.81:0/152657815 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f94108cf0 0x7f2f9410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 --2- 172.21.15.81:0/152657815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f941083a0 0x7f2f941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 --2- 172.21.15.81:0/152657815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94102a60 0x7f2f94102e70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 -- 172.21.15.81:0/152657815 >> 172.21.15.81:0/152657815 conn(0x7f2f94079730 msgr2=0x7f2f94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 -- 172.21.15.81:0/152657815 shutdown_connections 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.042+0000 7f2f9c450640 1 -- 172.21.15.81:0/152657815 wait complete. 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 Processor -- start 2024-09-21T03:01:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 -- start start 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f94102a60 0x7f2f9419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f941083a0 0x7f2f9419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94108cf0 0x7f2f9419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94112860 con 0x7f2f94108cf0 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2f941126e0 con 0x7f2f94102a60 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9c450640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2f941129e0 con 0x7f2f941083a0 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9a9ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94108cf0 0x7f2f9419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9a9ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94108cf0 0x7f2f9419bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42060/0 (socket says 172.21.15.81:42060) 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f9a9ed640 1 -- 172.21.15.81:0/1477934490 learned_addr learned my addr 172.21.15.81:0/1477934490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.043+0000 7f2f999eb640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f941083a0 0x7f2f9419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9a1ec640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f94102a60 0x7f2f9419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9a9ed640 1 -- 172.21.15.81:0/1477934490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f941083a0 msgr2=0x7f2f9419b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9a9ed640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f941083a0 0x7f2f9419b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9a9ed640 1 -- 172.21.15.81:0/1477934490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f94102a60 msgr2=0x7f2f9419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9a9ed640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f94102a60 0x7f2f9419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9a9ed640 1 -- 172.21.15.81:0/1477934490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f941a6420 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9a9ed640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94108cf0 0x7f2f9419bc10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00d750 tx=0x7f2f8c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f8b7fe640 1 -- 172.21.15.81:0/1477934490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c017070 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f941a6710 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f8b7fe640 1 -- 172.21.15.81:0/1477934490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f8c0054b0 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f8b7fe640 1 -- 172.21.15.81:0/1477934490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c004b90 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.044+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941a6c50 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.045+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f94102e70 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.047+0000 7f2f8b7fe640 1 -- 172.21.15.81:0/1477934490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2f8c004d30 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.048+0000 7f2f8b7fe640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f800b6540 0x7f2f800b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.048+0000 7f2f9a1ec640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f800b6540 0x7f2f800b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.048+0000 7f2f8b7fe640 1 -- 172.21.15.81:0/1477934490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2f8c0e7460 con 0x7f2f94108cf0 2024-09-21T03:01:07.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.049+0000 7f2f9a1ec640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f800b6540 0x7f2f800b8a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f90000f80 tx=0x7f2f900093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.051+0000 7f2f8b7fe640 1 -- 172.21.15.81:0/1477934490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f8c0ad950 con 0x7f2f94108cf0 2024-09-21T03:01:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.283+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f9406b270 con 0x7f2f94108cf0 2024-09-21T03:01:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.285+0000 7f2f8b7fe640 1 -- 172.21.15.81:0/1477934490 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f2f8c0b1d30 con 0x7f2f94108cf0 2024-09-21T03:01:07.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:01:07.287 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:01:07.287 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:01:07.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.287+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f800b6540 msgr2=0x7f2f800b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:07.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.287+0000 7f2f9c450640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f800b6540 0x7f2f800b8a50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f90000f80 tx=0x7f2f900093f0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94108cf0 msgr2=0x7f2f9419bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94108cf0 0x7f2f9419bc10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00d750 tx=0x7f2f8c00dc10 comp rx=0 tx=0).stop 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 shutdown_connections 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2f800b6540 0x7f2f800b8a50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2f941083a0 0x7f2f9419b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f94108cf0 0x7f2f9419bc10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 --2- 172.21.15.81:0/1477934490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f94102a60 0x7f2f9419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 >> 172.21.15.81:0/1477934490 conn(0x7f2f94079730 msgr2=0x7f2f941013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 shutdown_connections 2024-09-21T03:01:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:07.288+0000 7f2f9c450640 1 -- 172.21.15.81:0/1477934490 wait complete. 2024-09-21T03:01:07.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:07 smithi081 ceph-mon[30991]: pgmap v381: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T03:01:07.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:07 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1477934490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:07 smithi164 ceph-mon[34236]: pgmap v381: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T03:01:07.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:07 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1477934490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:07.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:07 smithi181 ceph-mon[34096]: pgmap v381: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T03:01:07.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:07 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1477934490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:08.098 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T03:01:08.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T03:01:08.366 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:01:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 -- 172.21.15.81:0/1083340202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c1083c0 msgr2=0x7f1a2c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1083340202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c1083c0 0x7f1a2c1087d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009900 tx=0x7f1a1c02a410 comp rx=0 tx=0).stop 2024-09-21T03:01:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 -- 172.21.15.81:0/1083340202 shutdown_connections 2024-09-21T03:01:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1083340202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a2c108d10 0x7f1a2c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1083340202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c1083c0 0x7f1a2c1087d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1083340202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a2c102a80 0x7f1a2c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 -- 172.21.15.81:0/1083340202 >> 172.21.15.81:0/1083340202 conn(0x7f1a2c079760 msgr2=0x7f1a2c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 -- 172.21.15.81:0/1083340202 shutdown_connections 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.915+0000 7f1a3387c640 1 -- 172.21.15.81:0/1083340202 wait complete. 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 Processor -- start 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 -- start start 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a2c102a80 0x7f1a2c0ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a2c1083c0 0x7f1a2c0ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c108d10 0x7f1a2c1000b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c112830 con 0x7f1a2c108d10 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1126b0 con 0x7f1a2c102a80 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a3387c640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1129b0 con 0x7f1a2c1083c0 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.916+0000 7f1a31e19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c108d10 0x7f1a2c1000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c108d10 0x7f1a2c1000b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42076/0 (socket says 172.21.15.81:42076) 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 -- 172.21.15.81:0/1863654466 learned_addr learned my addr 172.21.15.81:0/1863654466 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a30e17640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a2c1083c0 0x7f1a2c0ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31618640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a2c102a80 0x7f1a2c0ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 -- 172.21.15.81:0/1863654466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a2c1083c0 msgr2=0x7f1a2c0ffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a2c1083c0 0x7f1a2c0ffb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 -- 172.21.15.81:0/1863654466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a2c102a80 msgr2=0x7f1a2c0ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a2c102a80 0x7f1a2c0ff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 -- 172.21.15.81:0/1863654466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c1a8600 con 0x7f1a2c108d10 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31618640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a2c102a80 0x7f1a2c0ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a31e19640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c108d10 0x7f1a2c1000b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400cce0 tx=0x7f1a2400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a227fc640 1 -- 172.21.15.81:0/1863654466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400f450 con 0x7f1a2c108d10 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c1a88f0 con 0x7f1a2c108d10 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a227fc640 1 -- 172.21.15.81:0/1863654466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a2400fa80 con 0x7f1a2c108d10 2024-09-21T03:01:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a227fc640 1 -- 172.21.15.81:0/1863654466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24018ad0 con 0x7f1a2c108d10 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.917+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c1a8db0 con 0x7f1a2c108d10 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.920+0000 7f1a39df0740 1 Processor -- start 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a227fc640 1 -- 172.21.15.81:0/1863654466 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1a2400f5f0 con 0x7f1a2c108d10 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a39df0740 1 -- start start 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d40600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d40b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d41080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a39df0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564525cb6b90 con 0x564525978b60 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a39df0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564525ca5fc0 con 0x564525970980 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.921+0000 7f1a39df0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564525ca9dd0 con 0x564525999840 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d41080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d41080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42082/0 (socket says 172.21.15.81:42082) 2024-09-21T03:01:08.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 -- 172.21.15.81:0/2816077325 learned_addr learned my addr 172.21.15.81:0/2816077325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d40600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a227fc640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a180b6510 0x7f1a180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 -- 172.21.15.81:0/2816077325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 msgr2=0x564525d40600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d40600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 -- 172.21.15.81:0/2816077325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 msgr2=0x564525d40b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d40b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 -- 172.21.15.81:0/2816077325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564525c2d060 con 0x564525978b60 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a227fc640 1 -- 172.21.15.81:0/1863654466 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1a240e7de0 con 0x7f1a2c108d10 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a30e17640 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d41080 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0096c0 tx=0x7f1a1c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3d7de98d374bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.922+0000 7f1a31e19640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a180b6510 0x7f1a180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.923+0000 7f1a177fe640 1 -- 172.21.15.81:0/2816077325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c035040 con 0x564525978b60 2024-09-21T03:01:08.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.923+0000 7f1a177fe640 1 -- 172.21.15.81:0/2816077325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a1c0044c0 con 0x564525978b60 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.923+0000 7f1a177fe640 1 -- 172.21.15.81:0/2816077325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c003bf0 con 0x564525978b60 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 -- 172.21.15.81:0/2816077325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 msgr2=0x564525d41080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a31e19640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a180b6510 0x7f1a180b8a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1a240e55a0 tx=0x7f1a2400af30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d41080 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0096c0 tx=0x7f1a1c005fd0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 -- 172.21.15.81:0/2816077325 shutdown_connections 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d41080 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d40b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2816077325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d40600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 -- 172.21.15.81:0/2816077325 >> 172.21.15.81:0/2816077325 conn(0x56452598d990 msgr2=0x564525d3e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 -- 172.21.15.81:0/2816077325 shutdown_connections 2024-09-21T03:01:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 -- 172.21.15.81:0/2816077325 wait complete. 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.924+0000 7f1a39df0740 1 -- start start 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 1 Processor -- start 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d4c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d58160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564525b077a0 con 0x564525978b60 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564525c4b0a0 con 0x564525970980 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x564525d4ee20 con 0x564525999840 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a39df0740 10 client.0 _ll_register_callbacks cb 0x564525c283c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a31618640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a31618640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42092/0 (socket says 172.21.15.81:42092) 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a31618640 1 -- 172.21.15.81:0/463719748 learned_addr learned my addr 172.21.15.81:0/463719748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.925+0000 7f1a30e17640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d4c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a30e17640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d58160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a31618640 1 -- 172.21.15.81:0/463719748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 msgr2=0x564525d58160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a31618640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d58160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a31618640 1 -- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 msgr2=0x564525d4c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a31618640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d4c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a31618640 1 -- 172.21.15.81:0/463719748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564525c39880 con 0x564525978b60 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a30e17640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d58160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a31618640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4c650 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800be40 tx=0x7f1a2800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fe5e6e93dc37b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a14ff9640 1 -- 172.21.15.81:0/463719748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28015070 con 0x564525978b60 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a14ff9640 1 -- 172.21.15.81:0/463719748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1a28011850 con 0x564525978b60 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564525cb8ae0 con 0x564525978b60 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a14ff9640 1 -- 172.21.15.81:0/463719748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a28023050 con 0x564525978b60 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a39df0740 10 client.15573 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.926+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564525a13b90 con 0x564525978b60 2024-09-21T03:01:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a14ff9640 1 -- 172.21.15.81:0/463719748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564525cb8ae0 con 0x564525978b60 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a14ff9640 1 -- 172.21.15.81:0/463719748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1a2801aa30 con 0x564525978b60 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a39df0740 10 client.15573 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a39df0740 10 client.15573 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a39df0740 20 client.15573 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a39df0740 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5645259581c0 0x564525d5e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a39df0740 4 client.15573 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564525cb4590 con 0x5645259581c0 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a30e17640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5645259581c0 0x564525d5e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a30e17640 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5645259581c0 0x564525d5e170 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27b16c88c3d3e4f8 server_cookie=30f0ea9bedb25a98 in_seq=0 out_seq=0 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.927+0000 7f1a14ff9640 10 client.15573 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.928+0000 7f1a14ff9640 1 -- 172.21.15.81:0/463719748 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564525cb4590 con 0x5645259581c0 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.928+0000 7f1a14ff9640 10 client.15573 handle_command_reply: tid=0 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.928+0000 7f1a39df0740 1 client.15573 shutdown 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.928+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 msgr2=0x564525d4c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.928+0000 7f1a39df0740 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4c650 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800be40 tx=0x7f1a2800f730 comp rx=0 tx=0).stop 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.928+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 shutdown_connections 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.928+0000 7f1a39df0740 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5645259581c0 0x564525d5e170 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a39df0740 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d58160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a39df0740 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4c650 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a39df0740 1 --2- 172.21.15.81:0/463719748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d4c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 >> 172.21.15.81:0/463719748 conn(0x56452598d990 msgr2=0x564525d437e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a14ff9640 0 client.15573 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 shutdown_connections 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a39df0740 1 -- 172.21.15.81:0/463719748 wait complete. 2024-09-21T03:01:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.929+0000 7f1a39df0740 20 client.15573 trim_cache size 0 max 16384 2024-09-21T03:01:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 Processor -- start 2024-09-21T03:01:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 -- start start 2024-09-21T03:01:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d41d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1b5380 con 0x564525978b60 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1b2c50 con 0x564525970980 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a39df0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1b0aa0 con 0x564525999840 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42098/0 (socket says 172.21.15.81:42098) 2024-09-21T03:01:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 -- 172.21.15.81:0/2777706803 learned_addr learned my addr 172.21.15.81:0/2777706803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a30e17640 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d41d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 -- 172.21.15.81:0/2777706803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 msgr2=0x564525d41d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d41d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 -- 172.21.15.81:0/2777706803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 msgr2=0x564525d440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a31618640 1 -- 172.21.15.81:0/2777706803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564525d477a0 con 0x564525978b60 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.946+0000 7f1a30e17640 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d41d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.947+0000 7f1a31618640 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4a790 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a28001eb0 tx=0x7f1a2800ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19245742dd532dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.947+0000 7f1a16ffd640 1 -- 172.21.15.81:0/2777706803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28015070 con 0x564525978b60 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.947+0000 7f1a16ffd640 1 -- 172.21.15.81:0/2777706803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a28010420 con 0x564525978b60 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.947+0000 7f1a16ffd640 1 -- 172.21.15.81:0/2777706803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28005040 con 0x564525978b60 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 -- 172.21.15.81:0/2777706803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 msgr2=0x564525d4a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4a790 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a28001eb0 tx=0x7f1a2800ff80 comp rx=0 tx=0).stop 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 -- 172.21.15.81:0/2777706803 shutdown_connections 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525999840 0x564525d41d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525978b60 0x564525d4a790 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 --2- 172.21.15.81:0/2777706803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525970980 0x564525d440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 -- 172.21.15.81:0/2777706803 >> 172.21.15.81:0/2777706803 conn(0x56452598d990 msgr2=0x564525d41630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:08.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 -- 172.21.15.81:0/2777706803 shutdown_connections 2024-09-21T03:01:08.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 -- 172.21.15.81:0/2777706803 wait complete. 2024-09-21T03:01:08.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 -- start start 2024-09-21T03:01:08.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.948+0000 7f1a39df0740 1 Processor -- start 2024-09-21T03:01:08.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525970980 0x564525d549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525978b60 0x564525d50ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a39df0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525999840 0x564525d51540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a39df0740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1b1110 con 0x564525970980 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a39df0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1b2580 con 0x564525999840 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a39df0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1b17e0 con 0x564525978b60 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a39df0740 10 client.0 _ll_register_callbacks cb 0x7f1a2800b3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a30e17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525970980 0x564525d549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a30e17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525970980 0x564525d549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42114/0 (socket says 172.21.15.81:42114) 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a30e17640 1 -- 172.21.15.81:0/1191667524 learned_addr learned my addr 172.21.15.81:0/1191667524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.949+0000 7f1a31618640 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525978b60 0x564525d50ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a30e17640 1 -- 172.21.15.81:0/1191667524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525978b60 msgr2=0x564525d50ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a30e17640 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525978b60 0x564525d50ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a30e17640 1 -- 172.21.15.81:0/1191667524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525999840 msgr2=0x564525d51540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a30e17640 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525999840 0x564525d51540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a30e17640 1 -- 172.21.15.81:0/1191667524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564525d4ae70 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a31618640 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525978b60 0x564525d50ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a30e17640 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525970980 0x564525d549e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f3d24da71b7d67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a14ff9640 1 -- 172.21.15.81:0/1191667524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c055020 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a14ff9640 1 -- 172.21.15.81:0/1191667524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1a1c031a80 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a28010420 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a14ff9640 1 -- 172.21.15.81:0/1191667524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a1c05d050 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a39df0740 10 client.15579 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.950+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564525dc99a0 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a14ff9640 1 -- 172.21.15.81:0/1191667524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a28010420 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a14ff9640 1 -- 172.21.15.81:0/1191667524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1a1c03a3f0 con 0x564525970980 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a39df0740 10 client.15579 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a39df0740 10 client.15579 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:01:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a39df0740 20 client.15579 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:08.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a39df0740 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x56452592d570 0x564525dcbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:08.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a39df0740 4 client.15579 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T03:01:08.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x564525cb19c0 con 0x56452592d570 2024-09-21T03:01:08.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.951+0000 7f1a31618640 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x56452592d570 0x564525dcbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:08.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.952+0000 7f1a31618640 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x56452592d570 0x564525dcbe00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c076294419490f90 server_cookie=950e458c63b9648d in_seq=0 out_seq=0 2024-09-21T03:01:08.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.952+0000 7f1a14ff9640 10 client.15579 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:08.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a14ff9640 1 -- 172.21.15.81:0/1191667524 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564525cb19c0 con 0x56452592d570 2024-09-21T03:01:08.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a14ff9640 10 client.15579 handle_command_reply: tid=0 2024-09-21T03:01:08.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 client.15579 shutdown 2024-09-21T03:01:08.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525970980 msgr2=0x564525d549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525970980 0x564525d549e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c032bb0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 shutdown_connections 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x56452592d570 0x564525dcbe00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564525978b60 0x564525d50ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564525999840 0x564525d51540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 --2- 172.21.15.81:0/1191667524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564525970980 0x564525d549e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 >> 172.21.15.81:0/1191667524 conn(0x56452598d990 msgr2=0x564525d4d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.960+0000 7f1a14ff9640 0 client.15579 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 shutdown_connections 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a39df0740 1 -- 172.21.15.81:0/1191667524 wait complete. 2024-09-21T03:01:08.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a39df0740 20 client.15579 trim_cache size 0 max 16384 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 25, 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 2, 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "8c5b082b": { 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 2, 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:01:08.964 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 134.5, 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:08.965 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a180b6510 msgr2=0x7f1a180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a180b6510 0x7f1a180b8a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1a240e55a0 tx=0x7f1a2400af30 comp rx=0 tx=0).stop 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c108d10 msgr2=0x7f1a2c1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c108d10 0x7f1a2c1000b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400cce0 tx=0x7f1a2400a620 comp rx=0 tx=0).stop 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 shutdown_connections 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1a180b6510 0x7f1a180b8a20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a2c1083c0 0x7f1a2c0ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c108d10 0x7f1a2c1000b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 --2- 172.21.15.81:0/1863654466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a2c102a80 0x7f1a2c0ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:08.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 >> 172.21.15.81:0/1863654466 conn(0x7f1a2c079760 msgr2=0x7f1a2c101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:08.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 shutdown_connections 2024-09-21T03:01:08.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:08.961+0000 7f1a3387c640 1 -- 172.21.15.81:0/1863654466 wait complete. 2024-09-21T03:01:09.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:09 smithi164 ceph-mon[34236]: pgmap v382: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:01:09.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:09 smithi181 ceph-mon[34096]: pgmap v382: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:01:09.788 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:09 smithi081 ceph-mon[30991]: pgmap v382: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:01:09.818 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8c5b082b', quiesce took 3.6 seconds. Will release after: 10.9 2024-09-21T03:01:11.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:11 smithi164 ceph-mon[34236]: pgmap v383: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:01:11.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:11 smithi181 ceph-mon[34096]: pgmap v383: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:01:11.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:11 smithi081 ceph-mon[30991]: pgmap v383: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:01:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 -- 172.21.15.81:0/3876182717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103fc0 msgr2=0x7fb1b810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 --2- 172.21.15.81:0/3876182717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103fc0 0x7fb1b810a960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009bd0 tx=0x7fb1b002a6a0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 -- 172.21.15.81:0/3876182717 shutdown_connections 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 --2- 172.21.15.81:0/3876182717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103fc0 0x7fb1b810a960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 --2- 172.21.15.81:0/3876182717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1b8103620 0x7fb1b8103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 --2- 172.21.15.81:0/3876182717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1b81025a0 0x7fb1b8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 -- 172.21.15.81:0/3876182717 >> 172.21.15.81:0/3876182717 conn(0x7fb1b80fdee0 msgr2=0x7fb1b8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 -- 172.21.15.81:0/3876182717 shutdown_connections 2024-09-21T03:01:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.833+0000 7fb1be112640 1 -- 172.21.15.81:0/3876182717 wait complete. 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 Processor -- start 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 -- start start 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1b81025a0 0x7fb1b8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103620 0x7fb1b8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1b8103fc0 0x7fb1b8199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b810e0b0 con 0x7fb1b8103620 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b810df30 con 0x7fb1b81025a0 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1be112640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b810e230 con 0x7fb1b8103fc0 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103620 0x7fb1b8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103620 0x7fb1b8199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35796/0 (socket says 172.21.15.81:35796) 2024-09-21T03:01:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/3743457013 learned_addr learned my addr 172.21.15.81:0/3743457013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1b81025a0 0x7fb1b8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.834+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1b8103fc0 0x7fb1b8199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/3743457013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1b8103fc0 msgr2=0x7fb1b8199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1b8103fc0 0x7fb1b8199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/3743457013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1b81025a0 msgr2=0x7fb1b8198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1b81025a0 0x7fb1b8198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/3743457013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b819a800 con 0x7fb1b8103620 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1b81025a0 0x7fb1b8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103620 0x7fb1b8199430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9c0 tx=0x7fb1ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b4ff9640 1 -- 172.21.15.81:0/3743457013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00cde0 con 0x7fb1b8103620 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b819aaf0 con 0x7fb1b8103620 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b4ff9640 1 -- 172.21.15.81:0/3743457013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1ac0035f0 con 0x7fb1b8103620 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1b4ff9640 1 -- 172.21.15.81:0/3743457013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011830 con 0x7fb1b8103620 2024-09-21T03:01:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.835+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b806adc0 con 0x7fb1b8103620 2024-09-21T03:01:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1b4ff9640 1 -- 172.21.15.81:0/3743457013 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb1ac020020 con 0x7fb1b8103620 2024-09-21T03:01:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 Processor -- start 2024-09-21T03:01:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 -- start start 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498741b0 0x55db49c1be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4984b2f0 0x55db49c1c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498534d0 0x55db49c1d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55db49b8e6f0 con 0x55db4984b2f0 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55db49b7db20 con 0x55db498534d0 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1c5079740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55db49b81930 con 0x55db498741b0 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4984b2f0 0x55db49c1c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4984b2f0 0x55db49c1c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35806/0 (socket says 172.21.15.81:35806) 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2023258494 learned_addr learned my addr 172.21.15.81:0/2023258494 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498534d0 0x55db49c1d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.838+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498741b0 0x55db49c1be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2023258494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498741b0 msgr2=0x55db49c1be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498741b0 0x55db49c1be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2023258494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498534d0 msgr2=0x55db49c1d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498534d0 0x55db49c1d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b4ff9640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb1a00b6510 0x7fb1a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2023258494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db49b43530 con 0x55db4984b2f0 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498741b0 0x55db49c1be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb1a00b6510 0x7fb1a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4984b2f0 0x55db49c1c4c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009d40 tx=0x7fb1a80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361a3fe092471330 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb1b4ff9640 1 -- 172.21.15.81:0/3743457013 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb1ac0e9680 con 0x7fb1b8103620 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb19dffb640 1 -- 172.21.15.81:0/2023258494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8012650 con 0x55db4984b2f0 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb19dffb640 1 -- 172.21.15.81:0/2023258494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1a8009e30 con 0x55db4984b2f0 2024-09-21T03:01:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.839+0000 7fb19dffb640 1 -- 172.21.15.81:0/2023258494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800fba0 con 0x55db4984b2f0 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 -- 172.21.15.81:0/2023258494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4984b2f0 msgr2=0x55db49c1c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb1a00b6510 0x7fb1a00b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009ba0 tx=0x7fb1b00304c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4984b2f0 0x55db49c1c4c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009d40 tx=0x7fb1a80117b0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 -- 172.21.15.81:0/2023258494 shutdown_connections 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498534d0 0x55db49c1d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db4984b2f0 0x55db49c1c4c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2023258494 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498741b0 0x55db49c1be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 -- 172.21.15.81:0/2023258494 >> 172.21.15.81:0/2023258494 conn(0x55db49868300 msgr2=0x55db49c178e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 -- 172.21.15.81:0/2023258494 shutdown_connections 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.840+0000 7fb1c5079740 1 -- 172.21.15.81:0/2023258494 wait complete. 2024-09-21T03:01:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 -- start start 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 Processor -- start 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db4984b2f0 0x55db49c255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db498534d0 0x55db49c25c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498741b0 0x55db49c267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55db49ab5ab0 con 0x55db498534d0 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55db49b23730 con 0x55db498741b0 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55db49c1db30 con 0x55db4984b2f0 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1c5079740 10 client.0 _ll_register_callbacks cb 0x55db49b776b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.841+0000 7fb1b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db498534d0 0x55db49c25c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db498534d0 0x55db49c25c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35814/0 (socket says 172.21.15.81:35814) 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/2299228041 learned_addr learned my addr 172.21.15.81:0/2299228041 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db4984b2f0 0x55db49c255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498741b0 0x55db49c267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/2299228041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db4984b2f0 msgr2=0x55db49c255a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db4984b2f0 0x55db49c255a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498741b0 msgr2=0x55db49c267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498741b0 0x55db49c267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 -- 172.21.15.81:0/2299228041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db498df790 con 0x55db498534d0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498741b0 0x55db49c267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db498534d0 0x55db49c25c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0af1d0 tx=0x7fb1ac0ab370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a752c428384fe462 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb196ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb196ffd640 1 -- 172.21.15.81:0/2299228041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0aefe0 con 0x55db498534d0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb196ffd640 1 -- 172.21.15.81:0/2299228041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb1ac003aa0 con 0x55db498534d0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1a8009e30 con 0x55db498534d0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb196ffd640 1 -- 172.21.15.81:0/2299228041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb1ac0afbd0 con 0x55db498534d0 2024-09-21T03:01:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1c5079740 10 client.15591 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.842+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db49958620 con 0x55db498534d0 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb196ffd640 1 -- 172.21.15.81:0/2299228041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1a8009e30 con 0x55db498534d0 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb196ffd640 1 -- 172.21.15.81:0/2299228041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb1ac096040 con 0x55db498534d0 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb1c5079740 10 client.15591 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb1c5079740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb1c5079740 20 client.15591 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db49832d80 0x55db49c32c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb1c5079740 4 client.15591 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db49b90640 con 0x55db49832d80 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.843+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db49832d80 0x55db49c32c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.844+0000 7fb196ffd640 10 client.15591 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.844+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db49832d80 0x55db49c32c90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24bc4156f3db1121 server_cookie=1a664eeb7bf5af4e in_seq=0 out_seq=0 2024-09-21T03:01:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.844+0000 7fb196ffd640 1 -- 172.21.15.81:0/2299228041 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db49b90640 con 0x55db49832d80 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.844+0000 7fb196ffd640 10 client.15591 handle_command_reply: tid=0 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.844+0000 7fb1c5079740 1 client.15591 shutdown 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db498534d0 msgr2=0x55db49c25c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db498534d0 0x55db49c25c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0af1d0 tx=0x7fb1ac0ab370 comp rx=0 tx=0).stop 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 shutdown_connections 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db49832d80 0x55db49c32c90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db498741b0 0x55db49c267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb196ffd640 0 client.15591 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db498534d0 0x55db49c25c60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2299228041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db4984b2f0 0x55db49c255a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 >> 172.21.15.81:0/2299228041 conn(0x55db49868300 msgr2=0x55db49c15ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 shutdown_connections 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 1 -- 172.21.15.81:0/2299228041 wait complete. 2024-09-21T03:01:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.845+0000 7fb1c5079740 20 client.15591 trim_cache size 0 max 16384 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.873+0000 7fb1c5079740 1 Processor -- start 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1c5079740 1 -- start start 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c1cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c1bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c1c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1c5079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81acbf0 con 0x55db49832d80 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1c5079740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81aa4c0 con 0x55db4984b2f0 2024-09-21T03:01:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1c5079740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81a8310 con 0x55db498534d0 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c1cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c1cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35822/0 (socket says 172.21.15.81:35822) 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2975510901 learned_addr learned my addr 172.21.15.81:0/2975510901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c1bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c1c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2975510901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 msgr2=0x55db49c1c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c1c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2975510901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 msgr2=0x55db49c1bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c1bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 -- 172.21.15.81:0/2975510901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db49c30a00 con 0x55db49832d80 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.874+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c1cce0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800f9a0 tx=0x7fb1a8009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d322a0bbc430c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.875+0000 7fb19d7fa640 1 -- 172.21.15.81:0/2975510901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8009e30 con 0x55db49832d80 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.875+0000 7fb19d7fa640 1 -- 172.21.15.81:0/2975510901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1a800f440 con 0x55db49832d80 2024-09-21T03:01:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.875+0000 7fb19d7fa640 1 -- 172.21.15.81:0/2975510901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8004660 con 0x55db49832d80 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 -- 172.21.15.81:0/2975510901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 msgr2=0x55db49c1cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c1cce0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800f9a0 tx=0x7fb1a8009550 comp rx=0 tx=0).stop 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 -- 172.21.15.81:0/2975510901 shutdown_connections 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c1c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c1bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 --2- 172.21.15.81:0/2975510901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c1cce0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 -- 172.21.15.81:0/2975510901 >> 172.21.15.81:0/2975510901 conn(0x55db49868300 msgr2=0x55db49c125c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 -- 172.21.15.81:0/2975510901 shutdown_connections 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 -- 172.21.15.81:0/2975510901 wait complete. 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.876+0000 7fb1c5079740 1 -- start start 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 1 Processor -- start 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c2a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c2af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c2ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81a8980 con 0x55db49832d80 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81a9df0 con 0x55db4984b2f0 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81a9050 con 0x55db498534d0 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1c5079740 10 client.0 _ll_register_callbacks cb 0x7fb1ac0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c2a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c2a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35828/0 (socket says 172.21.15.81:35828) 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 -- 172.21.15.81:0/3770339976 learned_addr learned my addr 172.21.15.81:0/3770339976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b7fff640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c2ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c2af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 -- 172.21.15.81:0/3770339976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 msgr2=0x55db49c2ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c2ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 -- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 msgr2=0x55db49c2af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c2af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b77fe640 1 -- 172.21.15.81:0/3770339976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db49c2c180 con 0x55db49832d80 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.877+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c2af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1b77fe640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c2a860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80117f0 tx=0x7fb1a8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb870b93cff8e254 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb196ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb196ffd640 1 -- 172.21.15.81:0/3770339976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a803f060 con 0x55db49832d80 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb196ffd640 1 -- 172.21.15.81:0/3770339976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb1a800fad0 con 0x55db49832d80 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1a800f440 con 0x55db49832d80 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb196ffd640 1 -- 172.21.15.81:0/3770339976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb1a8046050 con 0x55db49832d80 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 10 client.15597 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db49c2d470 con 0x55db49832d80 2024-09-21T03:01:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb196ffd640 1 -- 172.21.15.81:0/3770339976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1a800f440 con 0x55db49832d80 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb196ffd640 1 -- 172.21.15.81:0/3770339976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb1a803ab80 con 0x55db49832d80 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 10 client.15597 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 20 client.15597 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db498741b0 0x55db49c9f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 4 client.15597 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.878+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db49b8c0f0 con 0x55db498741b0 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.879+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db498741b0 0x55db49c9f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.879+0000 7fb196ffd640 10 client.15597 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.879+0000 7fb1b6ffd640 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db498741b0 0x55db49c9f6a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad806b1ede0bb4b server_cookie=1c661327714f1eb3 in_seq=0 out_seq=0 2024-09-21T03:01:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.885+0000 7fb196ffd640 1 -- 172.21.15.81:0/3770339976 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55db49b8c0f0 con 0x55db498741b0 2024-09-21T03:01:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.885+0000 7fb196ffd640 10 client.15597 handle_command_reply: tid=0 2024-09-21T03:01:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.885+0000 7fb1c5079740 1 client.15597 shutdown 2024-09-21T03:01:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.885+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 msgr2=0x55db49c2a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.885+0000 7fb1c5079740 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c2a860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80117f0 tx=0x7fb1a8009f90 comp rx=0 tx=0).stop 2024-09-21T03:01:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 shutdown_connections 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55db498741b0 0x55db49c9f6a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb196ffd640 0 client.15597 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55db498534d0 0x55db49c2ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55db4984b2f0 0x55db49c2af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 --2- 172.21.15.81:0/3770339976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55db49832d80 0x55db49c2a860 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 >> 172.21.15.81:0/3770339976 conn(0x55db49868300 msgr2=0x55db49c23920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 shutdown_connections 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 1 -- 172.21.15.81:0/3770339976 wait complete. 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1c5079740 20 client.15597 trim_cache size 0 max 16384 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:01:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:01:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:01:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb1a00b6510 msgr2=0x7fb1a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1be112640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb1a00b6510 0x7fb1a00b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009ba0 tx=0x7fb1b00304c0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103620 msgr2=0x7fb1b8199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.886+0000 7fb1be112640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103620 0x7fb1b8199430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9c0 tx=0x7fb1ac00ee80 comp rx=0 tx=0).stop 2024-09-21T03:01:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 shutdown_connections 2024-09-21T03:01:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb1a00b6510 0x7fb1a00b8a20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1b8103fc0 0x7fb1b8199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8103620 0x7fb1b8199430 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 --2- 172.21.15.81:0/3743457013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1b81025a0 0x7fb1b8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 >> 172.21.15.81:0/3743457013 conn(0x7fb1b80fdee0 msgr2=0x7fb1b8106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 shutdown_connections 2024-09-21T03:01:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:12.887+0000 7fb1be112640 1 -- 172.21.15.81:0/3743457013 wait complete. 2024-09-21T03:01:13.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:13 smithi164 ceph-mon[34236]: pgmap v384: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-21T03:01:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:13 smithi181 ceph-mon[34096]: pgmap v384: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-21T03:01:13.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:13 smithi081 ceph-mon[30991]: pgmap v384: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-21T03:01:15.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:15 smithi164 ceph-mon[34236]: pgmap v385: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:15.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:15 smithi181 ceph-mon[34096]: pgmap v385: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:15.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:15 smithi081 ceph-mon[30991]: pgmap v385: 129 pgs: 129 active+clean; 673 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:17.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:17 smithi164 ceph-mon[34236]: pgmap v386: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T03:01:17.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:17 smithi181 ceph-mon[34096]: pgmap v386: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T03:01:17.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:17 smithi081 ceph-mon[30991]: pgmap v386: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T03:01:18.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:01:18.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:18 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:01:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:18 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:01:18.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:18.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:18 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:19.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:19 smithi164 ceph-mon[34236]: pgmap v387: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:19.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:01:19.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:01:19.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:19.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:19 smithi181 ceph-mon[34096]: pgmap v387: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:01:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:01:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:19.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:19 smithi081 ceph-mon[30991]: pgmap v387: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:01:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:01:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:01:20.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:01:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:01:21.428 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:21 smithi081 ceph-mon[30991]: pgmap v388: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 -- 172.21.15.81:0/259254064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f001083a0 msgr2=0x7f9f001087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/259254064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f001083a0 0x7f9f001087b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009900 tx=0x7f9ee802a410 comp rx=0 tx=0).stop 2024-09-21T03:01:21.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 -- 172.21.15.81:0/259254064 shutdown_connections 2024-09-21T03:01:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/259254064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f00108cf0 0x7f9f0010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/259254064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f001083a0 0x7f9f001087b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/259254064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f00102a60 0x7f9f00102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 -- 172.21.15.81:0/259254064 >> 172.21.15.81:0/259254064 conn(0x7f9f00079730 msgr2=0x7f9f00079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 -- 172.21.15.81:0/259254064 shutdown_connections 2024-09-21T03:01:21.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.568+0000 7f9f04cb5640 1 -- 172.21.15.81:0/259254064 wait complete. 2024-09-21T03:01:21.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.569+0000 7f9f04cb5640 1 Processor -- start 2024-09-21T03:01:21.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.570+0000 7f9f04cb5640 1 -- start start 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.570+0000 7f9f04cb5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f00102a60 0x7f9f00199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.570+0000 7f9f04cb5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f001083a0 0x7f9f001998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.570+0000 7f9f04cb5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f00108cf0 0x7f9f0019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.570+0000 7f9f04cb5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00112810 con 0x7f9f00108cf0 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.570+0000 7f9efe59c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f00102a60 0x7f9f00199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9efe59c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f00102a60 0x7f9f00199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:33934/0 (socket says 172.21.15.81:33934) 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9efe59c640 1 -- 172.21.15.81:0/3305371673 learned_addr learned my addr 172.21.15.81:0/3305371673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9ef7fff640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f001083a0 0x7f9f001998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9efed9d640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f00108cf0 0x7f9f0019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00112690 con 0x7f9f00102a60 2024-09-21T03:01:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00112990 con 0x7f9f001083a0 2024-09-21T03:01:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9efed9d640 1 -- 172.21.15.81:0/3305371673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f001083a0 msgr2=0x7f9f001998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.571+0000 7f9efed9d640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f001083a0 0x7f9f001998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9efed9d640 1 -- 172.21.15.81:0/3305371673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f00102a60 msgr2=0x7f9f00199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9efed9d640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f00102a60 0x7f9f00199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9efed9d640 1 -- 172.21.15.81:0/3305371673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0019f270 con 0x7f9f00108cf0 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9efed9d640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f00108cf0 0x7f9f0019eb40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009fd0 tx=0x7f9ef800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9ef77fe640 1 -- 172.21.15.81:0/3305371673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8004b20 con 0x7f9f00108cf0 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9ef77fe640 1 -- 172.21.15.81:0/3305371673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ef8004cc0 con 0x7f9f00108cf0 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9ef77fe640 1 -- 172.21.15.81:0/3305371673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80196f0 con 0x7f9f00108cf0 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0019f560 con 0x7f9f00108cf0 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.572+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0006ae60 con 0x7f9f00108cf0 2024-09-21T03:01:21.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.574+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f00103ce0 con 0x7f9f00108cf0 2024-09-21T03:01:21.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.578+0000 7f9ef77fe640 1 -- 172.21.15.81:0/3305371673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9ef8019aa0 con 0x7f9f00108cf0 2024-09-21T03:01:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.579+0000 7f9ef77fe640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9eec0b6590 0x7f9eec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.579+0000 7f9ef77fe640 1 -- 172.21.15.81:0/3305371673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f9ef80ebe70 con 0x7f9f00108cf0 2024-09-21T03:01:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.579+0000 7f9efe59c640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9eec0b6590 0x7f9eec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.580+0000 7f9efe59c640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9eec0b6590 0x7f9eec0b8aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005fd0 tx=0x7f9ef000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:21.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:21.584+0000 7f9ef77fe640 1 -- 172.21.15.81:0/3305371673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ef80b6740 con 0x7f9f00108cf0 2024-09-21T03:01:21.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:21 smithi164 ceph-mon[34236]: pgmap v388: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:21.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:21 smithi181 ceph-mon[34096]: pgmap v388: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:22.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.033+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f0006b940 con 0x7f9f00108cf0 2024-09-21T03:01:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.034+0000 7f9ef77fe640 1 -- 172.21.15.81:0/3305371673 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f9ef80bb680 con 0x7f9f00108cf0 2024-09-21T03:01:22.035 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:01:22.036 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:01:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9eec0b6590 msgr2=0x7f9eec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9eec0b6590 0x7f9eec0b8aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0005fd0 tx=0x7f9ef000b4a0 comp rx=0 tx=0).stop 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f00108cf0 msgr2=0x7f9f0019eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f00108cf0 0x7f9f0019eb40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009fd0 tx=0x7f9ef800b690 comp rx=0 tx=0).stop 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 shutdown_connections 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f9eec0b6590 0x7f9eec0b8aa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9f001083a0 0x7f9f001998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f00108cf0 0x7f9f0019eb40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 --2- 172.21.15.81:0/3305371673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f00102a60 0x7f9f00199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 >> 172.21.15.81:0/3305371673 conn(0x7f9f00079730 msgr2=0x7f9f00104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 shutdown_connections 2024-09-21T03:01:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:22.037+0000 7f9f04cb5640 1 -- 172.21.15.81:0/3305371673 wait complete. 2024-09-21T03:01:22.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:22 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3305371673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:22.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:22 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3305371673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:22.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:22 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3305371673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:22.893 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db --set-id 8c5b082b --release --await' 2024-09-21T03:01:22.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db --set-id 8c5b082b --release --await 2024-09-21T03:01:23.175 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:01:23.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:23 smithi081 ceph-mon[30991]: pgmap v389: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:23.682 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:23 smithi164 ceph-mon[34236]: pgmap v389: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1606774253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c101f70 msgr2=0x7f5c7c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1606774253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c101f70 0x7f5c7c102380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009900 tx=0x7f5c7802a410 comp rx=0 tx=0).stop 2024-09-21T03:01:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1606774253 shutdown_connections 2024-09-21T03:01:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1606774253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c7c109e00 0x7f5c7c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1606774253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c1094b0 0x7f5c7c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1606774253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c101f70 0x7f5c7c102380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1606774253 >> 172.21.15.81:0/1606774253 conn(0x7f5c7c077c60 msgr2=0x7f5c7c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1606774253 shutdown_connections 2024-09-21T03:01:23.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.740+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1606774253 wait complete. 2024-09-21T03:01:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c83fb5640 1 Processor -- start 2024-09-21T03:01:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c83fb5640 1 -- start start 2024-09-21T03:01:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c83fb5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c101f70 0x7f5c7c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c83fb5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c7c1094b0 0x7f5c7c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c83fb5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c109e00 0x7f5c7c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c81d51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c101f70 0x7f5c7c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c81d51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c101f70 0x7f5c7c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53664/0 (socket says 172.21.15.81:53664) 2024-09-21T03:01:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.742+0000 7f5c81d51640 1 -- 172.21.15.81:0/1715128633 learned_addr learned my addr 172.21.15.81:0/1715128633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c1139c0 con 0x7f5c7c101f70 2024-09-21T03:01:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c113840 con 0x7f5c7c109e00 2024-09-21T03:01:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c113b40 con 0x7f5c7c1094b0 2024-09-21T03:01:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81550640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c7c1094b0 0x7f5c7c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c82552640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c109e00 0x7f5c7c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81550640 1 -- 172.21.15.81:0/1715128633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c109e00 msgr2=0x7f5c7c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81550640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c109e00 0x7f5c7c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81550640 1 -- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c101f70 msgr2=0x7f5c7c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81550640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c101f70 0x7f5c7c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81550640 1 -- 172.21.15.81:0/1715128633 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c1a03c0 con 0x7f5c7c1094b0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81d51640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c101f70 0x7f5c7c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.743+0000 7f5c81550640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c7c1094b0 0x7f5c7c19a9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c075ab0 tx=0x7f5c6c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.744+0000 7f5c72ffd640 1 -- 172.21.15.81:0/1715128633 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00ccc0 con 0x7f5c7c1094b0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.744+0000 7f5c72ffd640 1 -- 172.21.15.81:0/1715128633 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c6c0137d0 con 0x7f5c7c1094b0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.744+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7c1a06b0 con 0x7f5c7c1094b0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.744+0000 7f5c72ffd640 1 -- 172.21.15.81:0/1715128633 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c003850 con 0x7f5c7c1094b0 2024-09-21T03:01:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.744+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c7c102df0 con 0x7f5c7c1094b0 2024-09-21T03:01:23.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:23 smithi181 ceph-mon[34096]: pgmap v389: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:23.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 Processor -- start 2024-09-21T03:01:23.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 -- start start 2024-09-21T03:01:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c30a520 0x55849c6b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6b9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c6b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55849c59bdc0 con 0x55849c30a520 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55849c6281f0 con 0x55849c2e9840 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c8a529740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55849c617620 con 0x55849c2e1660 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c82552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c30a520 0x55849c6b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c82552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c30a520 0x55849c6b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53668/0 (socket says 172.21.15.81:53668) 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.748+0000 7f5c82552640 1 -- 172.21.15.81:0/1315023658 learned_addr learned my addr 172.21.15.81:0/1315023658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c81d51640 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c72ffd640 1 -- 172.21.15.81:0/1715128633 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5c6c022020 con 0x7f5c7c1094b0 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c81d51640 1 -- 172.21.15.81:0/1315023658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 msgr2=0x55849c6b97a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c81d51640 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c6b97a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c81d51640 1 -- 172.21.15.81:0/1315023658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c30a520 msgr2=0x55849c6b8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c81d51640 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c30a520 0x55849c6b8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c81d51640 1 -- 172.21.15.81:0/1315023658 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849c5dffd0 con 0x55849c2e1660 2024-09-21T03:01:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.749+0000 7f5c81d51640 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6b9260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c78006010 tx=0x7f5c78004480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37558b2cc51aff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.752+0000 7f5c67fff640 1 -- 172.21.15.81:0/1315023658 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78040070 con 0x55849c2e1660 2024-09-21T03:01:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.752+0000 7f5c67fff640 1 -- 172.21.15.81:0/1315023658 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c78003d00 con 0x55849c2e1660 2024-09-21T03:01:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.752+0000 7f5c67fff640 1 -- 172.21.15.81:0/1315023658 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78035040 con 0x55849c2e1660 2024-09-21T03:01:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.752+0000 7f5c72ffd640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5c680b6590 0x7f5c680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.752+0000 7f5c82552640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5c680b6590 0x7f5c680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.752+0000 7f5c72ffd640 1 -- 172.21.15.81:0/1715128633 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5c6c0e70c0 con 0x7f5c7c1094b0 2024-09-21T03:01:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.753+0000 7f5c8a529740 1 -- 172.21.15.81:0/1315023658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 msgr2=0x55849c6b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.753+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6b9260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c78006010 tx=0x7f5c78004480 comp rx=0 tx=0).stop 2024-09-21T03:01:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c8a529740 1 -- 172.21.15.81:0/1315023658 shutdown_connections 2024-09-21T03:01:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6b9260 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c6b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1315023658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c30a520 0x55849c6b8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c8a529740 1 -- 172.21.15.81:0/1315023658 >> 172.21.15.81:0/1315023658 conn(0x55849c2fe910 msgr2=0x55849c6b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c8a529740 1 -- 172.21.15.81:0/1315023658 shutdown_connections 2024-09-21T03:01:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c82552640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5c680b6590 0x7f5c680b8aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c74011630 tx=0x7f5c74009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:23.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.754+0000 7f5c8a529740 1 -- 172.21.15.81:0/1315023658 wait complete. 2024-09-21T03:01:23.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.755+0000 7f5c8a529740 1 -- start start 2024-09-21T03:01:23.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.755+0000 7f5c8a529740 1 Processor -- start 2024-09-21T03:01:23.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e1660 0x55849c6c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2e9840 0x55849c6c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c30a520 0x55849c6d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c8a529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55849c5b2300 con 0x55849c2e9840 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c8a529740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55849c61b430 con 0x55849c2e1660 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c8a529740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55849c478bb0 con 0x55849c30a520 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c81550640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2e9840 0x55849c6c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c82552640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c30a520 0x55849c6d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c82552640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c30a520 0x55849c6d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:55960/0 (socket says 172.21.15.81:55960) 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c82552640 1 -- 172.21.15.81:0/2761600714 learned_addr learned my addr 172.21.15.81:0/2761600714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c81d51640 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e1660 0x55849c6c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c8a529740 10 client.0 _ll_register_callbacks cb 0x55849c5cc120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c82552640 1 -- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e1660 msgr2=0x55849c6c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c82552640 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e1660 0x55849c6c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.756+0000 7f5c82552640 1 -- 172.21.15.81:0/2761600714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2e9840 msgr2=0x55849c6c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c82552640 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2e9840 0x55849c6c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c82552640 1 -- 172.21.15.81:0/2761600714 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55849c5a1780 con 0x55849c30a520 2024-09-21T03:01:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c81550640 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2e9840 0x55849c6c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c82552640 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c30a520 0x55849c6d0610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c74003f20 tx=0x7f5c74004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232e6f13ee43bd85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c657fa640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-21T03:01:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c657fa640 1 -- 172.21.15.81:0/2761600714 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400f890 con 0x55849c30a520 2024-09-21T03:01:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c657fa640 1 -- 172.21.15.81:0/2761600714 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5c7400fa30 con 0x55849c30a520 2024-09-21T03:01:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.757+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c78003d00 con 0x55849c30a520 2024-09-21T03:01:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c657fa640 1 -- 172.21.15.81:0/2761600714 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5c7400fc30 con 0x55849c30a520 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 10 client.25147 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55849c375b00 con 0x55849c30a520 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c657fa640 1 -- 172.21.15.81:0/2761600714 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c7400fdd0 con 0x55849c30a520 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c657fa640 1 -- 172.21.15.81:0/2761600714 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5c74026070 con 0x55849c30a520 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 10 client.25147 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 10 client.25147 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 20 client.25147 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c2c8ea0 0x55849c6d6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 4 client.25147 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.758+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5c78003d00 con 0x55849c2c8ea0 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.759+0000 7f5c81d51640 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c2c8ea0 0x55849c6d6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.759+0000 7f5c657fa640 10 client.25147 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.759+0000 7f5c81d51640 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c2c8ea0 0x55849c6d6850 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc0ae1b66ca87054 server_cookie=ae726b897a1d3260 in_seq=0 out_seq=0 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c657fa640 1 -- 172.21.15.81:0/2761600714 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f5c78003d00 con 0x55849c2c8ea0 2024-09-21T03:01:23.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c657fa640 10 client.25147 handle_command_reply: tid=0 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 client.25147 shutdown 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c30a520 msgr2=0x55849c6d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c30a520 0x55849c6d0610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c74003f20 tx=0x7f5c74004a40 comp rx=0 tx=0).stop 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 shutdown_connections 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c2c8ea0 0x55849c6d6850 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c657fa640 0 client.25147 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c30a520 0x55849c6d0610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2e9840 0x55849c6c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2761600714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e1660 0x55849c6c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.760+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 >> 172.21.15.81:0/2761600714 conn(0x55849c2fe910 msgr2=0x55849c6bbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.761+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 shutdown_connections 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.761+0000 7f5c8a529740 1 -- 172.21.15.81:0/2761600714 wait complete. 2024-09-21T03:01:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.761+0000 7f5c8a529740 20 client.25147 trim_cache size 0 max 16384 2024-09-21T03:01:23.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.794+0000 7f5c8a529740 1 Processor -- start 2024-09-21T03:01:23.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.794+0000 7f5c8a529740 1 -- start start 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.794+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c6c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c8a529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c1b0ff0 con 0x55849c2c8ea0 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c8a529740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c1ae8c0 con 0x55849c2e9840 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c8a529740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c1ac710 con 0x55849c2e1660 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c81d51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c81d51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53678/0 (socket says 172.21.15.81:53678) 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c81d51640 1 -- 172.21.15.81:0/1546082111 learned_addr learned my addr 172.21.15.81:0/1546082111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c82552640 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c6c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c81550640 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c81550640 1 -- 172.21.15.81:0/1546082111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 msgr2=0x55849c6c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c81550640 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c6c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.795+0000 7f5c81550640 1 -- 172.21.15.81:0/1546082111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 msgr2=0x55849c6c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:23.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.796+0000 7f5c81550640 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.796+0000 7f5c81550640 1 -- 172.21.15.81:0/1546082111 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849c6bb5b0 con 0x55849c2e1660 2024-09-21T03:01:23.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.796+0000 7f5c81d51640 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:23.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.796+0000 7f5c81550640 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6d0510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0b0fb0 tx=0x7f5c6c00cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd13f0e25c0a581c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:23.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.796+0000 7f5c677fe640 1 -- 172.21.15.81:0/1546082111 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0b19b0 con 0x55849c2e1660 2024-09-21T03:01:23.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.796+0000 7f5c677fe640 1 -- 172.21.15.81:0/1546082111 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c6c0b5d90 con 0x55849c2e1660 2024-09-21T03:01:23.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.796+0000 7f5c677fe640 1 -- 172.21.15.81:0/1546082111 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0acc00 con 0x55849c2e1660 2024-09-21T03:01:23.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.797+0000 7f5c8a529740 1 -- 172.21.15.81:0/1546082111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 msgr2=0x55849c6d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.797+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6d0510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0b0fb0 tx=0x7f5c6c00cf90 comp rx=0 tx=0).stop 2024-09-21T03:01:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 -- 172.21.15.81:0/1546082111 shutdown_connections 2024-09-21T03:01:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6d0510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c6c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 --2- 172.21.15.81:0/1546082111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 -- 172.21.15.81:0/1546082111 >> 172.21.15.81:0/1546082111 conn(0x55849c2fe910 msgr2=0x55849c6b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 -- 172.21.15.81:0/1546082111 shutdown_connections 2024-09-21T03:01:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 -- 172.21.15.81:0/1546082111 wait complete. 2024-09-21T03:01:23.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 -- start start 2024-09-21T03:01:23.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.798+0000 7f5c8a529740 1 Processor -- start 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c8a529740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c73a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c8a529740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c1acd80 con 0x55849c2c8ea0 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c8a529740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c1ae1f0 con 0x55849c2e9840 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c8a529740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c1ad450 con 0x55849c2e1660 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c8a529740 10 client.0 _ll_register_callbacks cb 0x7f5c74009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c81550640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c81550640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:55986/0 (socket says 172.21.15.81:55986) 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.799+0000 7f5c81550640 1 -- 172.21.15.81:0/2385685716 learned_addr learned my addr 172.21.15.81:0/2385685716 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81d51640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c82552640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c73a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81550640 1 -- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 msgr2=0x55849c73a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81550640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c73a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81550640 1 -- 172.21.15.81:0/2385685716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 msgr2=0x55849c6c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81550640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81550640 1 -- 172.21.15.81:0/2385685716 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55849c3ec960 con 0x55849c2e1660 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81d51640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c81550640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6c93d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0ad880 tx=0x7f5c6c013b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3785f9e21b999d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c657fa640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c657fa640 1 -- 172.21.15.81:0/2385685716 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0b0510 con 0x55849c2e1660 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c657fa640 1 -- 172.21.15.81:0/2385685716 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5c6c0b06b0 con 0x55849c2e1660 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.800+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c6c0b5d90 con 0x55849c2e1660 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c657fa640 1 -- 172.21.15.81:0/2385685716 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5c6c0bf050 con 0x55849c2e1660 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c8a529740 10 client.25153 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55849c741960 con 0x55849c2e1660 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c657fa640 1 -- 172.21.15.81:0/2385685716 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c6c0b5d90 con 0x55849c2e1660 2024-09-21T03:01:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c657fa640 1 -- 172.21.15.81:0/2385685716 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5c6c0e4ce0 con 0x55849c2e1660 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c8a529740 10 client.25153 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c8a529740 10 client.25153 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c8a529740 20 client.25153 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c30a520 0x55849c743fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.801+0000 7f5c8a529740 4 client.25153 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8c5b082b", "release": true, "await": true}] 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.802+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8c5b082b", "release": true, "await": true}) -- 0x55849c62a140 con 0x55849c30a520 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.802+0000 7f5c81d51640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c30a520 0x55849c743fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.802+0000 7f5c657fa640 10 client.25153 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:23.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.802+0000 7f5c81d51640 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c30a520 0x55849c743fc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6449df96cafb27c server_cookie=aa02cf5f94f08baf in_seq=0 out_seq=0 2024-09-21T03:01:23.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c657fa640 1 -- 172.21.15.81:0/2385685716 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55849c62a140 con 0x55849c30a520 2024-09-21T03:01:23.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c657fa640 10 client.25153 handle_command_reply: tid=0 2024-09-21T03:01:23.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 client.25153 shutdown 2024-09-21T03:01:23.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 msgr2=0x55849c6c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6c93d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0ad880 tx=0x7f5c6c013b90 comp rx=0 tx=0).stop 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 shutdown_connections 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55849c30a520 0x55849c743fc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55849c2e1660 0x55849c6c93d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55849c2e9840 0x55849c73a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 --2- 172.21.15.81:0/2385685716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55849c2c8ea0 0x55849c6c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c657fa640 0 client.25153 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.804+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 >> 172.21.15.81:0/2385685716 conn(0x55849c2fe910 msgr2=0x55849c6b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.805+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 shutdown_connections 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.805+0000 7f5c8a529740 1 -- 172.21.15.81:0/2385685716 wait complete. 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.805+0000 7f5c8a529740 20 client.25153 trim_cache size 0 max 16384 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:01:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 25, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 4, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "8c5b082b": { 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 4, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 134.5, 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:01:23.810 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:23.811 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5c680b6590 msgr2=0x7f5c680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5c680b6590 0x7f5c680b8aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c74011630 tx=0x7f5c74009500 comp rx=0 tx=0).stop 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c7c1094b0 msgr2=0x7f5c7c19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c7c1094b0 0x7f5c7c19a9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c075ab0 tx=0x7f5c6c009f90 comp rx=0 tx=0).stop 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 shutdown_connections 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5c680b6590 0x7f5c680b8aa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c7c1094b0 0x7f5c7c19a9f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c7c109e00 0x7f5c7c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 --2- 172.21.15.81:0/1715128633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c7c101f70 0x7f5c7c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.806+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 >> 172.21.15.81:0/1715128633 conn(0x7f5c7c077c60 msgr2=0x7f5c7c1075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.807+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 shutdown_connections 2024-09-21T03:01:23.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:23.807+0000 7f5c83fb5640 1 -- 172.21.15.81:0/1715128633 wait complete. 2024-09-21T03:01:24.665 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8c5b082b', total seconds elapsed: 18.4 2024-09-21T03:01:25.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:25 smithi164 ceph-mon[34236]: pgmap v390: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:25.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:25 smithi181 ceph-mon[34096]: pgmap v390: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:25.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:25 smithi081 ceph-mon[30991]: pgmap v390: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:01:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.031+0000 7f6d6c107640 1 -- 172.21.15.81:0/1027233286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103fc0 msgr2=0x7f6d6410a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.031+0000 7f6d6c107640 1 --2- 172.21.15.81:0/1027233286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103fc0 0x7f6d6410a960 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009c90 tx=0x7f6d5c02a860 comp rx=0 tx=0).stop 2024-09-21T03:01:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.032+0000 7f6d6c107640 1 -- 172.21.15.81:0/1027233286 shutdown_connections 2024-09-21T03:01:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.032+0000 7f6d6c107640 1 --2- 172.21.15.81:0/1027233286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d64103620 0x7f6d64103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.032+0000 7f6d6c107640 1 --2- 172.21.15.81:0/1027233286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103fc0 0x7f6d6410a960 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.032+0000 7f6d6c107640 1 --2- 172.21.15.81:0/1027233286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d641025a0 0x7f6d64102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.032+0000 7f6d6c107640 1 -- 172.21.15.81:0/1027233286 >> 172.21.15.81:0/1027233286 conn(0x7f6d640fdee0 msgr2=0x7f6d64100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.032+0000 7f6d6c107640 1 -- 172.21.15.81:0/1027233286 shutdown_connections 2024-09-21T03:01:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.032+0000 7f6d6c107640 1 -- 172.21.15.81:0/1027233286 wait complete. 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 Processor -- start 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 -- start start 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d641025a0 0x7f6d64199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103620 0x7f6d6419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d64103fc0 0x7f6d6419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410f1d0 con 0x7f6d64103620 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d696a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103620 0x7f6d6419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d696a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103620 0x7f6d6419a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53706/0 (socket says 172.21.15.81:53706) 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d696a2640 1 -- 172.21.15.81:0/3229516442 learned_addr learned my addr 172.21.15.81:0/3229516442 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410f050 con 0x7f6d641025a0 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.033+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410f350 con 0x7f6d64103fc0 2024-09-21T03:01:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d641025a0 0x7f6d64199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d64103fc0 0x7f6d6419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d696a2640 1 -- 172.21.15.81:0/3229516442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d64103fc0 msgr2=0x7f6d6419ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d64103fc0 0x7f6d6419ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d696a2640 1 -- 172.21.15.81:0/3229516442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d641025a0 msgr2=0x7f6d64199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d641025a0 0x7f6d64199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d696a2640 1 -- 172.21.15.81:0/3229516442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6419b690 con 0x7f6d64103620 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d64103fc0 0x7f6d6419ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103620 0x7f6d6419a2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400d770 tx=0x7f6d5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d5affd640 1 -- 172.21.15.81:0/3229516442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54017070 con 0x7f6d64103620 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d5affd640 1 -- 172.21.15.81:0/3229516442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d540054b0 con 0x7f6d64103620 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6419b980 con 0x7f6d64103620 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.034+0000 7f6d5affd640 1 -- 172.21.15.81:0/3229516442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54004c60 con 0x7f6d64103620 2024-09-21T03:01:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.035+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d641a2070 con 0x7f6d64103620 2024-09-21T03:01:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.038+0000 7f6d73073740 1 Processor -- start 2024-09-21T03:01:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.038+0000 7f6d73073740 1 -- start start 2024-09-21T03:01:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d73073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502f91b0 0x55ea5069ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d73073740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d73073740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502d84d0 0x55ea506b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d73073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea506136f0 con 0x55ea502f91b0 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d73073740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ea50602b20 con 0x55ea502d84d0 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d73073740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ea50606930 con 0x55ea502d02f0 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d6a6a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502f91b0 0x55ea5069ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d6a6a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502f91b0 0x55ea5069ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53718/0 (socket says 172.21.15.81:53718) 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d6a6a4640 1 -- 172.21.15.81:0/3954092659 learned_addr learned my addr 172.21.15.81:0/3954092659 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.039+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d6a6a4640 1 -- 172.21.15.81:0/3954092659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 msgr2=0x55ea5069f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d6a6a4640 1 -- 172.21.15.81:0/3954092659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502d84d0 msgr2=0x55ea506b0d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502d84d0 0x55ea506b0d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d6a6a4640 1 -- 172.21.15.81:0/3954092659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea505c8530 con 0x55ea502f91b0 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d5affd640 1 -- 172.21.15.81:0/3229516442 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6d54004e00 con 0x7f6d64103620 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502f91b0 0x55ea5069ecf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009c90 tx=0x7f6d5c0010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684f47613872f847 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.040+0000 7f6d4ffff640 1 -- 172.21.15.81:0/3954092659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0316f0 con 0x55ea502f91b0 2024-09-21T03:01:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.041+0000 7f6d4ffff640 1 -- 172.21.15.81:0/3954092659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d5c036040 con 0x55ea502f91b0 2024-09-21T03:01:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.041+0000 7f6d4ffff640 1 -- 172.21.15.81:0/3954092659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0307c0 con 0x55ea502f91b0 2024-09-21T03:01:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.041+0000 7f6d5affd640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6d500b6610 0x7f6d500b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.041+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6d500b6610 0x7f6d500b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.041+0000 7f6d5affd640 1 -- 172.21.15.81:0/3229516442 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f6d540e7010 con 0x7f6d64103620 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 -- 172.21.15.81:0/3954092659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502f91b0 msgr2=0x55ea5069ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502f91b0 0x55ea5069ecf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c009c90 tx=0x7f6d5c0010b0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 -- 172.21.15.81:0/3954092659 shutdown_connections 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502d84d0 0x55ea506b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 --2- 172.21.15.81:0/3954092659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502f91b0 0x55ea5069ecf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 -- 172.21.15.81:0/3954092659 >> 172.21.15.81:0/3954092659 conn(0x55ea502ed300 msgr2=0x55ea5069c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 -- 172.21.15.81:0/3954092659 shutdown_connections 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6d500b6610 0x7f6d500b8b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005d00 tx=0x7f6d6000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.042+0000 7f6d73073740 1 -- 172.21.15.81:0/3954092659 wait complete. 2024-09-21T03:01:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 -- start start 2024-09-21T03:01:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 Processor -- start 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea5053aab0 con 0x55ea502d02f0 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ea505a8730 con 0x55ea502f91b0 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ea506b1380 con 0x55ea502d84d0 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d69ea3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d73073740 10 client.0 _ll_register_callbacks cb 0x55ea505fc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.043+0000 7f6d69ea3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53730/0 (socket says 172.21.15.81:53730) 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3040106523 learned_addr learned my addr 172.21.15.81:0/3040106523 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3040106523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 msgr2=0x55ea506b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 msgr2=0x55ea506b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3040106523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea50364790 con 0x55ea502d02f0 2024-09-21T03:01:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b2e90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6d60010890 tx=0x7f6d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca190c67bc99ec35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.044+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3040106523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60004220 con 0x55ea502d02f0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d5c036040 con 0x55ea502d02f0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3040106523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f6d600043c0 con 0x55ea502d02f0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3040106523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d6000f840 con 0x55ea502d02f0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 10 client.15633 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea503dd620 con 0x55ea502d02f0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3040106523 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d5c036040 con 0x55ea502d02f0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3040106523 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6d60003c00 con 0x55ea502d02f0 2024-09-21T03:01:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 10 client.15633 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 10 client.15633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 20 client.15633 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea502b7d80 0x55ea506c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 4 client.15633 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.045+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea50615640 con 0x55ea502b7d80 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.046+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea502b7d80 0x55ea506c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.046+0000 7f6d4d7fa640 10 client.15633 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.046+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea502b7d80 0x55ea506c0b60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af888453992fbbe1 server_cookie=904f3676bfc702f8 in_seq=0 out_seq=0 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3040106523 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea50615640 con 0x55ea502b7d80 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d4d7fa640 10 client.15633 handle_command_reply: tid=0 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 client.15633 shutdown 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 msgr2=0x55ea506b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b2e90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6d60010890 tx=0x7f6d600046c0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 shutdown_connections 2024-09-21T03:01:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea502b7d80 0x55ea506c0b60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 --2- 172.21.15.81:0/3040106523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b2e90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 >> 172.21.15.81:0/3040106523 conn(0x55ea502ed300 msgr2=0x55ea5069d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d4d7fa640 0 client.15633 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 shutdown_connections 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.047+0000 7f6d73073740 1 -- 172.21.15.81:0/3040106523 wait complete. 2024-09-21T03:01:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.048+0000 7f6d73073740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T03:01:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.076+0000 7f6d73073740 1 Processor -- start 2024-09-21T03:01:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.076+0000 7f6d73073740 1 -- start start 2024-09-21T03:01:26.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d73073740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d73073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d84d0 0x55ea506b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d73073740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea5069c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d73073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641acab0 con 0x55ea502d84d0 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d696a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d84d0 0x55ea506b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d696a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d84d0 0x55ea506b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53732/0 (socket says 172.21.15.81:53732) 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d696a2640 1 -- 172.21.15.81:0/515745436 learned_addr learned my addr 172.21.15.81:0/515745436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d73073740 1 -- 172.21.15.81:0/515745436 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641aa380 con 0x55ea502f91b0 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d73073740 1 -- 172.21.15.81:0/515745436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641a81d0 con 0x55ea502d02f0 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea5069c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d69ea3640 1 -- 172.21.15.81:0/515745436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 msgr2=0x55ea5069c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea5069c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d69ea3640 1 -- 172.21.15.81:0/515745436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d84d0 msgr2=0x55ea506b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d84d0 0x55ea506b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d69ea3640 1 -- 172.21.15.81:0/515745436 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea506c1130 con 0x55ea502d02f0 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.077+0000 7f6d696a2640 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d84d0 0x55ea506b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.078+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d60010860 tx=0x7f6d60004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa2af12449d648a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.078+0000 7f6d4f7fe640 1 -- 172.21.15.81:0/515745436 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60010440 con 0x55ea502d02f0 2024-09-21T03:01:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.078+0000 7f6d4f7fe640 1 -- 172.21.15.81:0/515745436 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d6000fbe0 con 0x55ea502d02f0 2024-09-21T03:01:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.078+0000 7f6d4f7fe640 1 -- 172.21.15.81:0/515745436 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60034680 con 0x55ea502d02f0 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 -- 172.21.15.81:0/515745436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 msgr2=0x55ea5069f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6d60010860 tx=0x7f6d60004730 comp rx=0 tx=0).stop 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 -- 172.21.15.81:0/515745436 shutdown_connections 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea5069c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d84d0 0x55ea506b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 --2- 172.21.15.81:0/515745436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d02f0 0x55ea5069f0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 -- 172.21.15.81:0/515745436 >> 172.21.15.81:0/515745436 conn(0x55ea502ed300 msgr2=0x55ea5069e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.079+0000 7f6d73073740 1 -- 172.21.15.81:0/515745436 shutdown_connections 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.080+0000 7f6d73073740 1 -- 172.21.15.81:0/515745436 wait complete. 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.080+0000 7f6d73073740 1 -- start start 2024-09-21T03:01:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.080+0000 7f6d73073740 1 Processor -- start 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d73073740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d73073740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d73073740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d73073740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641a8840 con 0x55ea502d02f0 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d73073740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641a9cb0 con 0x55ea502f91b0 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d73073740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6d641a8f10 con 0x55ea502d84d0 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53744/0 (socket says 172.21.15.81:53744) 2024-09-21T03:01:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3353019294 learned_addr learned my addr 172.21.15.81:0/3353019294 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d73073740 10 client.0 _ll_register_callbacks cb 0x7f6d6000bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3353019294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 msgr2=0x55ea506b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 msgr2=0x55ea506b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d69ea3640 1 -- 172.21.15.81:0/3353019294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea506b7490 con 0x55ea502d02f0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.081+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d6a6a4640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d69ea3640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b5b00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6d60000c00 tx=0x7f6d60004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720d617a50c19a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3353019294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60034620 con 0x55ea502d02f0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3353019294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f6d600347c0 con 0x55ea502d02f0 2024-09-21T03:01:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d6000fbe0 con 0x55ea502d02f0 2024-09-21T03:01:26.086 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3353019294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d6004e050 con 0x55ea502d02f0 2024-09-21T03:01:26.086 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.082+0000 7f6d73073740 10 client.15639 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:26.086 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.083+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea506ba7a0 con 0x55ea502d02f0 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.083+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3353019294 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d60042070 con 0x55ea502d02f0 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3353019294 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6d6003c900 con 0x55ea502d02f0 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d73073740 10 client.15639 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d73073740 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d73073740 20 client.15639 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d73073740 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea5028d1c0 0x55ea5072d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d73073740 4 client.15639 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:01:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f6d6000fbe0 con 0x55ea5028d1c0 2024-09-21T03:01:26.088 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea5028d1c0 0x55ea5072d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:26.088 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d696a2640 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea5028d1c0 0x55ea5072d570 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d62ab527c6c59f server_cookie=5a5b78cf6d447dc3 in_seq=0 out_seq=0 2024-09-21T03:01:26.088 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.084+0000 7f6d4d7fa640 10 client.15639 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.091+0000 7f6d4d7fa640 1 -- 172.21.15.81:0/3353019294 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f6d6000fbe0 con 0x55ea5028d1c0 2024-09-21T03:01:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.091+0000 7f6d4d7fa640 10 client.15639 handle_command_reply: tid=0 2024-09-21T03:01:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.091+0000 7f6d73073740 1 client.15639 shutdown 2024-09-21T03:01:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.091+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 msgr2=0x55ea506b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.091+0000 7f6d73073740 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b5b00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6d60000c00 tx=0x7f6d60004660 comp rx=0 tx=0).stop 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.091+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 shutdown_connections 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.091+0000 7f6d73073740 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ea5028d1c0 0x55ea5072d570 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d73073740 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea502d84d0 0x55ea506b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d73073740 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ea502f91b0 0x55ea506b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d73073740 1 --2- 172.21.15.81:0/3353019294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea502d02f0 0x55ea506b5b00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 >> 172.21.15.81:0/3353019294 conn(0x55ea502ed300 msgr2=0x55ea5069c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d4d7fa640 0 client.15639 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 shutdown_connections 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d73073740 1 -- 172.21.15.81:0/3353019294 wait complete. 2024-09-21T03:01:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.092+0000 7f6d73073740 20 client.15639 trim_cache size 0 max 16384 2024-09-21T03:01:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:01:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:01:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:01:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:01:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6d500b6610 msgr2=0x7f6d500b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6d500b6610 0x7f6d500b8b20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005d00 tx=0x7f6d6000b410 comp rx=0 tx=0).stop 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103620 msgr2=0x7f6d6419a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103620 0x7f6d6419a2c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400d770 tx=0x7f6d5400dc30 comp rx=0 tx=0).stop 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 shutdown_connections 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6d500b6610 0x7f6d500b8b20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6d64103fc0 0x7f6d6419ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d64103620 0x7f6d6419a2c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 --2- 172.21.15.81:0/3229516442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d641025a0 0x7f6d64199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 >> 172.21.15.81:0/3229516442 conn(0x7f6d640fdee0 msgr2=0x7f6d64106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 shutdown_connections 2024-09-21T03:01:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:26.093+0000 7f6d6c107640 1 -- 172.21.15.81:0/3229516442 wait complete. 2024-09-21T03:01:27.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:27 smithi164 ceph-mon[34236]: pgmap v391: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:27.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:27 smithi181 ceph-mon[34096]: pgmap v391: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:27.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:27 smithi081 ceph-mon[30991]: pgmap v391: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:29.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:29 smithi164 ceph-mon[34236]: pgmap v392: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:01:29.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:29 smithi181 ceph-mon[34096]: pgmap v392: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:01:29.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:29 smithi081 ceph-mon[30991]: pgmap v392: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:01:31.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:31 smithi164 ceph-mon[34236]: pgmap v393: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:01:31.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:31 smithi181 ceph-mon[34096]: pgmap v393: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:01:31.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:31 smithi081 ceph-mon[30991]: pgmap v393: 129 pgs: 129 active+clean; 674 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T03:01:33.681 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:33 smithi164 ceph-mon[34236]: pgmap v394: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T03:01:33.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:33 smithi181 ceph-mon[34096]: pgmap v394: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T03:01:33.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:33 smithi081 ceph-mon[30991]: pgmap v394: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T03:01:35.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:35 smithi181 ceph-mon[34096]: pgmap v395: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:35 smithi081 ceph-mon[30991]: pgmap v395: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:35 smithi164 ceph-mon[34236]: pgmap v395: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:37.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:37 smithi181 ceph-mon[34096]: pgmap v396: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:37.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:37 smithi081 ceph-mon[30991]: pgmap v396: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:37 smithi164 ceph-mon[34236]: pgmap v396: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 -- 172.21.15.81:0/2817754407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103620 msgr2=0x7fe424103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2817754407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103620 0x7fe424103a30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe418009900 tx=0x7fe41802a410 comp rx=0 tx=0).stop 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 -- 172.21.15.81:0/2817754407 shutdown_connections 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2817754407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe424103fc0 0x7fe42410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2817754407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103620 0x7fe424103a30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2817754407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4241025a0 0x7fe424102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 -- 172.21.15.81:0/2817754407 >> 172.21.15.81:0/2817754407 conn(0x7fe4240fdee0 msgr2=0x7fe424100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 -- 172.21.15.81:0/2817754407 shutdown_connections 2024-09-21T03:01:39.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.241+0000 7fe429fdf640 1 -- 172.21.15.81:0/2817754407 wait complete. 2024-09-21T03:01:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.242+0000 7fe429fdf640 1 Processor -- start 2024-09-21T03:01:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.242+0000 7fe429fdf640 1 -- start start 2024-09-21T03:01:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe429fdf640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4241025a0 0x7fe424198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe429fdf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103fc0 0x7fe4241995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe429fdf640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe42419a0a0 0x7fe42419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103fc0 0x7fe4241995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103fc0 0x7fe4241995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60514/0 (socket says 172.21.15.81:60514) 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe4237fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4241025a0 0x7fe424198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe422ffd640 1 -- 172.21.15.81:0/2649200160 learned_addr learned my addr 172.21.15.81:0/2649200160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410e170 con 0x7fe424103fc0 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410dff0 con 0x7fe4241025a0 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410e2f0 con 0x7fe42419a0a0 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.243+0000 7fe423fff640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe42419a0a0 0x7fe42419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe422ffd640 1 -- 172.21.15.81:0/2649200160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe42419a0a0 msgr2=0x7fe42419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe422ffd640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe42419a0a0 0x7fe42419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe422ffd640 1 -- 172.21.15.81:0/2649200160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4241025a0 msgr2=0x7fe424198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe422ffd640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4241025a0 0x7fe424198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe422ffd640 1 -- 172.21.15.81:0/2649200160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42419adc0 con 0x7fe424103fc0 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe4237fe640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4241025a0 0x7fe424198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe422ffd640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103fc0 0x7fe4241995e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe41802a980 tx=0x7fe418003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe420ff9640 1 -- 172.21.15.81:0/2649200160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41803f020 con 0x7fe424103fc0 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.244+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42406abe0 con 0x7fe424103fc0 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.245+0000 7fe420ff9640 1 -- 172.21.15.81:0/2649200160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe418031b90 con 0x7fe424103fc0 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.245+0000 7fe420ff9640 1 -- 172.21.15.81:0/2649200160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418035070 con 0x7fe424103fc0 2024-09-21T03:01:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.246+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42406b1d0 con 0x7fe424103fc0 2024-09-21T03:01:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe420ff9640 1 -- 172.21.15.81:0/2649200160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe418042020 con 0x7fe424103fc0 2024-09-21T03:01:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 Processor -- start 2024-09-21T03:01:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 -- start start 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf801b0 0x55dc4d330660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf572f0 0x55dc4d330cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d331820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dc4d29a6f0 con 0x55dc4cf801b0 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55dc4d289b20 con 0x55dc4cf572f0 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.249+0000 7fe431028740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dc4d28d930 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf801b0 0x55dc4d330660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf801b0 0x55dc4d330660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60520/0 (socket says 172.21.15.81:60520) 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 -- 172.21.15.81:0/3178352578 learned_addr learned my addr 172.21.15.81:0/3178352578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe4237fe640 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf572f0 0x55dc4d330cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 -- 172.21.15.81:0/3178352578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf5f4d0 msgr2=0x55dc4d331820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe422ffd640 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d331820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d331820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 -- 172.21.15.81:0/3178352578 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf572f0 msgr2=0x55dc4d330cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf572f0 0x55dc4d330cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 -- 172.21.15.81:0/3178352578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc4d24f530 con 0x55dc4cf801b0 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe4237fe640 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf572f0 0x55dc4d330cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.250+0000 7fe423fff640 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf801b0 0x55dc4d330660 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00b440 tx=0x7fe41c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a015fa0b88a378 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.251+0000 7fe409ffb640 1 -- 172.21.15.81:0/3178352578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c007780 con 0x55dc4cf801b0 2024-09-21T03:01:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.251+0000 7fe409ffb640 1 -- 172.21.15.81:0/3178352578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe41c007db0 con 0x55dc4cf801b0 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.251+0000 7fe409ffb640 1 -- 172.21.15.81:0/3178352578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c018d30 con 0x55dc4cf801b0 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.251+0000 7fe420ff9640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe40c0b6790 0x7fe40c0b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.251+0000 7fe4237fe640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe40c0b6790 0x7fe40c0b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.251+0000 7fe420ff9640 1 -- 172.21.15.81:0/2649200160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe41803b920 con 0x7fe424103fc0 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 -- 172.21.15.81:0/3178352578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf801b0 msgr2=0x55dc4d330660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe4237fe640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe40c0b6790 0x7fe40c0b8ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe41400bfd0 tx=0x7fe414011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf801b0 0x55dc4d330660 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00b440 tx=0x7fe41c00b840 comp rx=0 tx=0).stop 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 -- 172.21.15.81:0/3178352578 shutdown_connections 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d331820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf572f0 0x55dc4d330cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 --2- 172.21.15.81:0/3178352578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf801b0 0x55dc4d330660 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 -- 172.21.15.81:0/3178352578 >> 172.21.15.81:0/3178352578 conn(0x55dc4cf74300 msgr2=0x55dc4d3238e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 -- 172.21.15.81:0/3178352578 shutdown_connections 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 -- 172.21.15.81:0/3178352578 wait complete. 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.252+0000 7fe431028740 1 -- start start 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 1 Processor -- start 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d339e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d33a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d33b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dc4d1c1ab0 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55dc4d22f730 con 0x55dc4cf801b0 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55dc4d332340 con 0x55dc4cf572f0 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe431028740 10 client.0 _ll_register_callbacks cb 0x55dc4d2836b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d33a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d33a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60526/0 (socket says 172.21.15.81:60526) 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe422ffd640 1 -- 172.21.15.81:0/414574427 learned_addr learned my addr 172.21.15.81:0/414574427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.253+0000 7fe4237fe640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d339e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe423fff640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d33b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe4237fe640 1 -- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 msgr2=0x55dc4d33b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe4237fe640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d33b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe4237fe640 1 -- 172.21.15.81:0/414574427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 msgr2=0x55dc4d33a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe4237fe640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d33a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe4237fe640 1 -- 172.21.15.81:0/414574427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc4cfeb790 con 0x55dc4cf572f0 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe423fff640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d33b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe422ffd640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d33a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe4237fe640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d339e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe414011010 tx=0x7fe414004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2407ee0d791c60a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.254+0000 7fe402ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-21T03:01:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe402ffd640 1 -- 172.21.15.81:0/414574427 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41401ad30 con 0x55dc4cf572f0 2024-09-21T03:01:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe402ffd640 1 -- 172.21.15.81:0/414574427 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe4140243f0 con 0x55dc4cf572f0 2024-09-21T03:01:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe41c007db0 con 0x55dc4cf572f0 2024-09-21T03:01:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe402ffd640 1 -- 172.21.15.81:0/414574427 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe414032050 con 0x55dc4cf572f0 2024-09-21T03:01:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe431028740 10 client.25180 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dc4d064620 con 0x55dc4cf572f0 2024-09-21T03:01:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe402ffd640 1 -- 172.21.15.81:0/414574427 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe41c007db0 con 0x55dc4cf572f0 2024-09-21T03:01:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe402ffd640 1 -- 172.21.15.81:0/414574427 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe41402d440 con 0x55dc4cf572f0 2024-09-21T03:01:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe431028740 10 client.25180 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe431028740 10 client.25180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.255+0000 7fe431028740 20 client.25180 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.256+0000 7fe431028740 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf3ed80 0x55dc4d347610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.256+0000 7fe431028740 4 client.25180 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.256+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc4d29c640 con 0x55dc4cf3ed80 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.256+0000 7fe422ffd640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf3ed80 0x55dc4d347610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.256+0000 7fe402ffd640 10 client.25180 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.256+0000 7fe422ffd640 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf3ed80 0x55dc4d347610 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95b09925a36cda6d server_cookie=febeeef6577d0e32 in_seq=0 out_seq=0 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe402ffd640 1 -- 172.21.15.81:0/414574427 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc4d29c640 con 0x55dc4cf3ed80 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe402ffd640 10 client.25180 handle_command_reply: tid=0 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 client.25180 shutdown 2024-09-21T03:01:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 msgr2=0x55dc4d339e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d339e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe414011010 tx=0x7fe414004730 comp rx=0 tx=0).stop 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 shutdown_connections 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf3ed80 0x55dc4d347610 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d33b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d33a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe402ffd640 0 client.25180 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 --2- 172.21.15.81:0/414574427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d339e40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.257+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 >> 172.21.15.81:0/414574427 conn(0x55dc4cf74300 msgr2=0x55dc4d330bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.258+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 shutdown_connections 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.258+0000 7fe431028740 1 -- 172.21.15.81:0/414574427 wait complete. 2024-09-21T03:01:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.258+0000 7fe431028740 20 client.25180 trim_cache size 0 max 16384 2024-09-21T03:01:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 Processor -- start 2024-09-21T03:01:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 -- start start 2024-09-21T03:01:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf572f0 0x55dc4d31e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d3225b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf801b0 0x55dc4d34bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241ad150 con 0x55dc4cf572f0 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241aaa20 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.272+0000 7fe431028740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241a8870 con 0x55dc4cf801b0 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf572f0 0x55dc4d31e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf572f0 0x55dc4d31e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60528/0 (socket says 172.21.15.81:60528) 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 -- 172.21.15.81:0/2372725159 learned_addr learned my addr 172.21.15.81:0/2372725159 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe423fff640 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf801b0 0x55dc4d34bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe422ffd640 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d3225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 -- 172.21.15.81:0/2372725159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf801b0 msgr2=0x55dc4d34bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf801b0 0x55dc4d34bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 -- 172.21.15.81:0/2372725159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf5f4d0 msgr2=0x55dc4d3225b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d3225b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 -- 172.21.15.81:0/2372725159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc4d33b3e0 con 0x55dc4cf572f0 2024-09-21T03:01:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe423fff640 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf801b0 0x55dc4d34bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4237fe640 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf572f0 0x55dc4d31e5c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe41401a3e0 tx=0x7fe414005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ab01d35d5e77e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4097fa640 1 -- 172.21.15.81:0/2372725159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41403c020 con 0x55dc4cf572f0 2024-09-21T03:01:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4097fa640 1 -- 172.21.15.81:0/2372725159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe414029070 con 0x55dc4cf572f0 2024-09-21T03:01:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.273+0000 7fe4097fa640 1 -- 172.21.15.81:0/2372725159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414038800 con 0x55dc4cf572f0 2024-09-21T03:01:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 -- 172.21.15.81:0/2372725159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf572f0 msgr2=0x55dc4d31e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf572f0 0x55dc4d31e5c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe41401a3e0 tx=0x7fe414005fb0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 -- 172.21.15.81:0/2372725159 shutdown_connections 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf801b0 0x55dc4d34bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d3225b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 --2- 172.21.15.81:0/2372725159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf572f0 0x55dc4d31e5c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 -- 172.21.15.81:0/2372725159 >> 172.21.15.81:0/2372725159 conn(0x55dc4cf74300 msgr2=0x55dc4d321ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 -- 172.21.15.81:0/2372725159 shutdown_connections 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 -- 172.21.15.81:0/2372725159 wait complete. 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 -- start start 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.275+0000 7fe431028740 1 Processor -- start 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe431028740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d341490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe431028740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d341b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe431028740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d3aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe431028740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241a8ee0 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe431028740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241aa350 con 0x55dc4cf801b0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe431028740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe4241a95b0 con 0x55dc4cf572f0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d341b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe431028740 10 client.0 _ll_register_callbacks cb 0x7fe414005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d341b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60538/0 (socket says 172.21.15.81:60538) 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 -- 172.21.15.81:0/3726411991 learned_addr learned my addr 172.21.15.81:0/3726411991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe4237fe640 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d341490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe423fff640 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d3aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 -- 172.21.15.81:0/3726411991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 msgr2=0x55dc4d341490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d341490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 -- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 msgr2=0x55dc4d3aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d3aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 -- 172.21.15.81:0/3726411991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc4d3aa950 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe422ffd640 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d341b50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe418005ab0 tx=0x7fe418107e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82137aad916a0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.276+0000 7fe402ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.277+0000 7fe402ffd640 1 -- 172.21.15.81:0/3726411991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4180d2020 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.277+0000 7fe402ffd640 1 -- 172.21.15.81:0/3726411991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe4180f10c0 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.277+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe414029070 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.277+0000 7fe402ffd640 1 -- 172.21.15.81:0/3726411991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe418035040 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.277+0000 7fe431028740 10 client.15657 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.277+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dc4d3b1cf0 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.277+0000 7fe402ffd640 1 -- 172.21.15.81:0/3726411991 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe414029070 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe402ffd640 1 -- 172.21.15.81:0/3726411991 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe4180c9dc0 con 0x55dc4cf5f4d0 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe431028740 10 client.15657 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe431028740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe431028740 20 client.15657 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe431028740 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf141c0 0x55dc4d3b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe431028740 4 client.15657 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:01:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc4d2980f0 con 0x55dc4cf141c0 2024-09-21T03:01:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe4237fe640 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf141c0 0x55dc4d3b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.278+0000 7fe4237fe640 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf141c0 0x55dc4d3b4710 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8103744f0f865bb7 server_cookie=fbfe13dbdb9e615 in_seq=0 out_seq=0 2024-09-21T03:01:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.279+0000 7fe402ffd640 10 client.15657 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.284+0000 7fe402ffd640 1 -- 172.21.15.81:0/3726411991 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc4d2980f0 con 0x55dc4cf141c0 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe402ffd640 10 client.15657 handle_command_reply: tid=0 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 client.15657 shutdown 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 msgr2=0x55dc4d341b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d341b50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe418005ab0 tx=0x7fe418107e00 comp rx=0 tx=0).stop 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 shutdown_connections 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55dc4cf141c0 0x55dc4d3b4710 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dc4cf801b0 0x55dc4d3aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dc4cf5f4d0 0x55dc4d341b50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 --2- 172.21.15.81:0/3726411991 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc4cf572f0 0x55dc4d341490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 >> 172.21.15.81:0/3726411991 conn(0x55dc4cf74300 msgr2=0x55dc4d321ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe402ffd640 0 client.15657 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 shutdown_connections 2024-09-21T03:01:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 1 -- 172.21.15.81:0/3726411991 wait complete. 2024-09-21T03:01:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.285+0000 7fe431028740 20 client.15657 trim_cache size 0 max 16384 2024-09-21T03:01:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:01:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:01:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:01:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:01:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe40c0b6790 msgr2=0x7fe40c0b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe40c0b6790 0x7fe40c0b8ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe41400bfd0 tx=0x7fe414011040 comp rx=0 tx=0).stop 2024-09-21T03:01:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103fc0 msgr2=0x7fe4241995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103fc0 0x7fe4241995e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe41802a980 tx=0x7fe418003bb0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 shutdown_connections 2024-09-21T03:01:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe40c0b6790 0x7fe40c0b8ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe42419a0a0 0x7fe42419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424103fc0 0x7fe4241995e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 --2- 172.21.15.81:0/2649200160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4241025a0 0x7fe424198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 >> 172.21.15.81:0/2649200160 conn(0x7fe4240fdee0 msgr2=0x7fe424106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 shutdown_connections 2024-09-21T03:01:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:39.286+0000 7fe429fdf640 1 -- 172.21.15.81:0/2649200160 wait complete. 2024-09-21T03:01:39.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:39 smithi181 ceph-mon[34096]: pgmap v397: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:39.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:39 smithi081 ceph-mon[30991]: pgmap v397: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:39.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:39 smithi164 ceph-mon[34236]: pgmap v397: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:41.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:41 smithi181 ceph-mon[34096]: pgmap v398: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:41.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:41 smithi081 ceph-mon[30991]: pgmap v398: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:41.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:41 smithi164 ceph-mon[34236]: pgmap v398: 129 pgs: 129 active+clean; 675 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:43.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:43 smithi181 ceph-mon[34096]: pgmap v399: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:43.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:43 smithi081 ceph-mon[30991]: pgmap v399: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:43.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:43 smithi164 ceph-mon[34236]: pgmap v399: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:01:45.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:45 smithi181 ceph-mon[34096]: pgmap v400: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:45.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:45 smithi081 ceph-mon[30991]: pgmap v400: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:45.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:45 smithi164 ceph-mon[34236]: pgmap v400: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:01:46.471 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-21T03:01:46.472 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-09-21T03:01:46.473 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-21T03:01:46.473 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T03:01:46.473 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-21T03:01:46.473 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:01:46.476 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T03:01:46.543 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T03:01:46.545 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:01:46.545 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T03:01:47.195 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T03:01:47.266 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T03:01:47.306 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:01:47.307 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:01:47.308 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T03:01:47.345 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:01:47.349 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T03:01:47.349 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T03:01:47.408 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-21T03:01:47.409 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-21T03:01:47.409 DEBUG:teuthology.orchestra.run.smithi081:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-21T03:01:47.478 INFO:tasks.workunit.client.0.smithi081.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-21T03:01:47.557 INFO:tasks.workunit.client.0.smithi081.stdout: Iozone: Performance Test of File I/O 2024-09-21T03:01:47.557 INFO:tasks.workunit.client.0.smithi081.stdout: Version $Revision: 3.494 $ 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Compiled for 64 bit mode. 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Build: linux-AMD64 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:01:47.558 INFO:tasks.workunit.client.0.smithi081.stdout: Run began: Sat Sep 21 03:01:47 2024 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Include close in write timing 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Include fsync in write timing 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: File size set to 1048576 kB 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Record Size 16 kB 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Output is in kBytes/sec 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Processor cache line size set to 32 bytes. 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: File stride size set to 17 * record size. 2024-09-21T03:01:47.559 INFO:tasks.workunit.client.0.smithi081.stdout: Throughput test with 1 process 2024-09-21T03:01:47.560 INFO:tasks.workunit.client.0.smithi081.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-21T03:01:47.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:47 smithi181 ceph-mon[34096]: pgmap v401: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:47.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:47 smithi081 ceph-mon[30991]: pgmap v401: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:47.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:47 smithi164 ceph-mon[34236]: pgmap v401: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:49.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:49 smithi181 ceph-mon[34096]: pgmap v402: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:49.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:49 smithi081 ceph-mon[30991]: pgmap v402: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:49.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:49 smithi164 ceph-mon[34236]: pgmap v402: 129 pgs: 129 active+clean; 676 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:01:51.595 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T03:01:51.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:01:51.733 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:51 smithi164 ceph-mon[34236]: pgmap v403: 129 pgs: 129 active+clean; 49 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-09-21T03:01:51.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:51 smithi181 ceph-mon[34096]: pgmap v403: 129 pgs: 129 active+clean; 49 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-09-21T03:01:51.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:51 smithi081 ceph-mon[30991]: pgmap v403: 129 pgs: 129 active+clean; 49 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-09-21T03:01:51.887 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 -- 172.21.15.81:0/1579447779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24801025b0 msgr2=0x7f2480102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 --2- 172.21.15.81:0/1579447779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24801025b0 0x7f2480102a20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f247c009900 tx=0x7f247c02a410 comp rx=0 tx=0).stop 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 -- 172.21.15.81:0/1579447779 shutdown_connections 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 --2- 172.21.15.81:0/1579447779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2480103fd0 0x7f248010a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 --2- 172.21.15.81:0/1579447779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2480103630 0x7f2480103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 --2- 172.21.15.81:0/1579447779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24801025b0 0x7f2480102a20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 -- 172.21.15.81:0/1579447779 >> 172.21.15.81:0/1579447779 conn(0x7f24800fdf30 msgr2=0x7f24801003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 -- 172.21.15.81:0/1579447779 shutdown_connections 2024-09-21T03:01:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.409+0000 7f24879b0640 1 -- 172.21.15.81:0/1579447779 wait complete. 2024-09-21T03:01:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 Processor -- start 2024-09-21T03:01:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 -- start start 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24801025b0 0x7f2480198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480103630 0x7f2480199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2480103fd0 0x7f2480199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f248010e0b0 con 0x7f2480103630 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f248010df30 con 0x7f24801025b0 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f24879b0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f248010e230 con 0x7f2480103fd0 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480103630 0x7f2480199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480103630 0x7f2480199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53050/0 (socket says 172.21.15.81:53050) 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 -- 172.21.15.81:0/827793568 learned_addr learned my addr 172.21.15.81:0/827793568 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f248574c640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24801025b0 0x7f2480198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2485f4d640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2480103fd0 0x7f2480199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 -- 172.21.15.81:0/827793568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2480103fd0 msgr2=0x7f2480199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2480103fd0 0x7f2480199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 -- 172.21.15.81:0/827793568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24801025b0 msgr2=0x7f2480198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24801025b0 0x7f2480198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.410+0000 7f2484f4b640 1 -- 172.21.15.81:0/827793568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248019a7d0 con 0x7f2480103630 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.411+0000 7f2484f4b640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480103630 0x7f2480199400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2470009f20 tx=0x7f247000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.411+0000 7f24767fc640 1 -- 172.21.15.81:0/827793568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247001e070 con 0x7f2480103630 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.411+0000 7f24767fc640 1 -- 172.21.15.81:0/827793568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247000cd80 con 0x7f2480103630 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.411+0000 7f24767fc640 1 -- 172.21.15.81:0/827793568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470019820 con 0x7f2480103630 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.411+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248019aac0 con 0x7f2480103630 2024-09-21T03:01:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.411+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248006b780 con 0x7f2480103630 2024-09-21T03:01:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.415+0000 7f248e9f5740 1 Processor -- start 2024-09-21T03:01:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.415+0000 7f248e9f5740 1 -- start start 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.415+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f738e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.415+0000 7f24767fc640 1 -- 172.21.15.81:0/827793568 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2470011030 con 0x7f2480103630 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f7394c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f73a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f738e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f738e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:46112/0 (socket says 172.21.15.81:46112) 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 -- 172.21.15.81:0/2973691269 learned_addr learned my addr 172.21.15.81:0/2973691269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f248574c640 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f7394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a55f6ab6f0 con 0x55a55f3682f0 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a55f69ab20 con 0x55a55f3704d0 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a55f69e930 con 0x55a55f3911b0 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2484f4b640 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f73a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 -- 172.21.15.81:0/2973691269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 msgr2=0x55a55f73a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f73a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 -- 172.21.15.81:0/2973691269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 msgr2=0x55a55f7394c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f7394c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f2485f4d640 1 -- 172.21.15.81:0/2973691269 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a55f660530 con 0x55a55f3911b0 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f2485f4d640 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f738e50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2478010370 tx=0x7f2478010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7ce9c3abbadd1ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f24767fc640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f246c0ba9a0 0x7f246c0bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f246b7fe640 1 -- 172.21.15.81:0/2973691269 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478016070 con 0x55a55f3911b0 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f248574c640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f246c0ba9a0 0x7f246c0bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f24767fc640 1 -- 172.21.15.81:0/827793568 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f24700e79b0 con 0x7f2480103630 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f246b7fe640 1 -- 172.21.15.81:0/2973691269 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2478004d20 con 0x55a55f3911b0 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f246b7fe640 1 -- 172.21.15.81:0/2973691269 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478005280 con 0x55a55f3911b0 2024-09-21T03:01:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.418+0000 7f248574c640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f246c0ba9a0 0x7f246c0bceb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f247c0057c0 tx=0x7f247c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.418+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 msgr2=0x55a55f738e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.418+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f738e50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2478010370 tx=0x7f2478010830 comp rx=0 tx=0).stop 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 shutdown_connections 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f73a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f7394c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2973691269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f738e50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 >> 172.21.15.81:0/2973691269 conn(0x55a55f385300 msgr2=0x55a55f7348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 shutdown_connections 2024-09-21T03:01:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 -- 172.21.15.81:0/2973691269 wait complete. 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 -- start start 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f248e9f5740 1 Processor -- start 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f742630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f742cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3911b0 0x55a55f743860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248e9f5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a55f5d2ab0 con 0x55a55f3911b0 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248574c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f742630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248574c640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f742630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:46124/0 (socket says 172.21.15.81:46124) 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248574c640 1 -- 172.21.15.81:0/2479240358 learned_addr learned my addr 172.21.15.81:0/2479240358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f2484f4b640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f742cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a55f640730 con 0x55a55f3704d0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f2485f4d640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3911b0 0x55a55f743860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a55f73ab30 con 0x55a55f3682f0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f248e9f5740 10 client.0 _ll_register_callbacks cb 0x55a55f6946b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f2484f4b640 1 -- 172.21.15.81:0/2479240358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 msgr2=0x55a55f742630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f2484f4b640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f742630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.420+0000 7f2484f4b640 1 -- 172.21.15.81:0/2479240358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3911b0 msgr2=0x55a55f743860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2484f4b640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3911b0 0x55a55f743860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2484f4b640 1 -- 172.21.15.81:0/2479240358 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55f3fc790 con 0x55a55f3704d0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f248574c640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f742630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2484f4b640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f742cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24700e51c0 tx=0x7f24700a9860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c6ca1b68e28ea20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2468ff9640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2468ff9640 1 -- 172.21.15.81:0/2479240358 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700e7e60 con 0x55a55f3704d0 2024-09-21T03:01:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2468ff9640 1 -- 172.21.15.81:0/2479240358 <== mon.2 v2:172.21.15.164:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f24700a9200 con 0x55a55f3704d0 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2478004d20 con 0x55a55f3704d0 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2468ff9640 1 -- 172.21.15.81:0/2479240358 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24700b20d0 con 0x55a55f3704d0 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f248e9f5740 10 client.25253 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a55f475620 con 0x55a55f3704d0 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f2468ff9640 1 -- 172.21.15.81:0/2479240358 <== mon.2 v2:172.21.15.164:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24700d2080 con 0x55a55f3704d0 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f2468ff9640 1 -- 172.21.15.81:0/2479240358 <== mon.2 v2:172.21.15.164:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f24700a9400 con 0x55a55f3704d0 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f248e9f5740 10 client.25253 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f248e9f5740 10 client.25253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f248e9f5740 20 client.25253 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f34fd80 0x55a55f74fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f248e9f5740 4 client.25253 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2478004d20 con 0x55a55f34fd80 2024-09-21T03:01:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f248574c640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f34fd80 0x55a55f74fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f2468ff9640 10 client.25253 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.423+0000 7f248574c640 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f34fd80 0x55a55f74fcc0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e24240e34e84573 server_cookie=c6b5c126f2642697 in_seq=0 out_seq=0 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.423+0000 7f2468ff9640 1 -- 172.21.15.81:0/2479240358 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2478004d20 con 0x55a55f34fd80 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.423+0000 7f2468ff9640 10 client.25253 handle_command_reply: tid=0 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.423+0000 7f248e9f5740 1 client.25253 shutdown 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 msgr2=0x55a55f742cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f742cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24700e51c0 tx=0x7f24700a9860 comp rx=0 tx=0).stop 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 shutdown_connections 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f34fd80 0x55a55f74fcc0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3911b0 0x55a55f743860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3704d0 0x55a55f742cf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 --2- 172.21.15.81:0/2479240358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f742630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f2468ff9640 0 client.25253 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 >> 172.21.15.81:0/2479240358 conn(0x55a55f385300 msgr2=0x55a55f732ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 shutdown_connections 2024-09-21T03:01:52.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 1 -- 172.21.15.81:0/2479240358 wait complete. 2024-09-21T03:01:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.424+0000 7f248e9f5740 20 client.25253 trim_cache size 0 max 16384 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.414+0000 7f4d24322640 1 -- 172.21.15.81:0/3898577748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c109e00 msgr2=0x7f4d1c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.414+0000 7f4d24322640 1 --2- 172.21.15.81:0/3898577748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c109e00 0x7f4d1c110630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009be0 tx=0x7f4d1402a6c0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.414+0000 7f4d24322640 1 -- 172.21.15.81:0/3898577748 shutdown_connections 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.414+0000 7f4d24322640 1 --2- 172.21.15.81:0/3898577748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c109e00 0x7f4d1c110630 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.414+0000 7f4d24322640 1 --2- 172.21.15.81:0/3898577748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d1c1094b0 0x7f4d1c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.414+0000 7f4d24322640 1 --2- 172.21.15.81:0/3898577748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 0x7f4d1c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.414+0000 7f4d24322640 1 -- 172.21.15.81:0/3898577748 >> 172.21.15.81:0/3898577748 conn(0x7f4d1c077c60 msgr2=0x7f4d1c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.415+0000 7f4d24322640 1 -- 172.21.15.81:0/3898577748 shutdown_connections 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.415+0000 7f4d24322640 1 -- 172.21.15.81:0/3898577748 wait complete. 2024-09-21T03:01:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 Processor -- start 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 -- start start 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 0x7f4d1c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c1094b0 0x7f4d1c103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d1c109e00 0x7f4d1c103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c113970 con 0x7f4d1c1094b0 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1137f0 con 0x7f4d1c109e00 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.416+0000 7f4d24322640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c113af0 con 0x7f4d1c101f70 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 0x7f4d1c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 0x7f4d1c102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:46120/0 (socket says 172.21.15.81:46120) 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 -- 172.21.15.81:0/719588438 learned_addr learned my addr 172.21.15.81:0/719588438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d218bd640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c1094b0 0x7f4d1c103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d228bf640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d1c109e00 0x7f4d1c103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 -- 172.21.15.81:0/719588438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d1c109e00 msgr2=0x7f4d1c103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d1c109e00 0x7f4d1c103990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 -- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c1094b0 msgr2=0x7f4d1c103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c1094b0 0x7f4d1c103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 -- 172.21.15.81:0/719588438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c1a8640 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d220be640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 0x7f4d1c102f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00e9f0 tx=0x7f4d0c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d137fe640 1 -- 172.21.15.81:0/719588438 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00ccc0 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.417+0000 7f4d137fe640 1 -- 172.21.15.81:0/719588438 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d0c0108c0 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.418+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c1a8930 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.418+0000 7f4d137fe640 1 -- 172.21.15.81:0/719588438 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c018750 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.418+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c1a8e70 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.419+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c102380 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.421+0000 7f4d137fe640 1 -- 172.21.15.81:0/719588438 <== mon.1 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4d0c010430 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f4d137fe640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4d080b6660 0x7f4d080b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f4d218bd640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4d080b6660 0x7f4d080b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f4d137fe640 1 -- 172.21.15.81:0/719588438 <== mon.1 v2:172.21.15.181:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f4d0c0e7bd0 con 0x7f4d1c101f70 2024-09-21T03:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.422+0000 7f4d218bd640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4d080b6660 0x7f4d080b8b70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c106f70 tx=0x7f4d18009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.425+0000 7f4d137fe640 1 -- 172.21.15.81:0/719588438 <== mon.1 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d0c0ae140 con 0x7f4d1c101f70 2024-09-21T03:01:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.447+0000 7f248e9f5740 1 Processor -- start 2024-09-21T03:01:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.447+0000 7f248e9f5740 1 -- start start 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.447+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f743fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.447+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3704d0 0x55a55f734220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.447+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3911b0 0x55a55f741850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f248e9f5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24801acab0 con 0x55a55f3704d0 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3704d0 0x55a55f734220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3704d0 0x55a55f734220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53096/0 (socket says 172.21.15.81:53096) 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 -- 172.21.15.81:0/4282745713 learned_addr learned my addr 172.21.15.81:0/4282745713 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f248e9f5740 1 -- 172.21.15.81:0/4282745713 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f24801aa380 con 0x55a55f3911b0 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f248e9f5740 1 -- 172.21.15.81:0/4282745713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24801a81d0 con 0x55a55f3682f0 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f248574c640 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f743fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2485f4d640 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3911b0 0x55a55f741850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 -- 172.21.15.81:0/4282745713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 msgr2=0x55a55f743fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f743fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 -- 172.21.15.81:0/4282745713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3911b0 msgr2=0x55a55f741850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3911b0 0x55a55f741850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 -- 172.21.15.81:0/4282745713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a55f736270 con 0x55a55f3704d0 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.448+0000 7f2484f4b640 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3704d0 0x55a55f734220 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f24700a9e80 tx=0x7f2470011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82a4fa4a2ffe2eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.449+0000 7f246affd640 1 -- 172.21.15.81:0/4282745713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700ad200 con 0x55a55f3704d0 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.449+0000 7f246affd640 1 -- 172.21.15.81:0/4282745713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24700b20d0 con 0x55a55f3704d0 2024-09-21T03:01:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.449+0000 7f246affd640 1 -- 172.21.15.81:0/4282745713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470005040 con 0x55a55f3704d0 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 -- 172.21.15.81:0/4282745713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3704d0 msgr2=0x55a55f734220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3704d0 0x55a55f734220 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f24700a9e80 tx=0x7f2470011da0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 -- 172.21.15.81:0/4282745713 shutdown_connections 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3911b0 0x55a55f741850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3704d0 0x55a55f734220 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 --2- 172.21.15.81:0/4282745713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3682f0 0x55a55f743fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 -- 172.21.15.81:0/4282745713 >> 172.21.15.81:0/4282745713 conn(0x55a55f385300 msgr2=0x55a55f741050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 -- 172.21.15.81:0/4282745713 shutdown_connections 2024-09-21T03:01:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.450+0000 7f248e9f5740 1 -- 172.21.15.81:0/4282745713 wait complete. 2024-09-21T03:01:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.451+0000 7f248e9f5740 1 -- start start 2024-09-21T03:01:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.451+0000 7f248e9f5740 1 Processor -- start 2024-09-21T03:01:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f747860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f747f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248e9f5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3251c0 0x55a55f748a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248e9f5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24801a8840 con 0x55a55f3682f0 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248e9f5740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f24801a9cb0 con 0x55a55f3251c0 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248e9f5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f24801a8f10 con 0x55a55f3911b0 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f747860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f747860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53106/0 (socket says 172.21.15.81:53106) 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 -- 172.21.15.81:0/696751675 learned_addr learned my addr 172.21.15.81:0/696751675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f2485f4d640 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3251c0 0x55a55f748a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248e9f5740 10 client.0 _ll_register_callbacks cb 0x7f247000cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f2484f4b640 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f747f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 -- 172.21.15.81:0/696751675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 msgr2=0x55a55f747f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f747f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 -- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3251c0 msgr2=0x55a55f748a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3251c0 0x55a55f748a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 -- 172.21.15.81:0/696751675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55f7491f0 con 0x55a55f3682f0 2024-09-21T03:01:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f248574c640 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f747860 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f247c005ab0 tx=0x7f247c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9779ebf330d566 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.452+0000 7f2468ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.456+0000 7f2468ff9640 1 -- 172.21.15.81:0/696751675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c05d060 con 0x55a55f3682f0 2024-09-21T03:01:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.456+0000 7f2468ff9640 1 -- 172.21.15.81:0/696751675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f247c0035f0 con 0x55a55f3682f0 2024-09-21T03:01:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.456+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24700b20d0 con 0x55a55f3682f0 2024-09-21T03:01:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.456+0000 7f2468ff9640 1 -- 172.21.15.81:0/696751675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f247c064050 con 0x55a55f3682f0 2024-09-21T03:01:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.456+0000 7f248e9f5740 10 client.15681 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.456+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a55f74a570 con 0x55a55f3682f0 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.456+0000 7f2468ff9640 1 -- 172.21.15.81:0/696751675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f247c003c80 con 0x55a55f3682f0 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f2468ff9640 1 -- 172.21.15.81:0/696751675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f247c044040 con 0x55a55f3682f0 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f248e9f5740 10 client.15681 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f248e9f5740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f248e9f5740 20 client.15681 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f248e9f5740 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f7c3150 0x55a55f7c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f248e9f5740 4 client.15681 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f24700b20d0 con 0x55a55f7c3150 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f2484f4b640 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f7c3150 0x55a55f7c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f2484f4b640 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f7c3150 0x55a55f7c5570 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e35d5aea7ea6d5b server_cookie=7a73c359a26f4bde in_seq=0 out_seq=0 2024-09-21T03:01:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.457+0000 7f2468ff9640 10 client.15681 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.465+0000 7f2468ff9640 1 -- 172.21.15.81:0/696751675 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f24700b20d0 con 0x55a55f7c3150 2024-09-21T03:01:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.465+0000 7f2468ff9640 10 client.15681 handle_command_reply: tid=0 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.465+0000 7f248e9f5740 1 client.15681 shutdown 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.465+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 msgr2=0x55a55f747860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.465+0000 7f248e9f5740 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f747860 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f247c005ab0 tx=0x7f247c02a410 comp rx=0 tx=0).stop 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 shutdown_connections 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a55f7c3150 0x55a55f7c5570 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a55f3911b0 0x55a55f747f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a55f3251c0 0x55a55f748a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 --2- 172.21.15.81:0/696751675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a55f3682f0 0x55a55f747860 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 >> 172.21.15.81:0/696751675 conn(0x55a55f385300 msgr2=0x55a55f743f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f2468ff9640 0 client.15681 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 shutdown_connections 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 1 -- 172.21.15.81:0/696751675 wait complete. 2024-09-21T03:01:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.466+0000 7f248e9f5740 20 client.15681 trim_cache size 0 max 16384 2024-09-21T03:01:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:01:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:01:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:01:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f246c0ba9a0 msgr2=0x7f246c0bceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f246c0ba9a0 0x7f246c0bceb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f247c0057c0 tx=0x7f247c000bc0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480103630 msgr2=0x7f2480199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480103630 0x7f2480199400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2470009f20 tx=0x7f247000ee80 comp rx=0 tx=0).stop 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 shutdown_connections 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f246c0ba9a0 0x7f246c0bceb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2480103fd0 0x7f2480199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480103630 0x7f2480199400 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 --2- 172.21.15.81:0/827793568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24801025b0 0x7f2480198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 >> 172.21.15.81:0/827793568 conn(0x7f24800fdf30 msgr2=0x7f2480106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 shutdown_connections 2024-09-21T03:01:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:01:52.467+0000 7f24879b0640 1 -- 172.21.15.81:0/827793568 wait complete. 2024-09-21T03:01:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.723+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d1c104210 con 0x7f4d1c101f70 2024-09-21T03:01:52.725 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:01:52.725 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:01:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.724+0000 7f4d137fe640 1 -- 172.21.15.81:0/719588438 <== mon.1 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f4d1c104210 con 0x7f4d1c101f70 2024-09-21T03:01:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:01:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4d080b6660 msgr2=0x7f4d080b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4d080b6660 0x7f4d080b8b70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c106f70 tx=0x7f4d18009260 comp rx=0 tx=0).stop 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 msgr2=0x7f4d1c102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 0x7f4d1c102f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00e9f0 tx=0x7f4d0c00edf0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 shutdown_connections 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4d080b6660 0x7f4d080b8b70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d1c109e00 0x7f4d1c103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1c1094b0 0x7f4d1c103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 --2- 172.21.15.81:0/719588438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d1c101f70 0x7f4d1c102f10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 >> 172.21.15.81:0/719588438 conn(0x7f4d1c077c60 msgr2=0x7f4d1c105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 shutdown_connections 2024-09-21T03:01:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:52.727+0000 7f4d24322640 1 -- 172.21.15.81:0/719588438 wait complete. 2024-09-21T03:01:53.553 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T03:01:53.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T03:01:53.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:53 smithi181 ceph-mon[34096]: pgmap v404: 129 pgs: 129 active+clean; 261 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 MiB/s wr, 14 op/s 2024-09-21T03:01:53.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:53 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/719588438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:53.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:53 smithi081 ceph-mon[30991]: pgmap v404: 129 pgs: 129 active+clean; 261 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 MiB/s wr, 14 op/s 2024-09-21T03:01:53.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:53 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/719588438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:53.869 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:01:53.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:53 smithi164 ceph-mon[34236]: pgmap v404: 129 pgs: 129 active+clean; 261 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 22 MiB/s wr, 14 op/s 2024-09-21T03:01:53.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:53 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/719588438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:01:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.429+0000 7fb2fcde8640 1 -- 172.21.15.81:0/2013847951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 msgr2=0x7fb2f810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.429+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/2013847951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f810f540 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009ca0 tx=0x7fb2f002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.430+0000 7fb2fcde8640 1 -- 172.21.15.81:0/2013847951 shutdown_connections 2024-09-21T03:01:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.430+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/2013847951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f810f540 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.430+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/2013847951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f81083c0 0x7fb2f81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.430+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/2013847951 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2f8103190 0x7fb2f81035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.430+0000 7fb2fcde8640 1 -- 172.21.15.81:0/2013847951 >> 172.21.15.81:0/2013847951 conn(0x7fb2f8079f50 msgr2=0x7fb2f807a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.430+0000 7fb2fcde8640 1 -- 172.21.15.81:0/2013847951 shutdown_connections 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.430+0000 7fb2fcde8640 1 -- 172.21.15.81:0/2013847951 wait complete. 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 Processor -- start 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 -- start start 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f8103190 0x7fb2f819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2f81083c0 0x7fb2f819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81128d0 con 0x7fb2f8108d10 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f8112750 con 0x7fb2f8103190 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2fcde8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f8112a50 con 0x7fb2f81083c0 2024-09-21T03:01:54.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2f6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2f6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f819bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53126/0 (socket says 172.21.15.81:53126) 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2f6d9d640 1 -- 172.21.15.81:0/3388568646 learned_addr learned my addr 172.21.15.81:0/3388568646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2f659c640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f8103190 0x7fb2f819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.431+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2f81083c0 0x7fb2f819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2f6d9d640 1 -- 172.21.15.81:0/3388568646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2f81083c0 msgr2=0x7fb2f819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2f6d9d640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2f81083c0 0x7fb2f819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2f6d9d640 1 -- 172.21.15.81:0/3388568646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f8103190 msgr2=0x7fb2f819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2f6d9d640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f8103190 0x7fb2f819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2f6d9d640 1 -- 172.21.15.81:0/3388568646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f81a6490 con 0x7fb2f8108d10 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2f6d9d640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f819bc80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005cc0 tx=0x7fb2f0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2e77fe640 1 -- 172.21.15.81:0/3388568646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0032e00 con 0x7fb2f8108d10 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f81a6720 con 0x7fb2f8108d10 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2e77fe640 1 -- 172.21.15.81:0/3388568646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2f00044d0 con 0x7fb2f8108d10 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2e77fe640 1 -- 172.21.15.81:0/3388568646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0030b70 con 0x7fb2f8108d10 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.432+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f81a6cb0 con 0x7fb2f8108d10 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.435+0000 7fb30335c740 1 Processor -- start 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.435+0000 7fb2e77fe640 1 -- 172.21.15.81:0/3388568646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb2f0030d10 con 0x7fb2f8108d10 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.435+0000 7fb30335c740 1 -- start start 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb30335c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad8a19840 0x55cad8dc0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb30335c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8dc0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb30335c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dc1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb30335c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cad8d36b90 con 0x55cad89f8b60 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb30335c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55cad8d25fc0 con 0x55cad89f0980 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb30335c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cad8d29dd0 con 0x55cad8a19840 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dc1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dc1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53142/0 (socket says 172.21.15.81:53142) 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3448652134 learned_addr learned my addr 172.21.15.81:0/3448652134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad8a19840 0x55cad8dc0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2e77fe640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2e00b6540 0x7fb2e00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3448652134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad8a19840 msgr2=0x55cad8dc0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad8a19840 0x55cad8dc0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3448652134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 msgr2=0x55cad8dc0b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8dc0b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f6d9d640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2e00b6540 0x7fb2e00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2e77fe640 1 -- 172.21.15.81:0/3388568646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb2f0108870 con 0x7fb2f8108d10 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.436+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3448652134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad8cad060 con 0x55cad89f8b60 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.437+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dc1080 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec005d00 tx=0x7fb2ec005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ad2f562d4c5f33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.437+0000 7fb2e4ff9640 1 -- 172.21.15.81:0/3448652134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec012ca0 con 0x55cad89f8b60 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.437+0000 7fb2f6d9d640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2e00b6540 0x7fb2e00b8a50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00ce3c0 tx=0x7fb2f00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.437+0000 7fb2e4ff9640 1 -- 172.21.15.81:0/3448652134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2ec012e40 con 0x55cad89f8b60 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.437+0000 7fb2e4ff9640 1 -- 172.21.15.81:0/3448652134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec004a00 con 0x55cad89f8b60 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 -- 172.21.15.81:0/3448652134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 msgr2=0x55cad8dc1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dc1080 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec005d00 tx=0x7fb2ec005c90 comp rx=0 tx=0).stop 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 -- 172.21.15.81:0/3448652134 shutdown_connections 2024-09-21T03:01:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dc1080 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8dc0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 --2- 172.21.15.81:0/3448652134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad8a19840 0x55cad8dc0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 -- 172.21.15.81:0/3448652134 >> 172.21.15.81:0/3448652134 conn(0x55cad8a0d990 msgr2=0x55cad8dbe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 -- 172.21.15.81:0/3448652134 shutdown_connections 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.438+0000 7fb30335c740 1 -- 172.21.15.81:0/3448652134 wait complete. 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 -- start start 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 Processor -- start 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dcc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dcc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad8a19840 0x55cad8dd80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cad8b877a0 con 0x55cad89f8b60 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55cad8ccb0a0 con 0x55cad8a19840 2024-09-21T03:01:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55cad8dcede0 con 0x55cad89f0980 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb30335c740 10 client.0 _ll_register_callbacks cb 0x55cad8ca83c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.439+0000 7fb2f659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dcc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad8a19840 0x55cad8dd80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dcc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53150/0 (socket says 172.21.15.81:53150) 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f659c640 1 -- 172.21.15.81:0/1680180549 learned_addr learned my addr 172.21.15.81:0/1680180549 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad8a19840 0x55cad8dd80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:32890/0 (socket says 172.21.15.81:32890) 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dcc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/1680180549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 msgr2=0x55cad8dcc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dcc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/1680180549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 msgr2=0x55cad8dcc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dcc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/1680180549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad8cb9880 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad8a19840 0x55cad8dd80d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec005410 tx=0x7fb2ec01b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db3e94f6665e212 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2ddffb640 1 -- 172.21.15.81:0/1680180549 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec004020 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cad8d38ae0 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.440+0000 7fb2ddffb640 1 -- 172.21.15.81:0/1680180549 <== mon.2 v2:172.21.15.164:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb2ec0041c0 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb2ddffb640 1 -- 172.21.15.81:0/1680180549 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2ec0043c0 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 10 client.25268 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cad8a93b90 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb2ddffb640 1 -- 172.21.15.81:0/1680180549 <== mon.2 v2:172.21.15.164:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cad8d38ae0 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb2ddffb640 1 -- 172.21.15.81:0/1680180549 <== mon.2 v2:172.21.15.164:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb2ec004950 con 0x55cad8a19840 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 10 client.25268 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 10 client.25268 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:01:54.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 20 client.25268 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad89d81c0 0x55cad8dddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 4 client.25268 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad8d34590 con 0x55cad89d81c0 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.441+0000 7fb2f659c640 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad89d81c0 0x55cad8dddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.442+0000 7fb2ddffb640 10 client.25268 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.442+0000 7fb2f659c640 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad89d81c0 0x55cad8dddfd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecfa9a6fbd7b77f2 server_cookie=c708c8c48749f2f3 in_seq=0 out_seq=0 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb2ddffb640 1 -- 172.21.15.81:0/1680180549 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cad8d34590 con 0x55cad89d81c0 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb2ddffb640 10 client.25268 handle_command_reply: tid=0 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 client.25268 shutdown 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad8a19840 msgr2=0x55cad8dd80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad8a19840 0x55cad8dd80d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec005410 tx=0x7fb2ec01b040 comp rx=0 tx=0).stop 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 shutdown_connections 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad89d81c0 0x55cad8dddfd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb2ddffb640 0 client.25268 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad8a19840 0x55cad8dd80d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8dcc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 --2- 172.21.15.81:0/1680180549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dcc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 >> 172.21.15.81:0/1680180549 conn(0x55cad8a0d990 msgr2=0x55cad8dc3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 shutdown_connections 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 1 -- 172.21.15.81:0/1680180549 wait complete. 2024-09-21T03:01:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.443+0000 7fb30335c740 20 client.25268 trim_cache size 0 max 16384 2024-09-21T03:01:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.464+0000 7fb30335c740 1 Processor -- start 2024-09-21T03:01:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.464+0000 7fb30335c740 1 -- start start 2024-09-21T03:01:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb30335c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89d81c0 0x55cad8dcdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb30335c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dd8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb30335c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f8b60 0x55cad8dd8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb30335c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81b5380 con 0x55cad89d81c0 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb30335c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81b2c50 con 0x55cad89f8b60 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb30335c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81b0aa0 con 0x55cad89f0980 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89d81c0 0x55cad8dcdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89d81c0 0x55cad8dcdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53160/0 (socket says 172.21.15.81:53160) 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3353858732 learned_addr learned my addr 172.21.15.81:0/3353858732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f659c640 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dd8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3353858732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 msgr2=0x55cad8dd8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dd8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3353858732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f8b60 msgr2=0x55cad8dd8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f8b60 0x55cad8dd8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/3353858732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad8dcc570 con 0x55cad89d81c0 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f659c640 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dd8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.465+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89d81c0 0x55cad8dcdff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec005c90 tx=0x7fb2ec005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca27ccdacd84c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.466+0000 7fb2dffff640 1 -- 172.21.15.81:0/3353858732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00ba60 con 0x55cad89d81c0 2024-09-21T03:01:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.466+0000 7fb2dffff640 1 -- 172.21.15.81:0/3353858732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2ec016040 con 0x55cad89d81c0 2024-09-21T03:01:54.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.466+0000 7fb2dffff640 1 -- 172.21.15.81:0/3353858732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0045e0 con 0x55cad89d81c0 2024-09-21T03:01:54.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 -- 172.21.15.81:0/3353858732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89d81c0 msgr2=0x55cad8dcdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89d81c0 0x55cad8dcdff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec005c90 tx=0x7fb2ec005cc0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 -- 172.21.15.81:0/3353858732 shutdown_connections 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89f0980 0x55cad8dd8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f8b60 0x55cad8dd8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 --2- 172.21.15.81:0/3353858732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89d81c0 0x55cad8dcdff0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 -- 172.21.15.81:0/3353858732 >> 172.21.15.81:0/3353858732 conn(0x55cad8a0d990 msgr2=0x55cad8dc1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 -- 172.21.15.81:0/3353858732 shutdown_connections 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 -- 172.21.15.81:0/3353858732 wait complete. 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 -- start start 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.467+0000 7fb30335c740 1 Processor -- start 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb30335c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89d81c0 0x55cad8de15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb30335c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8ddfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb30335c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8de0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb30335c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81b1110 con 0x55cad89f8b60 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb30335c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81b2580 con 0x55cad89f0980 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb30335c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81b17e0 con 0x55cad89d81c0 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb30335c740 10 client.0 _ll_register_callbacks cb 0x7fb2ec00be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8de0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8de0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53176/0 (socket says 172.21.15.81:53176) 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/701823990 learned_addr learned my addr 172.21.15.81:0/701823990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89d81c0 0x55cad8de15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f659c640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8ddfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/701823990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89d81c0 msgr2=0x55cad8de15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89d81c0 0x55cad8de15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 msgr2=0x55cad8ddfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8ddfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 -- 172.21.15.81:0/701823990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad8de05c0 con 0x55cad89f8b60 2024-09-21T03:01:54.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f659c640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8ddfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2f5d9b640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8de0000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00b790 tx=0x7fb2ec00b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374e1a6574164dde server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.468+0000 7fb2ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb2ddffb640 1 -- 172.21.15.81:0/701823990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec03e040 con 0x55cad89f8b60 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb2ddffb640 1 -- 172.21.15.81:0/701823990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb2ec0047e0 con 0x55cad89f8b60 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2ec016040 con 0x55cad89f8b60 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb2ddffb640 1 -- 172.21.15.81:0/701823990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2ec0049e0 con 0x55cad89f8b60 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 10 client.15699 fetch_fsmap learned FSMap version 25 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cad8e49470 con 0x55cad89f8b60 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb2ddffb640 1 -- 172.21.15.81:0/701823990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2ec016040 con 0x55cad89f8b60 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb2ddffb640 1 -- 172.21.15.81:0/701823990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb2ec045430 con 0x55cad89f8b60 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 10 client.15699 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 10 client.15699 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:01:54.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 20 client.15699 populate_metadata read hostname 'smithi081' 2024-09-21T03:01:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad8a19840 0x55cad8e4b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:01:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 4 client.15699 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T03:01:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.469+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x55cad8d319c0 con 0x55cad8a19840 2024-09-21T03:01:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.470+0000 7fb2f659c640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad8a19840 0x55cad8e4b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:01:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.470+0000 7fb2ddffb640 10 client.15699 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:54.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.470+0000 7fb2f659c640 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad8a19840 0x55cad8e4b970 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fce68b4993eef6f1 server_cookie=cbc846b36415abe8 in_seq=0 out_seq=0 2024-09-21T03:01:54.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.480+0000 7fb2ddffb640 1 -- 172.21.15.81:0/701823990 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55cad8d319c0 con 0x55cad8a19840 2024-09-21T03:01:54.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.480+0000 7fb2ddffb640 10 client.15699 handle_command_reply: tid=0 2024-09-21T03:01:54.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.480+0000 7fb30335c740 1 client.15699 shutdown 2024-09-21T03:01:54.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.480+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 msgr2=0x55cad8de0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.480+0000 7fb30335c740 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8de0000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00b790 tx=0x7fb2ec00b500 comp rx=0 tx=0).stop 2024-09-21T03:01:54.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 shutdown_connections 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55cad8a19840 0x55cad8e4b970 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad89f8b60 0x55cad8de0000 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cad89f0980 0x55cad8ddfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 --2- 172.21.15.81:0/701823990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55cad89d81c0 0x55cad8de15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 >> 172.21.15.81:0/701823990 conn(0x55cad8a0d990 msgr2=0x55cad8dc1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb2ddffb640 0 client.15699 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 shutdown_connections 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 1 -- 172.21.15.81:0/701823990 wait complete. 2024-09-21T03:01:54.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb30335c740 20 client.15699 trim_cache size 0 max 16384 2024-09-21T03:01:54.484 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:01:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 25, 2024-09-21T03:01:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:01:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 6, 2024-09-21T03:01:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:01:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "e1cefff0": { 2024-09-21T03:01:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 6, 2024-09-21T03:01:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:01:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:01:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:01:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:01:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:01:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:01:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 137.0, 2024-09-21T03:01:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:01:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:01:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:01:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:01:54.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2e00b6540 msgr2=0x7fb2e00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2e00b6540 0x7fb2e00b8a50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00ce3c0 tx=0x7fb2f00095c0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 msgr2=0x7fb2f819bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.481+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f819bc80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005cc0 tx=0x7fb2f0032a10 comp rx=0 tx=0).stop 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 shutdown_connections 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb2e00b6540 0x7fb2e00b8a50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb2f81083c0 0x7fb2f819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2f8108d10 0x7fb2f819bc80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 --2- 172.21.15.81:0/3388568646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f8103190 0x7fb2f819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 >> 172.21.15.81:0/3388568646 conn(0x7fb2f8079f50 msgr2=0x7fb2f81043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 shutdown_connections 2024-09-21T03:01:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:01:54.482+0000 7fb2fcde8640 1 -- 172.21.15.81:0/3388568646 wait complete. 2024-09-21T03:01:55.175 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e1cefff0', quiesce took 3.6 seconds. Will release after: 13.4 2024-09-21T03:01:55.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:55 smithi181 ceph-mon[34096]: pgmap v405: 129 pgs: 129 active+clean; 349 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 29 MiB/s wr, 14 op/s 2024-09-21T03:01:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:55 smithi081 ceph-mon[30991]: pgmap v405: 129 pgs: 129 active+clean; 349 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 29 MiB/s wr, 14 op/s 2024-09-21T03:01:55.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:55 smithi164 ceph-mon[34236]: pgmap v405: 129 pgs: 129 active+clean; 349 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 29 MiB/s wr, 14 op/s 2024-09-21T03:01:57.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:57 smithi181 ceph-mon[34096]: pgmap v406: 129 pgs: 129 active+clean; 569 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 47 MiB/s wr, 21 op/s 2024-09-21T03:01:57.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:57 smithi081 ceph-mon[30991]: pgmap v406: 129 pgs: 129 active+clean; 569 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 47 MiB/s wr, 21 op/s 2024-09-21T03:01:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:57 smithi164 ceph-mon[34236]: pgmap v406: 129 pgs: 129 active+clean; 569 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 47 MiB/s wr, 21 op/s 2024-09-21T03:01:59.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:01:59 smithi181 ceph-mon[34096]: pgmap v407: 129 pgs: 129 active+clean; 685 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 57 MiB/s wr, 24 op/s 2024-09-21T03:01:59.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:01:59 smithi081 ceph-mon[30991]: pgmap v407: 129 pgs: 129 active+clean; 685 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 57 MiB/s wr, 24 op/s 2024-09-21T03:01:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:01:59 smithi164 ceph-mon[34236]: pgmap v407: 129 pgs: 129 active+clean; 685 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 57 MiB/s wr, 24 op/s 2024-09-21T03:02:01.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:01 smithi181 ceph-mon[34096]: pgmap v408: 129 pgs: 129 active+clean; 701 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 58 MiB/s wr, 24 op/s 2024-09-21T03:02:01.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:01 smithi081 ceph-mon[30991]: pgmap v408: 129 pgs: 129 active+clean; 701 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 58 MiB/s wr, 24 op/s 2024-09-21T03:02:01.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:01 smithi164 ceph-mon[34236]: pgmap v408: 129 pgs: 129 active+clean; 701 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 58 MiB/s wr, 24 op/s 2024-09-21T03:02:03.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:03 smithi181 ceph-mon[34096]: pgmap v409: 129 pgs: 129 active+clean; 706 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 55 MiB/s wr, 25 op/s 2024-09-21T03:02:03.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:03 smithi081 ceph-mon[30991]: pgmap v409: 129 pgs: 129 active+clean; 706 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 55 MiB/s wr, 25 op/s 2024-09-21T03:02:03.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:03 smithi164 ceph-mon[34236]: pgmap v409: 129 pgs: 129 active+clean; 706 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 55 MiB/s wr, 25 op/s 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 -- 172.21.15.81:0/246484674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c103640 msgr2=0x7f053c103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 --2- 172.21.15.81:0/246484674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c103640 0x7f053c103a50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0530009900 tx=0x7f053002a410 comp rx=0 tx=0).stop 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 -- 172.21.15.81:0/246484674 shutdown_connections 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 --2- 172.21.15.81:0/246484674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f053c103fe0 0x7f053c10a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 --2- 172.21.15.81:0/246484674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c103640 0x7f053c103a50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 --2- 172.21.15.81:0/246484674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f053c1025c0 0x7f053c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 -- 172.21.15.81:0/246484674 >> 172.21.15.81:0/246484674 conn(0x7f053c0fdf00 msgr2=0x7f053c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 -- 172.21.15.81:0/246484674 shutdown_connections 2024-09-21T03:02:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.578+0000 7f054243f640 1 -- 172.21.15.81:0/246484674 wait complete. 2024-09-21T03:02:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 Processor -- start 2024-09-21T03:02:05.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 -- start start 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c1025c0 0x7f053c199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f053c103640 0x7f053c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f053c103fe0 0x7f053c19b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f053c06be90 con 0x7f053c1025c0 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f053c06bd10 con 0x7f053c103fe0 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f054243f640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f053c06c010 con 0x7f053c103640 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c1025c0 0x7f053c199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c1025c0 0x7f053c199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55760/0 (socket says 172.21.15.81:55760) 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 -- 172.21.15.81:0/2008827547 learned_addr learned my addr 172.21.15.81:0/2008827547 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f05409dc640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f053c103fe0 0x7f053c19b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053b7fe640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f053c103640 0x7f053c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 -- 172.21.15.81:0/2008827547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f053c103640 msgr2=0x7f053c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f053c103640 0x7f053c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 -- 172.21.15.81:0/2008827547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f053c103fe0 msgr2=0x7f053c19b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f053c103fe0 0x7f053c19b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053bfff640 1 -- 172.21.15.81:0/2008827547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c19b8e0 con 0x7f053c1025c0 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f05409dc640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f053c103fe0 0x7f053c19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.579+0000 7f053b7fe640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f053c103640 0x7f053c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.580+0000 7f053bfff640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c1025c0 0x7f053c199ea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f052c00d950 tx=0x7f052c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.580+0000 7f05397fa640 1 -- 172.21.15.81:0/2008827547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c017070 con 0x7f053c1025c0 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.580+0000 7f05397fa640 1 -- 172.21.15.81:0/2008827547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f052c009c30 con 0x7f053c1025c0 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.580+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053c19bbd0 con 0x7f053c1025c0 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.580+0000 7f05397fa640 1 -- 172.21.15.81:0/2008827547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c00f620 con 0x7f053c1025c0 2024-09-21T03:02:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.580+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053c1a22c0 con 0x7f053c1025c0 2024-09-21T03:02:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f05397fa640 1 -- 172.21.15.81:0/2008827547 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f052c010460 con 0x7f053c1025c0 2024-09-21T03:02:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 Processor -- start 2024-09-21T03:02:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 -- start start 2024-09-21T03:02:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dca8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8e04d0 0x55f37dcaa010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f37dc1b6f0 con 0x55f37d9011b0 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f37dc0ab20 con 0x55f37d8e04d0 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f054948a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f37dc0e930 con 0x55f37d8d82f0 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f05409dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dca8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f05409dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dca8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55768/0 (socket says 172.21.15.81:55768) 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f05409dc640 1 -- 172.21.15.81:0/2879893185 learned_addr learned my addr 172.21.15.81:0/2879893185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f053b7fe640 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8e04d0 0x55f37dcaa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f053bfff640 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f05409dc640 1 -- 172.21.15.81:0/2879893185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 msgr2=0x55f37dca94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f05409dc640 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.583+0000 7f05397fa640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f05240b6510 0x7f05240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05409dc640 1 -- 172.21.15.81:0/2879893185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8e04d0 msgr2=0x55f37dcaa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05409dc640 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8e04d0 0x55f37dcaa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05409dc640 1 -- 172.21.15.81:0/2879893185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37dbd0530 con 0x55f37d9011b0 2024-09-21T03:02:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f053bfff640 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05409dc640 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dca8e50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0534009fd0 tx=0x7f05340108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de281ced3e695985 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05397fa640 1 -- 172.21.15.81:0/2008827547 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f052c0e7330 con 0x7f053c1025c0 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05409dc640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f05240b6510 0x7f05240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05227fc640 1 -- 172.21.15.81:0/2879893185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534011940 con 0x55f37d9011b0 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05227fc640 1 -- 172.21.15.81:0/2879893185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0534011ce0 con 0x55f37d9011b0 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.584+0000 7f05227fc640 1 -- 172.21.15.81:0/2879893185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053401a800 con 0x55f37d9011b0 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 -- 172.21.15.81:0/2879893185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 msgr2=0x55f37dca8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f05409dc640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f05240b6510 0x7f05240b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f053401b000 tx=0x7f053401aeb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dca8e50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0534009fd0 tx=0x7f05340108e0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 -- 172.21.15.81:0/2879893185 shutdown_connections 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8e04d0 0x55f37dcaa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 --2- 172.21.15.81:0/2879893185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dca8e50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 -- 172.21.15.81:0/2879893185 >> 172.21.15.81:0/2879893185 conn(0x55f37d8f5300 msgr2=0x55f37dca48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 -- 172.21.15.81:0/2879893185 shutdown_connections 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 -- 172.21.15.81:0/2879893185 wait complete. 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.585+0000 7f054948a740 1 -- start start 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 1 Processor -- start 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcb25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d9011b0 0x55f37dcb37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f37db42ab0 con 0x55f37d8e04d0 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f37dbb0730 con 0x55f37d8d82f0 2024-09-21T03:02:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f37dcaab30 con 0x55f37d9011b0 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f054948a740 10 client.0 _ll_register_callbacks cb 0x55f37dc046b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55770/0 (socket says 172.21.15.81:55770) 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 -- 172.21.15.81:0/4116262617 learned_addr learned my addr 172.21.15.81:0/4116262617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053bfff640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcb25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f05409dc640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d9011b0 0x55f37dcb37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 -- 172.21.15.81:0/4116262617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d9011b0 msgr2=0x55f37dcb37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d9011b0 0x55f37dcb37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 -- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 msgr2=0x55f37dcb25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcb25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f053b7fe640 1 -- 172.21.15.81:0/4116262617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37d96c790 con 0x55f37d8e04d0 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.586+0000 7f05409dc640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d9011b0 0x55f37dcb37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f053b7fe640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb2c70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0530005ab0 tx=0x7f05300317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6d55a15e6f254b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f051b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f051b7fe640 1 -- 172.21.15.81:0/4116262617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530035030 con 0x55f37d8e04d0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f051b7fe640 1 -- 172.21.15.81:0/4116262617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f0530004240 con 0x55f37d8e04d0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0534011ce0 con 0x55f37d8e04d0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f051b7fe640 1 -- 172.21.15.81:0/4116262617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0530004440 con 0x55f37d8e04d0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 10 client.15711 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f37d9e5620 con 0x55f37d8e04d0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f051b7fe640 1 -- 172.21.15.81:0/4116262617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0534011ce0 con 0x55f37d8e04d0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f051b7fe640 1 -- 172.21.15.81:0/4116262617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f053003c670 con 0x55f37d8e04d0 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 10 client.15711 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 20 client.15711 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8bfd80 0x55f37dcbfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 4 client.15711 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:02:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.587+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f37dc1d640 con 0x55f37d8bfd80 2024-09-21T03:02:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.588+0000 7f053bfff640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8bfd80 0x55f37dcbfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.588+0000 7f051b7fe640 10 client.15711 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.588+0000 7f053bfff640 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8bfd80 0x55f37dcbfc60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247a05f0fc50b361 server_cookie=666bf38ed8db9b2 in_seq=0 out_seq=0 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f051b7fe640 1 -- 172.21.15.81:0/4116262617 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f37dc1d640 con 0x55f37d8bfd80 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f051b7fe640 10 client.15711 handle_command_reply: tid=0 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 client.15711 shutdown 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 msgr2=0x55f37dcb2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb2c70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0530005ab0 tx=0x7f05300317b0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 shutdown_connections 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8bfd80 0x55f37dcbfc60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d9011b0 0x55f37dcb37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb2c70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 --2- 172.21.15.81:0/4116262617 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcb25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f051b7fe640 0 client.15711 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 >> 172.21.15.81:0/4116262617 conn(0x55f37d8f5300 msgr2=0x55f37dca9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 shutdown_connections 2024-09-21T03:02:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 1 -- 172.21.15.81:0/4116262617 wait complete. 2024-09-21T03:02:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.589+0000 7f054948a740 20 client.15711 trim_cache size 0 max 16384 2024-09-21T03:02:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 Processor -- start 2024-09-21T03:02:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 -- start start 2024-09-21T03:02:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d9011b0 0x55f37dcb2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f053c1aedc0 con 0x55f37d8e04d0 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f053c1ac690 con 0x55f37d9011b0 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f054948a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f053c1aa4e0 con 0x55f37d8d82f0 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55780/0 (socket says 172.21.15.81:55780) 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 -- 172.21.15.81:0/3486602545 learned_addr learned my addr 172.21.15.81:0/3486602545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f05409dc640 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d9011b0 0x55f37dcb2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053bfff640 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 -- 172.21.15.81:0/3486602545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 msgr2=0x55f37dca9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 -- 172.21.15.81:0/3486602545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d9011b0 msgr2=0x55f37dcb2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d9011b0 0x55f37dcb2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.604+0000 7f053b7fe640 1 -- 172.21.15.81:0/3486602545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37dcadda0 con 0x55f37d8e04d0 2024-09-21T03:02:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.605+0000 7f053b7fe640 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb25b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f053004a040 tx=0x7f053002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f2de73560cd2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.605+0000 7f0521ffb640 1 -- 172.21.15.81:0/3486602545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530055070 con 0x55f37d8e04d0 2024-09-21T03:02:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.605+0000 7f0521ffb640 1 -- 172.21.15.81:0/3486602545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f053003de80 con 0x55f37d8e04d0 2024-09-21T03:02:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.605+0000 7f0521ffb640 1 -- 172.21.15.81:0/3486602545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530035040 con 0x55f37d8e04d0 2024-09-21T03:02:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 -- 172.21.15.81:0/3486602545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 msgr2=0x55f37dcb25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb25b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f053004a040 tx=0x7f053002a410 comp rx=0 tx=0).stop 2024-09-21T03:02:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 -- 172.21.15.81:0/3486602545 shutdown_connections 2024-09-21T03:02:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d9011b0 0x55f37dcb2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d8e04d0 0x55f37dcb25b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 --2- 172.21.15.81:0/3486602545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8d82f0 0x55f37dca9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 -- 172.21.15.81:0/3486602545 >> 172.21.15.81:0/3486602545 conn(0x55f37d8f5300 msgr2=0x55f37dca8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 -- 172.21.15.81:0/3486602545 shutdown_connections 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 -- 172.21.15.81:0/3486602545 wait complete. 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 -- start start 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 Processor -- start 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.606+0000 7f054948a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8e04d0 0x55f37dcb8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f054948a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dcb93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f054948a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f053c1aab50 con 0x55f37d9011b0 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f054948a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f053c1abfc0 con 0x55f37d8d82f0 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f054948a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f053c1ab220 con 0x55f37d8e04d0 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f054948a740 10 client.0 _ll_register_callbacks cb 0x7f05340093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dcb93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dcb93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55792/0 (socket says 172.21.15.81:55792) 2024-09-21T03:02:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 -- 172.21.15.81:0/2247702435 learned_addr learned my addr 172.21.15.81:0/2247702435 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f053bfff640 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f053b7fe640 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8e04d0 0x55f37dcb8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 -- 172.21.15.81:0/2247702435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8e04d0 msgr2=0x55f37dcb8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8e04d0 0x55f37dcb8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 -- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 msgr2=0x55f37dcba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcba1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 -- 172.21.15.81:0/2247702435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37dcb99b0 con 0x55f37d9011b0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f05409dc640 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dcb93f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0534011bf0 tx=0x7f0534017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc50ca5b86eac36d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f051b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f051b7fe640 1 -- 172.21.15.81:0/2247702435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053400ea20 con 0x55f37d9011b0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f051b7fe640 1 -- 172.21.15.81:0/2247702435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f053400ebc0 con 0x55f37d9011b0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.607+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f053003de80 con 0x55f37d9011b0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f051b7fe640 1 -- 172.21.15.81:0/2247702435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0534041050 con 0x55f37d9011b0 2024-09-21T03:02:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 10 client.15717 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f37dcb88e0 con 0x55f37d9011b0 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f051b7fe640 1 -- 172.21.15.81:0/2247702435 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f053003de80 con 0x55f37d9011b0 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f051b7fe640 1 -- 172.21.15.81:0/2247702435 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f053401c510 con 0x55f37d9011b0 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 10 client.15717 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 20 client.15717 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8951c0 0x55f37dd2cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 4 client.15717 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f37dc190f0 con 0x55f37d8951c0 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.608+0000 7f053bfff640 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8951c0 0x55f37dd2cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.609+0000 7f051b7fe640 10 client.15717 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.609+0000 7f053bfff640 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8951c0 0x55f37dd2cbe0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3184a94132f5e5e1 server_cookie=3c8378b144c4792e in_seq=0 out_seq=0 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f051b7fe640 1 -- 172.21.15.81:0/2247702435 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f37dc190f0 con 0x55f37d8951c0 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f051b7fe640 10 client.15717 handle_command_reply: tid=0 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 client.15717 shutdown 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 msgr2=0x55f37dcb93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dcb93f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0534011bf0 tx=0x7f0534017000 comp rx=0 tx=0).stop 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 shutdown_connections 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f37d8951c0 0x55f37dd2cbe0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f37d8e04d0 0x55f37dcb8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f051b7fe640 0 client.15717 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f37d9011b0 0x55f37dcb93f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 --2- 172.21.15.81:0/2247702435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f37d8d82f0 0x55f37dcba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 >> 172.21.15.81:0/2247702435 conn(0x55f37d8f5300 msgr2=0x55f37dcb0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.618+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 shutdown_connections 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054948a740 1 -- 172.21.15.81:0/2247702435 wait complete. 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054948a740 20 client.15717 trim_cache size 0 max 16384 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:02:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:02:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f05240b6510 msgr2=0x7f05240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f05240b6510 0x7f05240b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f053401b000 tx=0x7f053401aeb0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c1025c0 msgr2=0x7f053c199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c1025c0 0x7f053c199ea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f052c00d950 tx=0x7f052c00de10 comp rx=0 tx=0).stop 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 shutdown_connections 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f05240b6510 0x7f05240b8a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f053c103640 0x7f053c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f053c103fe0 0x7f053c19b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 --2- 172.21.15.81:0/2008827547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053c1025c0 0x7f053c199ea0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 >> 172.21.15.81:0/2008827547 conn(0x7f053c0fdf00 msgr2=0x7f053c106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 shutdown_connections 2024-09-21T03:02:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:05.619+0000 7f054243f640 1 -- 172.21.15.81:0/2008827547 wait complete. 2024-09-21T03:02:05.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:05 smithi181 ceph-mon[34096]: pgmap v410: 129 pgs: 129 active+clean; 706 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 37 MiB/s wr, 18 op/s 2024-09-21T03:02:05.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:05 smithi081 ceph-mon[30991]: pgmap v410: 129 pgs: 129 active+clean; 706 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 37 MiB/s wr, 18 op/s 2024-09-21T03:02:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:05 smithi164 ceph-mon[34236]: pgmap v410: 129 pgs: 129 active+clean; 706 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 37 MiB/s wr, 18 op/s 2024-09-21T03:02:07.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:07 smithi181 ceph-mon[34096]: pgmap v411: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 30 MiB/s wr, 17 op/s 2024-09-21T03:02:07.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:07 smithi081 ceph-mon[30991]: pgmap v411: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 30 MiB/s wr, 17 op/s 2024-09-21T03:02:07.933 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:07 smithi164 ceph-mon[34236]: pgmap v411: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 30 MiB/s wr, 17 op/s 2024-09-21T03:02:08.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:02:08.845 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:02:09.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:09 smithi081 ceph-mon[30991]: pgmap v412: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 MiB/s wr, 11 op/s 2024-09-21T03:02:09.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:09 smithi181 ceph-mon[34096]: pgmap v412: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 MiB/s wr, 11 op/s 2024-09-21T03:02:09.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:09 smithi164 ceph-mon[34236]: pgmap v412: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 MiB/s wr, 11 op/s 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 -- 172.21.15.81:0/1860976690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd4102aa0 msgr2=0x7fdfd4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 --2- 172.21.15.81:0/1860976690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd4102aa0 0x7fdfd4102eb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009900 tx=0x7fdfc402a410 comp rx=0 tx=0).stop 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 -- 172.21.15.81:0/1860976690 shutdown_connections 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 --2- 172.21.15.81:0/1860976690 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfd4108d30 0x7fdfd410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 --2- 172.21.15.81:0/1860976690 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfd41083e0 0x7fdfd41087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 --2- 172.21.15.81:0/1860976690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd4102aa0 0x7fdfd4102eb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 -- 172.21.15.81:0/1860976690 >> 172.21.15.81:0/1860976690 conn(0x7fdfd40797e0 msgr2=0x7fdfd4079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 -- 172.21.15.81:0/1860976690 shutdown_connections 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.949+0000 7fdfda595640 1 -- 172.21.15.81:0/1860976690 wait complete. 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 Processor -- start 2024-09-21T03:02:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 -- start start 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfd4102aa0 0x7fdfd41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd41083e0 0x7fdfd4199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfd4108d30 0x7fdfd419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd4112850 con 0x7fdfd41083e0 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41126d0 con 0x7fdfd4108d30 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfda595640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd41129d0 con 0x7fdfd4102aa0 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfd37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd41083e0 0x7fdfd4199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfd37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd41083e0 0x7fdfd4199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55802/0 (socket says 172.21.15.81:55802) 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfd37fe640 1 -- 172.21.15.81:0/3915162100 learned_addr learned my addr 172.21.15.81:0/3915162100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfd8b32640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfd4108d30 0x7fdfd419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.950+0000 7fdfd3fff640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfd4102aa0 0x7fdfd41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd37fe640 1 -- 172.21.15.81:0/3915162100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfd4102aa0 msgr2=0x7fdfd41993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd37fe640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfd4102aa0 0x7fdfd41993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd37fe640 1 -- 172.21.15.81:0/3915162100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfd4108d30 msgr2=0x7fdfd419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd37fe640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfd4108d30 0x7fdfd419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd37fe640 1 -- 172.21.15.81:0/3915162100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd419f250 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd37fe640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd41083e0 0x7fdfd4199940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8005fd0 tx=0x7fdfc800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd17fa640 1 -- 172.21.15.81:0/3915162100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8017070 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd17fa640 1 -- 172.21.15.81:0/3915162100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfc8009c30 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd419f540 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfd17fa640 1 -- 172.21.15.81:0/3915162100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8003c70 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.951+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd41a5d60 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.952+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd4102eb0 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.954+0000 7fdfd17fa640 1 -- 172.21.15.81:0/3915162100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdfc8003e10 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.954+0000 7fdfd17fa640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfbc0b6540 0x7fdfbc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.955+0000 7fdfd3fff640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfbc0b6540 0x7fdfbc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.955+0000 7fdfd17fa640 1 -- 172.21.15.81:0/3915162100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fdfc80e7a50 con 0x7fdfd41083e0 2024-09-21T03:02:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.955+0000 7fdfd3fff640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfbc0b6540 0x7fdfbc0b8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4000c00 tx=0x7fdfc4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:09.958+0000 7fdfd17fa640 1 -- 172.21.15.81:0/3915162100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfc8020030 con 0x7fdfd41083e0 2024-09-21T03:02:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.182+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfd410ab00 con 0x7fdfd41083e0 2024-09-21T03:02:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.182+0000 7fdfd17fa640 1 -- 172.21.15.81:0/3915162100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7fdfc80adfa0 con 0x7fdfd41083e0 2024-09-21T03:02:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:02:10.184 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:02:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfbc0b6540 msgr2=0x7fdfbc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfbc0b6540 0x7fdfbc0b8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4000c00 tx=0x7fdfc4009680 comp rx=0 tx=0).stop 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd41083e0 msgr2=0x7fdfd4199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd41083e0 0x7fdfd4199940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8005fd0 tx=0x7fdfc800dde0 comp rx=0 tx=0).stop 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 shutdown_connections 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfbc0b6540 0x7fdfbc0b8a50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfd4108d30 0x7fdfd419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfd41083e0 0x7fdfd4199940 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 --2- 172.21.15.81:0/3915162100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdfd4102aa0 0x7fdfd41993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 >> 172.21.15.81:0/3915162100 conn(0x7fdfd40797e0 msgr2=0x7fdfd41015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 shutdown_connections 2024-09-21T03:02:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:10.185+0000 7fdfda595640 1 -- 172.21.15.81:0/3915162100 wait complete. 2024-09-21T03:02:10.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:10 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3915162100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:02:10.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:10 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3915162100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:02:10.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:10 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3915162100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:02:10.990 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db --set-id e1cefff0 --release --await' 2024-09-21T03:02:10.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db --set-id e1cefff0 --release --await 2024-09-21T03:02:11.239 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:02:11.650 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:11 smithi081 ceph-mon[30991]: pgmap v413: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-21T03:02:11.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:11 smithi181 ceph-mon[34096]: pgmap v413: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 -- 172.21.15.81:0/234597775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34108d10 msgr2=0x7f2e3410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 --2- 172.21.15.81:0/234597775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34108d10 0x7f2e3410f540 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009ca0 tx=0x7f2e2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 -- 172.21.15.81:0/234597775 shutdown_connections 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 --2- 172.21.15.81:0/234597775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34108d10 0x7f2e3410f540 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 --2- 172.21.15.81:0/234597775 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e341083c0 0x7f2e341087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 --2- 172.21.15.81:0/234597775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e34102a80 0x7f2e34102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 -- 172.21.15.81:0/234597775 >> 172.21.15.81:0/234597775 conn(0x7f2e34079740 msgr2=0x7f2e34079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 -- 172.21.15.81:0/234597775 shutdown_connections 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 -- 172.21.15.81:0/234597775 wait complete. 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 Processor -- start 2024-09-21T03:02:11.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.746+0000 7f2e3c353640 1 -- start start 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3c353640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34102a80 0x7f2e3419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3c353640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e341083c0 0x7f2e3419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3c353640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e34108d10 0x7f2e3419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3c353640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34112880 con 0x7f2e34102a80 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3c353640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34112700 con 0x7f2e34108d10 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3c353640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34112a00 con 0x7f2e341083c0 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34102a80 0x7f2e3419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34102a80 0x7f2e3419a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33050/0 (socket says 172.21.15.81:33050) 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/3933075464 learned_addr learned my addr 172.21.15.81:0/3933075464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e34108d10 0x7f2e3419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e398ee640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e341083c0 0x7f2e3419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/3933075464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e341083c0 msgr2=0x7f2e3419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e341083c0 0x7f2e3419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/3933075464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e34108d10 msgr2=0x7f2e3419fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e34108d10 0x7f2e3419fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/3933075464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e341a02f0 con 0x7f2e34102a80 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.747+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34102a80 0x7f2e3419a380 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c970 tx=0x7f2e3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.748+0000 7f2e2b7fe640 1 -- 172.21.15.81:0/3933075464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30007bb0 con 0x7f2e34102a80 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.748+0000 7f2e2b7fe640 1 -- 172.21.15.81:0/3933075464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e30007d50 con 0x7f2e34102a80 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.748+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e341a05e0 con 0x7f2e34102a80 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.748+0000 7f2e2b7fe640 1 -- 172.21.15.81:0/3933075464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30004e40 con 0x7f2e34102a80 2024-09-21T03:02:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.748+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e341a6d40 con 0x7f2e34102a80 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.750+0000 7f2e428c7740 1 Processor -- start 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.750+0000 7f2e428c7740 1 -- start start 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.750+0000 7f2e2b7fe640 1 -- 172.21.15.81:0/3933075464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2e30005020 con 0x7f2e34102a80 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b55c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b18d660 0x55ef0b55ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b195840 0x55ef0b55cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e428c7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ef0b447dc0 con 0x55ef0b18d660 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e428c7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ef0b4d41f0 con 0x55ef0b1b6520 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e428c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ef0b4c3620 con 0x55ef0b195840 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b18d660 0x55ef0b55ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b18d660 0x55ef0b55ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33054/0 (socket says 172.21.15.81:33054) 2024-09-21T03:02:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/1223602390 learned_addr learned my addr 172.21.15.81:0/1223602390 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e398ee640 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b195840 0x55ef0b55cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b55c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/1223602390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b195840 msgr2=0x55ef0b55cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b195840 0x55ef0b55cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/1223602390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 msgr2=0x55ef0b55c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b55c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a0ef640 1 -- 172.21.15.81:0/1223602390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0b48bfd0 con 0x55ef0b18d660 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b55c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.751+0000 7f2e2b7fe640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2e200b6510 0x7f2e200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.752+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2e200b6510 0x7f2e200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.752+0000 7f2e2b7fe640 1 -- 172.21.15.81:0/3933075464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2e300e72e0 con 0x7f2e34102a80 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.752+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b18d660 0x55ef0b55ca50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e300ef560 tx=0x7f2e300efa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae90e14d192e4782 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.752+0000 7f2e28d9a640 1 -- 172.21.15.81:0/1223602390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3001d020 con 0x55ef0b18d660 2024-09-21T03:02:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.752+0000 7f2e28d9a640 1 -- 172.21.15.81:0/1223602390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e300055d0 con 0x55ef0b18d660 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.752+0000 7f2e28d9a640 1 -- 172.21.15.81:0/1223602390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300acfa0 con 0x55ef0b18d660 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 -- 172.21.15.81:0/1223602390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b18d660 msgr2=0x55ef0b55ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b18d660 0x55ef0b55ca50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e300ef560 tx=0x7f2e300efa20 comp rx=0 tx=0).stop 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2e200b6510 0x7f2e200b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c006010 tx=0x7f2e2c0098e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 -- 172.21.15.81:0/1223602390 shutdown_connections 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b195840 0x55ef0b55cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b18d660 0x55ef0b55ca50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 --2- 172.21.15.81:0/1223602390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b55c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 -- 172.21.15.81:0/1223602390 >> 172.21.15.81:0/1223602390 conn(0x55ef0b1aa910 msgr2=0x55ef0b55a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 -- 172.21.15.81:0/1223602390 shutdown_connections 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 -- 172.21.15.81:0/1223602390 wait complete. 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 -- start start 2024-09-21T03:02:11.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.753+0000 7f2e428c7740 1 Processor -- start 2024-09-21T03:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b567bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b195840 0x55ef0b568130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b1b6520 0x55ef0b573e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b1b6520 0x55ef0b573e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e428c7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ef0b45e300 con 0x55ef0b1b6520 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e428c7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ef0b4c7430 con 0x55ef0b195840 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e428c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55ef0b324bb0 con 0x55ef0b18d660 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b1b6520 0x55ef0b573e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33058/0 (socket says 172.21.15.81:33058) 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 -- 172.21.15.81:0/4010955580 learned_addr learned my addr 172.21.15.81:0/4010955580 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e428c7740 10 client.0 _ll_register_callbacks cb 0x55ef0b478120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b567bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e398ee640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b195840 0x55ef0b568130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 -- 172.21.15.81:0/4010955580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 msgr2=0x55ef0b567bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b567bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 -- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b195840 msgr2=0x55ef0b568130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b195840 0x55ef0b568130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e3a8f0640 1 -- 172.21.15.81:0/4010955580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef0b44d780 con 0x55ef0b1b6520 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.754+0000 7f2e398ee640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b195840 0x55ef0b568130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b1b6520 0x55ef0b573e90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c035000 tx=0x7f2e2c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b765cac31a312ead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e1dffb640 1 -- 172.21.15.81:0/4010955580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c004250 con 0x55ef0b1b6520 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e1dffb640 1 -- 172.21.15.81:0/4010955580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2e2c0043f0 con 0x55ef0b1b6520 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef0b4d6140 con 0x55ef0b1b6520 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e1dffb640 1 -- 172.21.15.81:0/4010955580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e2c0045f0 con 0x55ef0b1b6520 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 10 client.15735 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef0b221b00 con 0x55ef0b1b6520 2024-09-21T03:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e1dffb640 1 -- 172.21.15.81:0/4010955580 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ef0b4d6140 con 0x55ef0b1b6520 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e1dffb640 1 -- 172.21.15.81:0/4010955580 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2e2c051070 con 0x55ef0b1b6520 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 10 client.15735 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 10 client.15735 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 20 client.15735 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b174ea0 0x55ef0b579f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 4 client.15735 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.755+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef0b4d1bf0 con 0x55ef0b174ea0 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.756+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b174ea0 0x55ef0b579f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.756+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b174ea0 0x55ef0b579f30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67276a527ccea567 server_cookie=45dc2d805ceef541 in_seq=0 out_seq=0 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.756+0000 7f2e1dffb640 10 client.15735 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e1dffb640 1 -- 172.21.15.81:0/4010955580 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef0b4d1bf0 con 0x55ef0b174ea0 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e1dffb640 10 client.15735 handle_command_reply: tid=0 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 client.15735 shutdown 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b1b6520 msgr2=0x55ef0b573e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b1b6520 0x55ef0b573e90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c035000 tx=0x7f2e2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 shutdown_connections 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b174ea0 0x55ef0b579f30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b1b6520 0x55ef0b573e90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b195840 0x55ef0b568130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 --2- 172.21.15.81:0/4010955580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b567bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 >> 172.21.15.81:0/4010955580 conn(0x55ef0b1aa910 msgr2=0x55ef0b55f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e1dffb640 0 client.15735 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 shutdown_connections 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 1 -- 172.21.15.81:0/4010955580 wait complete. 2024-09-21T03:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.757+0000 7f2e428c7740 20 client.15735 trim_cache size 0 max 16384 2024-09-21T03:02:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.774+0000 7f2e428c7740 1 Processor -- start 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.774+0000 7f2e428c7740 1 -- start start 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b573d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b568010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b569ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e428c7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b3180 con 0x55ef0b195840 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e428c7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b0a50 con 0x55ef0b1b6520 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e428c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341ae8a0 con 0x55ef0b18d660 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b568010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b568010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33072/0 (socket says 172.21.15.81:33072) 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 -- 172.21.15.81:0/2247618913 learned_addr learned my addr 172.21.15.81:0/2247618913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b569ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 -- 172.21.15.81:0/2247618913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 msgr2=0x55ef0b573d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b573d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b573d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 -- 172.21.15.81:0/2247618913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 msgr2=0x55ef0b569ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b569ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 -- 172.21.15.81:0/2247618913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0b298960 con 0x55ef0b195840 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e398ee640 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b568010 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2e24004620 tx=0x7f2e2400db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c577a2d84cecf57a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.775+0000 7f2e1ffff640 1 -- 172.21.15.81:0/2247618913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24003b50 con 0x55ef0b195840 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e1ffff640 1 -- 172.21.15.81:0/2247618913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e24003cf0 con 0x55ef0b195840 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e1ffff640 1 -- 172.21.15.81:0/2247618913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24005600 con 0x55ef0b195840 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 -- 172.21.15.81:0/2247618913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 msgr2=0x55ef0b568010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b568010 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2e24004620 tx=0x7f2e2400db60 comp rx=0 tx=0).stop 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 -- 172.21.15.81:0/2247618913 shutdown_connections 2024-09-21T03:02:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b569ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b568010 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 --2- 172.21.15.81:0/2247618913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b573d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 -- 172.21.15.81:0/2247618913 >> 172.21.15.81:0/2247618913 conn(0x55ef0b1aa910 msgr2=0x55ef0b55d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 -- 172.21.15.81:0/2247618913 shutdown_connections 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.776+0000 7f2e428c7740 1 -- 172.21.15.81:0/2247618913 wait complete. 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 -- start start 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 Processor -- start 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b56bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b56c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b56c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341aef10 con 0x55ef0b195840 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b0380 con 0x55ef0b1b6520 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341af5e0 con 0x55ef0b18d660 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e428c7740 10 client.0 _ll_register_callbacks cb 0x7f2e2c031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e398ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b56c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e398ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b56c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33078/0 (socket says 172.21.15.81:33078) 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e398ee640 1 -- 172.21.15.81:0/3569546009 learned_addr learned my addr 172.21.15.81:0/3569546009 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.777+0000 7f2e3a8f0640 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b56c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b56bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e398ee640 1 -- 172.21.15.81:0/3569546009 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 msgr2=0x55ef0b56bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e398ee640 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b56bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e398ee640 1 -- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 msgr2=0x55ef0b56c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e398ee640 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b56c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e398ee640 1 -- 172.21.15.81:0/3569546009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef0b5e39f0 con 0x55ef0b195840 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e398ee640 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b56c400 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2e24000c00 tx=0x7f2e24005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e922d66037da8ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e1dffb640 1 -- 172.21.15.81:0/3569546009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2402b060 con 0x55ef0b195840 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e1dffb640 1 -- 172.21.15.81:0/3569546009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2e2400ddb0 con 0x55ef0b195840 2024-09-21T03:02:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e24003cf0 con 0x55ef0b195840 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e1dffb640 1 -- 172.21.15.81:0/3569546009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e24032050 con 0x55ef0b195840 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e428c7740 10 client.15741 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef0b5e4cb0 con 0x55ef0b195840 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.778+0000 7f2e1dffb640 1 -- 172.21.15.81:0/3569546009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e24003cf0 con 0x55ef0b195840 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e1dffb640 1 -- 172.21.15.81:0/3569546009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2e2401a030 con 0x55ef0b195840 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e428c7740 10 client.15741 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e428c7740 10 client.15741 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e428c7740 20 client.15741 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e428c7740 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b14a250 0x55ef0b5e7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e428c7740 4 client.15741 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e1cefff0", "release": true, "await": true}] 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e1cefff0", "release": true, "await": true}) -- 0x55ef0b4cf020 con 0x55ef0b14a250 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b14a250 0x55ef0b5e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e3a0ef640 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b14a250 0x55ef0b5e7370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c8ed372577d158b server_cookie=a2ed4c6e06b7161c in_seq=0 out_seq=0 2024-09-21T03:02:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.779+0000 7f2e1dffb640 10 client.15741 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e1dffb640 1 -- 172.21.15.81:0/3569546009 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ef0b4cf020 con 0x55ef0b14a250 2024-09-21T03:02:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e1dffb640 10 client.15741 handle_command_reply: tid=0 2024-09-21T03:02:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 client.15741 shutdown 2024-09-21T03:02:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 msgr2=0x55ef0b56c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b56c400 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2e24000c00 tx=0x7f2e24005570 comp rx=0 tx=0).stop 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 shutdown_connections 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55ef0b14a250 0x55ef0b5e7370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ef0b1b6520 0x55ef0b56c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ef0b195840 0x55ef0b56c400 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 --2- 172.21.15.81:0/3569546009 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ef0b18d660 0x55ef0b56bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 >> 172.21.15.81:0/3569546009 conn(0x55ef0b1aa910 msgr2=0x55ef0b55dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e1dffb640 0 client.15741 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 shutdown_connections 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 1 -- 172.21.15.81:0/3569546009 wait complete. 2024-09-21T03:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.782+0000 7f2e428c7740 20 client.15741 trim_cache size 0 max 16384 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 25, 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 8, 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "e1cefff0": { 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 8, 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:02:11.788 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 137.0, 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:11.789 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2e200b6510 msgr2=0x7f2e200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2e200b6510 0x7f2e200b8a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c006010 tx=0x7f2e2c0098e0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34102a80 msgr2=0x7f2e3419a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34102a80 0x7f2e3419a380 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c970 tx=0x7f2e3000ce30 comp rx=0 tx=0).stop 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 shutdown_connections 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2e200b6510 0x7f2e200b8a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e341083c0 0x7f2e3419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e34108d10 0x7f2e3419fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 --2- 172.21.15.81:0/3933075464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e34102a80 0x7f2e3419a380 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 >> 172.21.15.81:0/3933075464 conn(0x7f2e34079740 msgr2=0x7f2e34101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 shutdown_connections 2024-09-21T03:02:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:11.783+0000 7f2e3c353640 1 -- 172.21.15.81:0/3933075464 wait complete. 2024-09-21T03:02:11.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:11 smithi164 ceph-mon[34236]: pgmap v413: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-21T03:02:12.566 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e1cefff0', total seconds elapsed: 21.0 2024-09-21T03:02:13.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:13 smithi181 ceph-mon[34096]: pgmap v414: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 410 KiB/s wr, 9 op/s 2024-09-21T03:02:13.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:13 smithi081 ceph-mon[30991]: pgmap v414: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 410 KiB/s wr, 9 op/s 2024-09-21T03:02:13.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:13 smithi164 ceph-mon[34236]: pgmap v414: 129 pgs: 129 active+clean; 706 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 410 KiB/s wr, 9 op/s 2024-09-21T03:02:14.611 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:14.612 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 initial writers = 38763.00 kB/sec 2024-09-21T03:02:14.612 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 initial writers = 38762.66 kB/sec 2024-09-21T03:02:14.612 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 38763.00 kB/sec 2024-09-21T03:02:14.612 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 38763.00 kB/sec 2024-09-21T03:02:14.612 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 38763.00 kB/sec 2024-09-21T03:02:14.612 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:15.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:15 smithi181 ceph-mon[34096]: pgmap v415: 129 pgs: 129 active+clean; 738 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.7 MiB/s wr, 8 op/s 2024-09-21T03:02:15.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:15 smithi081 ceph-mon[30991]: pgmap v415: 129 pgs: 129 active+clean; 738 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.7 MiB/s wr, 8 op/s 2024-09-21T03:02:15.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:15 smithi164 ceph-mon[34236]: pgmap v415: 129 pgs: 129 active+clean; 738 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.7 MiB/s wr, 8 op/s 2024-09-21T03:02:17.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:17 smithi181 ceph-mon[34096]: pgmap v416: 129 pgs: 129 active+clean; 874 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 14 MiB/s wr, 12 op/s 2024-09-21T03:02:17.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:17 smithi081 ceph-mon[30991]: pgmap v416: 129 pgs: 129 active+clean; 874 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 14 MiB/s wr, 12 op/s 2024-09-21T03:02:17.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:17 smithi164 ceph-mon[34236]: pgmap v416: 129 pgs: 129 active+clean; 874 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 14 MiB/s wr, 12 op/s 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 -- 172.21.15.81:0/182822003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 msgr2=0x7f8698108ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 --2- 172.21.15.81:0/182822003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698108ca0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f868c009900 tx=0x7f868c02a410 comp rx=0 tx=0).stop 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 -- 172.21.15.81:0/182822003 shutdown_connections 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 --2- 172.21.15.81:0/182822003 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f86981093e0 0x7f869810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 --2- 172.21.15.81:0/182822003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698108ca0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 --2- 172.21.15.81:0/182822003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f869806b6d0 0x7f8698106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 -- 172.21.15.81:0/182822003 >> 172.21.15.81:0/182822003 conn(0x7f86980fdee0 msgr2=0x7f8698100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 -- 172.21.15.81:0/182822003 shutdown_connections 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 -- 172.21.15.81:0/182822003 wait complete. 2024-09-21T03:02:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.731+0000 7f869df77640 1 Processor -- start 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f869df77640 1 -- start start 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f869df77640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f869806b6d0 0x7f8698103960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f869df77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f869df77640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86981093e0 0x7f8698102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f869df77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f869810f1f0 con 0x7f8698106860 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f869df77640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f869810f070 con 0x7f86981093e0 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f869df77640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f869810f370 con 0x7f869806b6d0 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f8697fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86981093e0 0x7f8698102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33090/0 (socket says 172.21.15.81:33090) 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f8696ffd640 1 -- 172.21.15.81:0/4230426152 learned_addr learned my addr 172.21.15.81:0/4230426152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.732+0000 7f86977fe640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f869806b6d0 0x7f8698103960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8697fff640 1 -- 172.21.15.81:0/4230426152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f869806b6d0 msgr2=0x7f8698103960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8697fff640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f869806b6d0 0x7f8698103960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8697fff640 1 -- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 msgr2=0x7f8698102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8697fff640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8697fff640 1 -- 172.21.15.81:0/4230426152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8698102e90 con 0x7f86981093e0 2024-09-21T03:02:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8696ffd640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:02:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8697fff640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86981093e0 0x7f8698102760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f869000d980 tx=0x7f869000de40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.733+0000 7f8694ff9640 1 -- 172.21.15.81:0/4230426152 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690017070 con 0x7f86981093e0 2024-09-21T03:02:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.734+0000 7f8694ff9640 1 -- 172.21.15.81:0/4230426152 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8690003e50 con 0x7f86981093e0 2024-09-21T03:02:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.734+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86981a3f20 con 0x7f86981093e0 2024-09-21T03:02:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.734+0000 7f8694ff9640 1 -- 172.21.15.81:0/4230426152 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86900047e0 con 0x7f86981093e0 2024-09-21T03:02:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.734+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86981a4330 con 0x7f86981093e0 2024-09-21T03:02:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.737+0000 7f86a4fbf740 1 Processor -- start 2024-09-21T03:02:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f8694ff9640 1 -- 172.21.15.81:0/4230426152 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f86900039c0 con 0x7f86981093e0 2024-09-21T03:02:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86a4fbf740 1 -- start start 2024-09-21T03:02:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b4d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6abe6f0 con 0x55a7a677b2f0 2024-09-21T03:02:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6aadb20 con 0x55a7a67a41b0 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6ab1930 con 0x55a7a67834d0 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:55364/0 (socket says 172.21.15.81:55364) 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f8696ffd640 1 -- 172.21.15.81:0/264346205 learned_addr learned my addr 172.21.15.81:0/264346205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.738+0000 7f86977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8696ffd640 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b4d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8696ffd640 1 -- 172.21.15.81:0/264346205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 msgr2=0x55a7a6b4d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8696ffd640 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b4d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8696ffd640 1 -- 172.21.15.81:0/264346205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 msgr2=0x55a7a6b4c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8696ffd640 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8696ffd640 1 -- 172.21.15.81:0/264346205 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a6a73530 con 0x55a7a67a41b0 2024-09-21T03:02:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8694ff9640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f86800b6510 0x7f86800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8696ffd640 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4be50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f868c0057c0 tx=0x7f868c02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6335520cf90f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f86977fe640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f86800b6510 0x7f86800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f8694ff9640 1 -- 172.21.15.81:0/4230426152 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f86900e7740 con 0x7f86981093e0 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.739+0000 7f867dffb640 1 -- 172.21.15.81:0/264346205 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c035040 con 0x55a7a67a41b0 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.740+0000 7f867dffb640 1 -- 172.21.15.81:0/264346205 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f868c031500 con 0x55a7a67a41b0 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.740+0000 7f867dffb640 1 -- 172.21.15.81:0/264346205 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c03d6e0 con 0x55a7a67a41b0 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 -- 172.21.15.81:0/264346205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 msgr2=0x55a7a6b4be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4be50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f868c0057c0 tx=0x7f868c02a410 comp rx=0 tx=0).stop 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86977fe640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f86800b6510 0x7f86800b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8688004610 tx=0x7f868800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 -- 172.21.15.81:0/264346205 shutdown_connections 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b4d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/264346205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4be50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 -- 172.21.15.81:0/264346205 >> 172.21.15.81:0/264346205 conn(0x55a7a6798300 msgr2=0x55a7a6b478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 -- 172.21.15.81:0/264346205 shutdown_connections 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 -- 172.21.15.81:0/264346205 wait complete. 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 -- start start 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.741+0000 7f86a4fbf740 1 Processor -- start 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a677b2f0 0x55a7a6b5de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67834d0 0x55a7a6b5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a67a41b0 0x55a7a6b5f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a7a69e5ab0 con 0x55a7a67a41b0 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6a53730 con 0x55a7a67834d0 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55a7a6b4dad0 con 0x55a7a677b2f0 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f86a4fbf740 10 client.0 _ll_register_callbacks cb 0x55a7a6aa76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a67a41b0 0x55a7a6b5f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67834d0 0x55a7a6b5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a67a41b0 0x55a7a6b5f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33098/0 (socket says 172.21.15.81:33098) 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 -- 172.21.15.81:0/1491222895 learned_addr learned my addr 172.21.15.81:0/1491222895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 -- 172.21.15.81:0/1491222895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a677b2f0 msgr2=0x55a7a6b5de00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a677b2f0 0x55a7a6b5de00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 -- 172.21.15.81:0/1491222895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67834d0 msgr2=0x55a7a6b5e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67834d0 0x55a7a6b5e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.742+0000 7f8697fff640 1 -- 172.21.15.81:0/1491222895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a680f790 con 0x55a7a67a41b0 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f8697fff640 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a67a41b0 0x55a7a6b5f030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f86900a9b60 tx=0x7f8690004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad89042546f8e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f8676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f8676ffd640 1 -- 172.21.15.81:0/1491222895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86900ac9f0 con 0x55a7a67a41b0 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f8676ffd640 1 -- 172.21.15.81:0/1491222895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f86900a8ee0 con 0x55a7a67a41b0 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f868c031500 con 0x55a7a67a41b0 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f8676ffd640 1 -- 172.21.15.81:0/1491222895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86900ad0a0 con 0x55a7a67a41b0 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 10 client.15753 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a7a6888620 con 0x55a7a67a41b0 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f8676ffd640 1 -- 172.21.15.81:0/1491222895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f868c031500 con 0x55a7a67a41b0 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f8676ffd640 1 -- 172.21.15.81:0/1491222895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f86900b3200 con 0x55a7a67a41b0 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 10 client.15753 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 20 client.15753 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a6762d80 0x55a7a6b6b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 4 client.15753 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.743+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7a6ac0640 con 0x55a7a6762d80 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.744+0000 7f86977fe640 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a6762d80 0x55a7a6b6b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.744+0000 7f8676ffd640 10 client.15753 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.744+0000 7f86977fe640 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a6762d80 0x55a7a6b6b640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eee5b7ee9bade47 server_cookie=2b1c293d5f3f13cc in_seq=0 out_seq=0 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f8676ffd640 1 -- 172.21.15.81:0/1491222895 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7a6ac0640 con 0x55a7a6762d80 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f8676ffd640 10 client.15753 handle_command_reply: tid=0 2024-09-21T03:02:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 client.15753 shutdown 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a67a41b0 msgr2=0x55a7a6b5f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a67a41b0 0x55a7a6b5f030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f86900a9b60 tx=0x7f8690004250 comp rx=0 tx=0).stop 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 shutdown_connections 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a6762d80 0x55a7a6b6b640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a67a41b0 0x55a7a6b5f030 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f8676ffd640 0 client.15753 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67834d0 0x55a7a6b5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1491222895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a677b2f0 0x55a7a6b5de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.745+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 >> 172.21.15.81:0/1491222895 conn(0x55a7a6798300 msgr2=0x55a7a6b45ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.746+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 shutdown_connections 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.746+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1491222895 wait complete. 2024-09-21T03:02:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.746+0000 7f86a4fbf740 20 client.15753 trim_cache size 0 max 16384 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 Processor -- start 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 -- start start 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b65f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86981aca00 con 0x55a7a677b2f0 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f86981aa2d0 con 0x55a7a67a41b0 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86981a8120 con 0x55a7a67834d0 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33106/0 (socket says 172.21.15.81:33106) 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f86977fe640 1 -- 172.21.15.81:0/2616098977 learned_addr learned my addr 172.21.15.81:0/2616098977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f8696ffd640 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b65f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.764+0000 7f8697fff640 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f8696ffd640 1 -- 172.21.15.81:0/2616098977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 msgr2=0x55a7a6b4c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f8696ffd640 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f8696ffd640 1 -- 172.21.15.81:0/2616098977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 msgr2=0x55a7a6b4bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f8696ffd640 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f8696ffd640 1 -- 172.21.15.81:0/2616098977 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a6b5e920 con 0x55a7a67834d0 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f8697fff640 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f8696ffd640 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b65f10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab4ab52ebe8d24a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f867d7fa640 1 -- 172.21.15.81:0/2616098977 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c035030 con 0x55a7a67834d0 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f867d7fa640 1 -- 172.21.15.81:0/2616098977 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f868c04e070 con 0x55a7a67834d0 2024-09-21T03:02:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.765+0000 7f867d7fa640 1 -- 172.21.15.81:0/2616098977 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c03d6e0 con 0x55a7a67834d0 2024-09-21T03:02:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 -- 172.21.15.81:0/2616098977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 msgr2=0x55a7a6b65f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b65f10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c005fd0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 -- 172.21.15.81:0/2616098977 shutdown_connections 2024-09-21T03:02:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b65f10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b4c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/2616098977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b4bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 -- 172.21.15.81:0/2616098977 >> 172.21.15.81:0/2616098977 conn(0x55a7a6798300 msgr2=0x55a7a6b53b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 -- 172.21.15.81:0/2616098977 shutdown_connections 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.766+0000 7f86a4fbf740 1 -- 172.21.15.81:0/2616098977 wait complete. 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 -- start start 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 Processor -- start 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b65a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b64c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86981a8790 con 0x55a7a677b2f0 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f86981a9c00 con 0x55a7a67a41b0 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f86981a8e60 con 0x55a7a67834d0 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86a4fbf740 10 client.0 _ll_register_callbacks cb 0x7f869000bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b65a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b65a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33114/0 (socket says 172.21.15.81:33114) 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.767+0000 7f86977fe640 1 -- 172.21.15.81:0/1882376555 learned_addr learned my addr 172.21.15.81:0/1882376555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8697fff640 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b64c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8696ffd640 1 -- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 msgr2=0x55a7a6b64c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8696ffd640 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b64c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8696ffd640 1 -- 172.21.15.81:0/1882376555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 msgr2=0x55a7a6b65a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8696ffd640 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b65a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8696ffd640 1 -- 172.21.15.81:0/1882376555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a6b65200 con 0x55a7a67834d0 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f86977fe640 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b65a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8696ffd640 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b646d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f868c009850 tx=0x7f868c005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20072c9a6de656aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8676ffd640 1 -- 172.21.15.81:0/1882376555 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c035070 con 0x55a7a67834d0 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f868c04e070 con 0x55a7a67834d0 2024-09-21T03:02:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8676ffd640 1 -- 172.21.15.81:0/1882376555 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f868c031910 con 0x55a7a67834d0 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f8676ffd640 1 -- 172.21.15.81:0/1882376555 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f868c058070 con 0x55a7a67834d0 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f86a4fbf740 10 client.25261 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.768+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a7a6b640b0 con 0x55a7a67834d0 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f8676ffd640 1 -- 172.21.15.81:0/1882376555 <== mon.1 v2:172.21.15.181:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f868c04e070 con 0x55a7a67834d0 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f8676ffd640 1 -- 172.21.15.81:0/1882376555 <== mon.1 v2:172.21.15.181:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f868c03dc60 con 0x55a7a67834d0 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f86a4fbf740 10 client.25261 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f86a4fbf740 10 client.25261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f86a4fbf740 20 client.25261 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a67381c0 0x55a7a6bd82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f86a4fbf740 4 client.25261 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7a6abc0f0 con 0x55a7a67381c0 2024-09-21T03:02:18.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.769+0000 7f86977fe640 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a67381c0 0x55a7a6bd82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.770+0000 7f86977fe640 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a67381c0 0x55a7a6bd82a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb04814cdd7b9ae0 server_cookie=82d56f5f09b22035 in_seq=0 out_seq=0 2024-09-21T03:02:18.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.770+0000 7f8676ffd640 10 client.25261 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f8676ffd640 1 -- 172.21.15.81:0/1882376555 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7a6abc0f0 con 0x55a7a67381c0 2024-09-21T03:02:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f8676ffd640 10 client.25261 handle_command_reply: tid=0 2024-09-21T03:02:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 client.25261 shutdown 2024-09-21T03:02:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 msgr2=0x55a7a6b646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b646d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f868c009850 tx=0x7f868c005850 comp rx=0 tx=0).stop 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 shutdown_connections 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55a7a67381c0 0x55a7a6bd82a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a7a67834d0 0x55a7a6b646d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a7a67a41b0 0x55a7a6b64c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f8676ffd640 0 client.25261 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 --2- 172.21.15.81:0/1882376555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a7a677b2f0 0x55a7a6b65a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 >> 172.21.15.81:0/1882376555 conn(0x55a7a6798300 msgr2=0x55a7a6b4bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 shutdown_connections 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 1 -- 172.21.15.81:0/1882376555 wait complete. 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.777+0000 7f86a4fbf740 20 client.25261 trim_cache size 0 max 16384 2024-09-21T03:02:18.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:02:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:02:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:02:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:02:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f86800b6510 msgr2=0x7f86800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f86800b6510 0x7f86800b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8688004610 tx=0x7f868800b390 comp rx=0 tx=0).stop 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86981093e0 msgr2=0x7f8698102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86981093e0 0x7f8698102760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f869000d980 tx=0x7f869000de40 comp rx=0 tx=0).stop 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 shutdown_connections 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f86800b6510 0x7f86800b8a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86981093e0 0x7f8698102760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8698106860 0x7f8698102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 --2- 172.21.15.81:0/4230426152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f869806b6d0 0x7f8698103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 >> 172.21.15.81:0/4230426152 conn(0x7f86980fdee0 msgr2=0x7f8698104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 shutdown_connections 2024-09-21T03:02:18.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:18.778+0000 7f869df77640 1 -- 172.21.15.81:0/4230426152 wait complete. 2024-09-21T03:02:19.748 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:19 smithi181 ceph-mon[34096]: pgmap v417: 129 pgs: 129 active+clean; 1001 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 25 MiB/s wr, 13 op/s 2024-09-21T03:02:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:02:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:02:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:02:19.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:02:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:19 smithi081 ceph-mon[30991]: pgmap v417: 129 pgs: 129 active+clean; 1001 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 25 MiB/s wr, 13 op/s 2024-09-21T03:02:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:02:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:02:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:02:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:02:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:19 smithi164 ceph-mon[34236]: pgmap v417: 129 pgs: 129 active+clean; 1001 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 25 MiB/s wr, 13 op/s 2024-09-21T03:02:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:02:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:02:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:02:19.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:02:21.749 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:21 smithi181 ceph-mon[34096]: pgmap v418: 129 pgs: 129 active+clean; 1.0 GiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 33 MiB/s wr, 15 op/s 2024-09-21T03:02:21.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:21 smithi081 ceph-mon[30991]: pgmap v418: 129 pgs: 129 active+clean; 1.0 GiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 33 MiB/s wr, 15 op/s 2024-09-21T03:02:21.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:21 smithi164 ceph-mon[34236]: pgmap v418: 129 pgs: 129 active+clean; 1.0 GiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 33 MiB/s wr, 15 op/s 2024-09-21T03:02:23.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:23 smithi081 ceph-mon[30991]: pgmap v419: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 53 MiB/s wr, 22 op/s 2024-09-21T03:02:23.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:23 smithi164 ceph-mon[34236]: pgmap v419: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 53 MiB/s wr, 22 op/s 2024-09-21T03:02:23.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:23 smithi181 ceph-mon[34096]: pgmap v419: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 53 MiB/s wr, 22 op/s 2024-09-21T03:02:25.782 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:25.782 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 rewriters = 126465.74 kB/sec 2024-09-21T03:02:25.782 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 rewriters = 126462.08 kB/sec 2024-09-21T03:02:25.782 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 126465.74 kB/sec 2024-09-21T03:02:25.782 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 126465.74 kB/sec 2024-09-21T03:02:25.782 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 126465.74 kB/sec 2024-09-21T03:02:25.782 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:25.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:25 smithi081 ceph-mon[30991]: pgmap v420: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-21T03:02:25.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:25 smithi164 ceph-mon[34236]: pgmap v420: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-21T03:02:25.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:25 smithi181 ceph-mon[34096]: pgmap v420: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 61 MiB/s wr, 23 op/s 2024-09-21T03:02:27.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:27 smithi081 ceph-mon[30991]: pgmap v421: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 82 MiB/s wr, 29 op/s 2024-09-21T03:02:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:27 smithi164 ceph-mon[34236]: pgmap v421: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 82 MiB/s wr, 29 op/s 2024-09-21T03:02:27.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:27 smithi181 ceph-mon[34096]: pgmap v421: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 82 MiB/s wr, 29 op/s 2024-09-21T03:02:29.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:29 smithi081 ceph-mon[30991]: pgmap v422: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 91 MiB/s wr, 30 op/s 2024-09-21T03:02:29.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:29 smithi164 ceph-mon[34236]: pgmap v422: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 91 MiB/s wr, 30 op/s 2024-09-21T03:02:29.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:29 smithi181 ceph-mon[34096]: pgmap v422: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 91 MiB/s wr, 30 op/s 2024-09-21T03:02:30.205 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:30.205 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 readers = 7416094.00 kB/sec 2024-09-21T03:02:30.205 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 readers = 7408074.60 kB/sec 2024-09-21T03:02:30.205 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 7416094.00 kB/sec 2024-09-21T03:02:30.205 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 7416094.00 kB/sec 2024-09-21T03:02:30.205 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 7416094.00 kB/sec 2024-09-21T03:02:30.205 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:31.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:31 smithi081 ceph-mon[30991]: pgmap v423: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 MiB/s wr, 29 op/s 2024-09-21T03:02:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 -- 172.21.15.81:0/1966586399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 msgr2=0x7f5bcc102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/1966586399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc102a30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009900 tx=0x7f5bbc02a410 comp rx=0 tx=0).stop 2024-09-21T03:02:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 -- 172.21.15.81:0/1966586399 shutdown_connections 2024-09-21T03:02:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/1966586399 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bcc103640 0x7f5bcc103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/1966586399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bcc103fe0 0x7f5bcc10a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/1966586399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc102a30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 -- 172.21.15.81:0/1966586399 >> 172.21.15.81:0/1966586399 conn(0x7f5bcc0fdf00 msgr2=0x7f5bcc1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.885+0000 7f5bd21a1640 1 -- 172.21.15.81:0/1966586399 shutdown_connections 2024-09-21T03:02:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.886+0000 7f5bd21a1640 1 -- 172.21.15.81:0/1966586399 wait complete. 2024-09-21T03:02:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.886+0000 7f5bd21a1640 1 Processor -- start 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.886+0000 7f5bd21a1640 1 -- start start 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.886+0000 7f5bd21a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bd21a1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bcc103640 0x7f5bcc19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bd21a1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bcc103fe0 0x7f5bcc19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bd21a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc10f200 con 0x7f5bcc1025c0 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bd21a1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc10f080 con 0x7f5bcc103640 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bd21a1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc10f380 con 0x7f5bcc103fe0 2024-09-21T03:02:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44716/0 (socket says 172.21.15.81:44716) 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/133768178 learned_addr learned my addr 172.21.15.81:0/133768178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bcc103640 0x7f5bcc19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bcc103fe0 0x7f5bcc19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/133768178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bcc103fe0 msgr2=0x7f5bcc19b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bcc103fe0 0x7f5bcc19b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/133768178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bcc103640 msgr2=0x7f5bcc19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bcc103640 0x7f5bcc19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/133768178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc19b830 con 0x7f5bcc1025c0 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bcc103640 0x7f5bcc19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bcc103fe0 0x7f5bcc19b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc199e80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009230 tx=0x7f5bbc004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bc8ff9640 1 -- 172.21.15.81:0/133768178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc03f030 con 0x7f5bcc1025c0 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bc8ff9640 1 -- 172.21.15.81:0/133768178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bbc003c90 con 0x7f5bcc1025c0 2024-09-21T03:02:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc19bac0 con 0x7f5bcc1025c0 2024-09-21T03:02:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bc8ff9640 1 -- 172.21.15.81:0/133768178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc035070 con 0x7f5bcc1025c0 2024-09-21T03:02:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.887+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bcc1a20c0 con 0x7f5bcc1025c0 2024-09-21T03:02:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 Processor -- start 2024-09-21T03:02:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 -- start start 2024-09-21T03:02:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bc8ff9640 1 -- 172.21.15.81:0/133768178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5bbc042030 con 0x7f5bcc1025c0 2024-09-21T03:02:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc858be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc858c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81c34d0 0x563bc858d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563bc84fe6f0 con 0x563bc81c34d0 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563bc84edb20 con 0x563bc81e41b0 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563bc84f1930 con 0x563bc81bb2f0 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81c34d0 0x563bc858d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81c34d0 0x563bc858d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44724/0 (socket says 172.21.15.81:44724) 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bcaffd640 1 -- 172.21.15.81:0/1239624885 learned_addr learned my addr 172.21.15.81:0/1239624885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc858c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.890+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc858be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcaffd640 1 -- 172.21.15.81:0/1239624885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 msgr2=0x563bc858c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc858c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcaffd640 1 -- 172.21.15.81:0/1239624885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 msgr2=0x563bc858be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc858be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcaffd640 1 -- 172.21.15.81:0/1239624885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc84b3530 con 0x563bc81c34d0 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc858be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc858c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bc8ff9640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5bb40b6510 0x7f5bb40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81c34d0 0x563bc858d010 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000bb70 tx=0x7f5bc000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281a4536890391b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5bb40b6510 0x7f5bb40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bc8ff9640 1 -- 172.21.15.81:0/133768178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5bbc107f10 con 0x7f5bcc1025c0 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bb1ffb640 1 -- 172.21.15.81:0/1239624885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0017620 con 0x563bc81c34d0 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bb1ffb640 1 -- 172.21.15.81:0/1239624885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bc0017c50 con 0x563bc81c34d0 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.891+0000 7f5bb1ffb640 1 -- 172.21.15.81:0/1239624885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000faf0 con 0x563bc81c34d0 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 -- 172.21.15.81:0/1239624885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81c34d0 msgr2=0x563bc858d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5bb40b6510 0x7f5bb40b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005fd0 tx=0x7f5bc4008570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81c34d0 0x563bc858d010 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000bb70 tx=0x7f5bc000d710 comp rx=0 tx=0).stop 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 -- 172.21.15.81:0/1239624885 shutdown_connections 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc858c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81c34d0 0x563bc858d010 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/1239624885 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc858be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 -- 172.21.15.81:0/1239624885 >> 172.21.15.81:0/1239624885 conn(0x563bc81d8300 msgr2=0x563bc85878e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 -- 172.21.15.81:0/1239624885 shutdown_connections 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 -- 172.21.15.81:0/1239624885 wait complete. 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.892+0000 7f5bd91e8740 1 -- start start 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 1 Processor -- start 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc8595570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81c34d0 0x563bc8595c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81e41b0 0x563bc85967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563bc8425ab0 con 0x563bc81e41b0 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563bc8493730 con 0x563bc81c34d0 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x563bc858db30 con 0x563bc81bb2f0 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bd91e8740 10 client.0 _ll_register_callbacks cb 0x563bc84e76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81e41b0 0x563bc85967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81e41b0 0x563bc85967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44740/0 (socket says 172.21.15.81:44740) 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcbfff640 1 -- 172.21.15.81:0/2261153191 learned_addr learned my addr 172.21.15.81:0/2261153191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81c34d0 0x563bc8595c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc8595570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcbfff640 1 -- 172.21.15.81:0/2261153191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 msgr2=0x563bc8595570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc8595570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.893+0000 7f5bcbfff640 1 -- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81c34d0 msgr2=0x563bc8595c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81c34d0 0x563bc8595c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5bcbfff640 1 -- 172.21.15.81:0/2261153191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc824f790 con 0x563bc81e41b0 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81e41b0 0x563bc85967a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4008890 tx=0x7f5bc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667f3c453ca06c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5baaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5baaffd640 1 -- 172.21.15.81:0/2261153191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc401d620 con 0x563bc81e41b0 2024-09-21T03:02:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5baaffd640 1 -- 172.21.15.81:0/2261153191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5bc401d7c0 con 0x563bc81e41b0 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc0017c50 con 0x563bc81e41b0 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5baaffd640 1 -- 172.21.15.81:0/2261153191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bc402e050 con 0x563bc81e41b0 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5bd91e8740 10 client.15771 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563bc82c8620 con 0x563bc81e41b0 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5baaffd640 1 -- 172.21.15.81:0/2261153191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bc0017c50 con 0x563bc81e41b0 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5baaffd640 1 -- 172.21.15.81:0/2261153191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5bc401b9d0 con 0x563bc81e41b0 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.894+0000 7f5bd91e8740 10 client.15771 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5bd91e8740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5bd91e8740 20 client.15771 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81a2d80 0x563bc85a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5bd91e8740 4 client.15771 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bc8500640 con 0x563bc81a2d80 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81a2d80 0x563bc85a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5baaffd640 10 client.15771 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.895+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81a2d80 0x563bc85a2e50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14762759e04ac4a8 server_cookie=8006e9d68baaaa5f in_seq=0 out_seq=0 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5baaffd640 1 -- 172.21.15.81:0/2261153191 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563bc8500640 con 0x563bc81a2d80 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5baaffd640 10 client.15771 handle_command_reply: tid=0 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 client.15771 shutdown 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81e41b0 msgr2=0x563bc85967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81e41b0 0x563bc85967a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4008890 tx=0x7f5bc4004a40 comp rx=0 tx=0).stop 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 shutdown_connections 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81a2d80 0x563bc85a2e50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81e41b0 0x563bc85967a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5baaffd640 0 client.15771 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81c34d0 0x563bc8595c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2261153191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81bb2f0 0x563bc8595570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 >> 172.21.15.81:0/2261153191 conn(0x563bc81d8300 msgr2=0x563bc8585ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 shutdown_connections 2024-09-21T03:02:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2261153191 wait complete. 2024-09-21T03:02:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.896+0000 7f5bd91e8740 20 client.15771 trim_cache size 0 max 16384 2024-09-21T03:02:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 Processor -- start 2024-09-21T03:02:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 -- start start 2024-09-21T03:02:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc8590900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc8587d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc8588260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1aecc0 con 0x563bc81bb2f0 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1ac590 con 0x563bc81e41b0 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1aa3e0 con 0x563bc81c34d0 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc8590900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc8590900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44756/0 (socket says 172.21.15.81:44756) 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/159646955 learned_addr learned my addr 172.21.15.81:0/159646955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/159646955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 msgr2=0x563bc8587d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc8587d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc8587d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/159646955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 msgr2=0x563bc8588260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc8588260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/159646955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc85936f0 con 0x563bc81bb2f0 2024-09-21T03:02:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.911+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc8587d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc8590900 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc000c00 tx=0x7f5bbc105540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd75b9b04210722c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bb17fa640 1 -- 172.21.15.81:0/159646955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0d2030 con 0x563bc81bb2f0 2024-09-21T03:02:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bb17fa640 1 -- 172.21.15.81:0/159646955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bbc03b460 con 0x563bc81bb2f0 2024-09-21T03:02:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bb17fa640 1 -- 172.21.15.81:0/159646955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc049040 con 0x563bc81bb2f0 2024-09-21T03:02:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bd91e8740 1 -- 172.21.15.81:0/159646955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 msgr2=0x563bc8590900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc8590900 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc000c00 tx=0x7f5bbc105540 comp rx=0 tx=0).stop 2024-09-21T03:02:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bd91e8740 1 -- 172.21.15.81:0/159646955 shutdown_connections 2024-09-21T03:02:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc8587d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc8588260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/159646955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc8590900 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.912+0000 7f5bd91e8740 1 -- 172.21.15.81:0/159646955 >> 172.21.15.81:0/159646955 conn(0x563bc81d8300 msgr2=0x563bc85825c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 -- 172.21.15.81:0/159646955 shutdown_connections 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 -- 172.21.15.81:0/159646955 wait complete. 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 -- start start 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 Processor -- start 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc859d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc859c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc859c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1aaa50 con 0x563bc81bb2f0 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1abec0 con 0x563bc81e41b0 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1ab120 con 0x563bc81c34d0 2024-09-21T03:02:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bd91e8740 10 client.0 _ll_register_callbacks cb 0x7f5bc4008b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc859d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc859d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44768/0 (socket says 172.21.15.81:44768) 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.913+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/2870324582 learned_addr learned my addr 172.21.15.81:0/2870324582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc859c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcbfff640 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc859c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/2870324582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 msgr2=0x563bc859c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc859c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 msgr2=0x563bc859c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc859c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcb7fe640 1 -- 172.21.15.81:0/2870324582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc859cd50 con 0x563bc81bb2f0 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bcb7fe640 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc859d3a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0caf70 tx=0x7f5bbc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dc4174052afb56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5baaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5baaffd640 1 -- 172.21.15.81:0/2870324582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc049070 con 0x563bc81bb2f0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5baaffd640 1 -- 172.21.15.81:0/2870324582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f5bbc0d7290 con 0x563bc81bb2f0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563bc84fc0f0 con 0x563bc81bb2f0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5baaffd640 1 -- 172.21.15.81:0/2870324582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bbc0d2070 con 0x563bc81bb2f0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bd91e8740 10 client.15777 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563bc860d810 con 0x563bc81bb2f0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.914+0000 7f5baaffd640 1 -- 172.21.15.81:0/2870324582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563bc84fc0f0 con 0x563bc81bb2f0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5baaffd640 1 -- 172.21.15.81:0/2870324582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5bbc0d5b60 con 0x563bc81bb2f0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bd91e8740 10 client.15777 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bd91e8740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bd91e8740 20 client.15777 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81781c0 0x563bc86101c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bd91e8740 4 client.15777 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563bc84f9520 con 0x563bc81781c0 2024-09-21T03:02:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81781c0 0x563bc86101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5baaffd640 10 client.15777 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:31.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.915+0000 7f5bcaffd640 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81781c0 0x563bc86101c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a582fc59df02bda server_cookie=368d97f139af3b91 in_seq=0 out_seq=0 2024-09-21T03:02:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.923+0000 7f5baaffd640 1 -- 172.21.15.81:0/2870324582 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563bc84f9520 con 0x563bc81781c0 2024-09-21T03:02:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.923+0000 7f5baaffd640 10 client.15777 handle_command_reply: tid=0 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.923+0000 7f5bd91e8740 1 client.15777 shutdown 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 msgr2=0x563bc859d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc859d3a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0caf70 tx=0x7f5bbc02a410 comp rx=0 tx=0).stop 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 shutdown_connections 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x563bc81781c0 0x563bc86101c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563bc81c34d0 0x563bc859c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc81e41b0 0x563bc859c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5baaffd640 0 client.15777 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 --2- 172.21.15.81:0/2870324582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563bc81bb2f0 0x563bc859d3a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 >> 172.21.15.81:0/2870324582 conn(0x563bc81d8300 msgr2=0x563bc85825c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 shutdown_connections 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 1 -- 172.21.15.81:0/2870324582 wait complete. 2024-09-21T03:02:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd91e8740 20 client.15777 trim_cache size 0 max 16384 2024-09-21T03:02:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:02:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:02:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:02:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5bb40b6510 msgr2=0x7f5bb40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5bb40b6510 0x7f5bb40b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005fd0 tx=0x7f5bc4008570 comp rx=0 tx=0).stop 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 msgr2=0x7f5bcc199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc199e80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009230 tx=0x7f5bbc004360 comp rx=0 tx=0).stop 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 shutdown_connections 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f5bb40b6510 0x7f5bb40b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5bcc103fe0 0x7f5bcc19b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5bcc103640 0x7f5bcc19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 --2- 172.21.15.81:0/133768178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bcc1025c0 0x7f5bcc199e80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.924+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 >> 172.21.15.81:0/133768178 conn(0x7f5bcc0fdf00 msgr2=0x7f5bcc106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.925+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 shutdown_connections 2024-09-21T03:02:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:31.925+0000 7f5bd21a1640 1 -- 172.21.15.81:0/133768178 wait complete. 2024-09-21T03:02:31.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:31 smithi164 ceph-mon[34236]: pgmap v423: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 MiB/s wr, 29 op/s 2024-09-21T03:02:31.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:31 smithi181 ceph-mon[34096]: pgmap v423: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 MiB/s wr, 29 op/s 2024-09-21T03:02:32.431 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:32.431 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 re-readers = 7697777.00 kB/sec 2024-09-21T03:02:32.431 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 re-readers = 7686610.63 kB/sec 2024-09-21T03:02:32.431 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 7697777.00 kB/sec 2024-09-21T03:02:32.431 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 7697777.00 kB/sec 2024-09-21T03:02:32.431 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 7697777.00 kB/sec 2024-09-21T03:02:32.431 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:33.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:33 smithi081 ceph-mon[30991]: pgmap v424: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 79 MiB/s wr, 28 op/s 2024-09-21T03:02:33.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:33 smithi164 ceph-mon[34236]: pgmap v424: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 79 MiB/s wr, 28 op/s 2024-09-21T03:02:33.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:33 smithi181 ceph-mon[34096]: pgmap v424: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 79 MiB/s wr, 28 op/s 2024-09-21T03:02:35.802 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:35 smithi181 ceph-mon[34096]: pgmap v425: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 59 MiB/s wr, 20 op/s 2024-09-21T03:02:35.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:35 smithi081 ceph-mon[30991]: pgmap v425: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 59 MiB/s wr, 20 op/s 2024-09-21T03:02:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:35 smithi164 ceph-mon[34236]: pgmap v425: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 59 MiB/s wr, 20 op/s 2024-09-21T03:02:37.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:37 smithi081 ceph-mon[30991]: pgmap v426: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 51 MiB/s wr, 20 op/s 2024-09-21T03:02:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:37 smithi164 ceph-mon[34236]: pgmap v426: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 51 MiB/s wr, 20 op/s 2024-09-21T03:02:37.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:37 smithi181 ceph-mon[34096]: pgmap v426: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 51 MiB/s wr, 20 op/s 2024-09-21T03:02:38.752 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:38.752 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:38.753 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:38.753 INFO:tasks.workunit.client.0.smithi081.stdout:iozone test complete. 2024-09-21T03:02:38.753 INFO:tasks.workunit.client.0.smithi081.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-21T03:02:38.819 INFO:tasks.workunit.client.0.smithi081.stdout: Iozone: Performance Test of File I/O 2024-09-21T03:02:38.819 INFO:tasks.workunit.client.0.smithi081.stdout: Version $Revision: 3.494 $ 2024-09-21T03:02:38.819 INFO:tasks.workunit.client.0.smithi081.stdout: Compiled for 64 bit mode. 2024-09-21T03:02:38.819 INFO:tasks.workunit.client.0.smithi081.stdout: Build: linux-AMD64 2024-09-21T03:02:38.819 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:38.819 INFO:tasks.workunit.client.0.smithi081.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T03:02:38.819 INFO:tasks.workunit.client.0.smithi081.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Run began: Sat Sep 21 03:02:38 2024 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Include close in write timing 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Include fsync in write timing 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: File size set to 1048576 kB 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Record Size 1024 kB 2024-09-21T03:02:38.820 INFO:tasks.workunit.client.0.smithi081.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-21T03:02:38.821 INFO:tasks.workunit.client.0.smithi081.stdout: Output is in kBytes/sec 2024-09-21T03:02:38.821 INFO:tasks.workunit.client.0.smithi081.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T03:02:38.821 INFO:tasks.workunit.client.0.smithi081.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T03:02:38.821 INFO:tasks.workunit.client.0.smithi081.stdout: Processor cache line size set to 32 bytes. 2024-09-21T03:02:38.821 INFO:tasks.workunit.client.0.smithi081.stdout: File stride size set to 17 * record size. 2024-09-21T03:02:38.821 INFO:tasks.workunit.client.0.smithi081.stdout: Throughput test with 1 process 2024-09-21T03:02:38.821 INFO:tasks.workunit.client.0.smithi081.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-21T03:02:39.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:39 smithi081 ceph-mon[30991]: pgmap v427: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 27 MiB/s wr, 15 op/s 2024-09-21T03:02:39.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:39 smithi164 ceph-mon[34236]: pgmap v427: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 27 MiB/s wr, 15 op/s 2024-09-21T03:02:39.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:39 smithi181 ceph-mon[34096]: pgmap v427: 129 pgs: 129 active+clean; 1.0 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 27 MiB/s wr, 15 op/s 2024-09-21T03:02:40.511 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:40.511 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 initial writers = 632179.88 kB/sec 2024-09-21T03:02:40.511 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 initial writers = 632096.88 kB/sec 2024-09-21T03:02:40.511 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 632179.88 kB/sec 2024-09-21T03:02:40.511 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 632179.88 kB/sec 2024-09-21T03:02:40.511 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 632179.88 kB/sec 2024-09-21T03:02:40.511 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:41.808 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:41 smithi081 ceph-mon[30991]: pgmap v428: 129 pgs: 129 active+clean; 1.1 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T03:02:41.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:41 smithi164 ceph-mon[34236]: pgmap v428: 129 pgs: 129 active+clean; 1.1 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T03:02:41.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:41 smithi181 ceph-mon[34096]: pgmap v428: 129 pgs: 129 active+clean; 1.1 GiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 16 MiB/s wr, 12 op/s 2024-09-21T03:02:43.804 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:43 smithi081 ceph-mon[30991]: pgmap v429: 129 pgs: 129 active+clean; 1.2 GiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 55 MiB/s wr, 33 op/s 2024-09-21T03:02:43.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:43 smithi164 ceph-mon[34236]: pgmap v429: 129 pgs: 129 active+clean; 1.2 GiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 55 MiB/s wr, 33 op/s 2024-09-21T03:02:43.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:43 smithi181 ceph-mon[34096]: pgmap v429: 129 pgs: 129 active+clean; 1.2 GiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 55 MiB/s wr, 33 op/s 2024-09-21T03:02:44.138 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T03:02:44.138 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T03:02:44.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:02:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:02:44.750 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:44.750 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 rewriters = 683694.88 kB/sec 2024-09-21T03:02:44.750 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 rewriters = 683600.86 kB/sec 2024-09-21T03:02:44.750 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 683694.88 kB/sec 2024-09-21T03:02:44.750 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 683694.88 kB/sec 2024-09-21T03:02:44.750 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 683694.88 kB/sec 2024-09-21T03:02:44.750 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 -- 172.21.15.81:0/392867401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1381025d0 msgr2=0x7fd138102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/392867401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1381025d0 0x7fd138102a40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009900 tx=0x7fd12c02a410 comp rx=0 tx=0).stop 2024-09-21T03:02:45.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 -- 172.21.15.81:0/392867401 shutdown_connections 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/392867401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd138103ff0 0x7fd13810a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/392867401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd138103650 0x7fd138103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/392867401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1381025d0 0x7fd138102a40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 -- 172.21.15.81:0/392867401 >> 172.21.15.81:0/392867401 conn(0x7fd1380fdf30 msgr2=0x7fd1381003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 -- 172.21.15.81:0/392867401 shutdown_connections 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.019+0000 7fd13ea9b640 1 -- 172.21.15.81:0/392867401 wait complete. 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.020+0000 7fd13ea9b640 1 Processor -- start 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.020+0000 7fd13ea9b640 1 -- start start 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.020+0000 7fd13ea9b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1381025d0 0x7fd138198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.020+0000 7fd13ea9b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd138103650 0x7fd138199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.020+0000 7fd13ea9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd138103ff0 0x7fd13819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13ea9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd13810e110 con 0x7fd138103ff0 2024-09-21T03:02:45.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13ea9b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd13810df90 con 0x7fd138103650 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13ea9b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd13810e290 con 0x7fd1381025d0 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd138103ff0 0x7fd13819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13c837640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1381025d0 0x7fd138198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd138103ff0 0x7fd13819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46882/0 (socket says 172.21.15.81:46882) 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 -- 172.21.15.81:0/3342509127 learned_addr learned my addr 172.21.15.81:0/3342509127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd137fff640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd138103650 0x7fd138199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 -- 172.21.15.81:0/3342509127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1381025d0 msgr2=0x7fd138198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1381025d0 0x7fd138198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 -- 172.21.15.81:0/3342509127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd138103650 msgr2=0x7fd138199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd138103650 0x7fd138199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 -- 172.21.15.81:0/3342509127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13819a840 con 0x7fd138103ff0 2024-09-21T03:02:45.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13d038640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd138103ff0 0x7fd13819a020 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd13000eb10 tx=0x7fd13000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd135ffb640 1 -- 172.21.15.81:0/3342509127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130004b20 con 0x7fd138103ff0 2024-09-21T03:02:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd135ffb640 1 -- 172.21.15.81:0/3342509127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd130004cc0 con 0x7fd138103ff0 2024-09-21T03:02:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13819ab30 con 0x7fd138103ff0 2024-09-21T03:02:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.021+0000 7fd135ffb640 1 -- 172.21.15.81:0/3342509127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130010690 con 0x7fd138103ff0 2024-09-21T03:02:45.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.022+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1381a1220 con 0x7fd138103ff0 2024-09-21T03:02:45.034 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.024+0000 7fd145a11740 1 Processor -- start 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.024+0000 7fd135ffb640 1 -- 172.21.15.81:0/3342509127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd130005020 con 0x7fd138103ff0 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd145a11740 1 -- start start 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd145a11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c282880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd145a11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6beb52f0 0x561e6c281230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd145a11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c281770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd145a11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561e6c1f86f0 con 0x561e6bede1b0 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd145a11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561e6c1e7b20 con 0x561e6bebd4d0 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd145a11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561e6c1eb930 con 0x561e6beb52f0 2024-09-21T03:02:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd137fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c282880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd137fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c282880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46886/0 (socket says 172.21.15.81:46886) 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd13c837640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6beb52f0 0x561e6c281230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd137fff640 1 -- 172.21.15.81:0/3919356219 learned_addr learned my addr 172.21.15.81:0/3919356219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd137fff640 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c281770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd13c837640 1 -- 172.21.15.81:0/3919356219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 msgr2=0x561e6c281770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd13c837640 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c281770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd13c837640 1 -- 172.21.15.81:0/3919356219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 msgr2=0x561e6c282880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd13c837640 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c282880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd13c837640 1 -- 172.21.15.81:0/3919356219 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6c1ad530 con 0x561e6beb52f0 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd137fff640 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c282880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.025+0000 7fd135ffb640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd1280b6510 0x7fd1280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.026+0000 7fd137fff640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd1280b6510 0x7fd1280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.026+0000 7fd135ffb640 1 -- 172.21.15.81:0/3342509127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fd1300e7b70 con 0x7fd138103ff0 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.026+0000 7fd13c837640 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6beb52f0 0x561e6c281230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd12c02a930 tx=0x7fd12c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc9d2b92f2be238 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.026+0000 7fd122ffd640 1 -- 172.21.15.81:0/3919356219 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c040070 con 0x561e6beb52f0 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.026+0000 7fd122ffd640 1 -- 172.21.15.81:0/3919356219 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd12c003a80 con 0x561e6beb52f0 2024-09-21T03:02:45.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.026+0000 7fd122ffd640 1 -- 172.21.15.81:0/3919356219 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c035040 con 0x561e6beb52f0 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 -- 172.21.15.81:0/3919356219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6beb52f0 msgr2=0x561e6c281230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd137fff640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd1280b6510 0x7fd1280b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd12400bfd0 tx=0x7fd12400b810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6beb52f0 0x561e6c281230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd12c02a930 tx=0x7fd12c0040c0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 -- 172.21.15.81:0/3919356219 shutdown_connections 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6beb52f0 0x561e6c281230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c281770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 --2- 172.21.15.81:0/3919356219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c282880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 -- 172.21.15.81:0/3919356219 >> 172.21.15.81:0/3919356219 conn(0x561e6bed2300 msgr2=0x561e6c283af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 -- 172.21.15.81:0/3919356219 shutdown_connections 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 -- 172.21.15.81:0/3919356219 wait complete. 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 -- start start 2024-09-21T03:02:45.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.027+0000 7fd145a11740 1 Processor -- start 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c293960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bebd4d0 0x561e6c294020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c294b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561e6c11fab0 con 0x561e6bede1b0 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561e6c18d730 con 0x561e6beb52f0 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561e6c292090 con 0x561e6bebd4d0 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 10 client.0 _ll_register_callbacks cb 0x561e6c1e16b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c294b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c294b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46896/0 (socket says 172.21.15.81:46896) 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 -- 172.21.15.81:0/2883949575 learned_addr learned my addr 172.21.15.81:0/2883949575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13c837640 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c293960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd137fff640 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bebd4d0 0x561e6c294020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 -- 172.21.15.81:0/2883949575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bebd4d0 msgr2=0x561e6c294020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bebd4d0 0x561e6c294020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 -- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 msgr2=0x561e6c293960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c293960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 -- 172.21.15.81:0/2883949575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6bf49790 con 0x561e6bede1b0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd13d038640 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c294b90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd1300ad950 tx=0x7fd130005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4ae34393f4f22a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd117fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd117fff640 1 -- 172.21.15.81:0/2883949575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1300ad4d0 con 0x561e6bede1b0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd12c003a80 con 0x561e6bede1b0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.028+0000 7fd117fff640 1 -- 172.21.15.81:0/2883949575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fd1300ace30 con 0x561e6bede1b0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd117fff640 1 -- 172.21.15.81:0/2883949575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd1300ae0c0 con 0x561e6bede1b0 2024-09-21T03:02:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 10 client.15789 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e6bfc2620 con 0x561e6bede1b0 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd117fff640 1 -- 172.21.15.81:0/2883949575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd12c003a80 con 0x561e6bede1b0 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd117fff640 1 -- 172.21.15.81:0/2883949575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd1300ac690 con 0x561e6bede1b0 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 10 client.15789 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 10 client.15789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 20 client.15789 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be9cd80 0x561e6c2a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 4 client.15789 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e6c1fa640 con 0x561e6be9cd80 2024-09-21T03:02:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.029+0000 7fd13c837640 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be9cd80 0x561e6c2a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.030+0000 7fd117fff640 10 client.15789 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.030+0000 7fd13c837640 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be9cd80 0x561e6c2a11c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=900c5f9bf882d665 server_cookie=97aeb499beed69a6 in_seq=0 out_seq=0 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd117fff640 1 -- 172.21.15.81:0/2883949575 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e6c1fa640 con 0x561e6be9cd80 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd117fff640 10 client.15789 handle_command_reply: tid=0 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 client.15789 shutdown 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 msgr2=0x561e6c294b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c294b90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd1300ad950 tx=0x7fd130005650 comp rx=0 tx=0).stop 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 shutdown_connections 2024-09-21T03:02:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be9cd80 0x561e6c2a11c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bebd4d0 0x561e6c294020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bede1b0 0x561e6c294b90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 --2- 172.21.15.81:0/2883949575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c293960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd117fff640 0 client.15789 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 >> 172.21.15.81:0/2883949575 conn(0x561e6bed2300 msgr2=0x561e6c2846f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 shutdown_connections 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 1 -- 172.21.15.81:0/2883949575 wait complete. 2024-09-21T03:02:45.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.031+0000 7fd145a11740 20 client.15789 trim_cache size 0 max 16384 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 Processor -- start 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 -- start start 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c28ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bebd4d0 0x561e6c27c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c292a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1381acc20 con 0x561e6bebd4d0 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd1381aa4f0 con 0x561e6beb52f0 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.045+0000 7fd145a11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd1381a8340 con 0x561e6bede1b0 2024-09-21T03:02:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bebd4d0 0x561e6c27c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bebd4d0 0x561e6c27c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46912/0 (socket says 172.21.15.81:46912) 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 -- 172.21.15.81:0/861947375 learned_addr learned my addr 172.21.15.81:0/861947375 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd13c837640 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c28ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd13d038640 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c292a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 -- 172.21.15.81:0/861947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 msgr2=0x561e6c292a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c292a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 -- 172.21.15.81:0/861947375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 msgr2=0x561e6c28ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c28ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 -- 172.21.15.81:0/861947375 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6c282de0 con 0x561e6bebd4d0 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd13c837640 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c28ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd13d038640 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c292a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd137fff640 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bebd4d0 0x561e6c27c5c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd1240122c0 tx=0x7fd1240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f4c845b33e2b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd1227fc640 1 -- 172.21.15.81:0/861947375 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124004220 con 0x561e6bebd4d0 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd1227fc640 1 -- 172.21.15.81:0/861947375 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1240043c0 con 0x561e6bebd4d0 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.046+0000 7fd1227fc640 1 -- 172.21.15.81:0/861947375 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124010820 con 0x561e6bebd4d0 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 -- 172.21.15.81:0/861947375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bebd4d0 msgr2=0x561e6c27c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bebd4d0 0x561e6c27c5c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd1240122c0 tx=0x7fd1240046c0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 -- 172.21.15.81:0/861947375 shutdown_connections 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c292a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6bebd4d0 0x561e6c27c5c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 --2- 172.21.15.81:0/861947375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6beb52f0 0x561e6c28ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 -- 172.21.15.81:0/861947375 >> 172.21.15.81:0/861947375 conn(0x561e6bed2300 msgr2=0x561e6c292380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 -- 172.21.15.81:0/861947375 shutdown_connections 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 -- 172.21.15.81:0/861947375 wait complete. 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 -- start start 2024-09-21T03:02:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.047+0000 7fd145a11740 1 Processor -- start 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd145a11740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6beb52f0 0x561e6c29b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd145a11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c29a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd145a11740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c29a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd145a11740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1381a89b0 con 0x561e6beb52f0 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd145a11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd1381a9e20 con 0x561e6bebd4d0 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd145a11740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd1381a9080 con 0x561e6bede1b0 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd145a11740 10 client.0 _ll_register_callbacks cb 0x7fd1300aa0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6beb52f0 0x561e6c29b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6beb52f0 0x561e6c29b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46916/0 (socket says 172.21.15.81:46916) 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 -- 172.21.15.81:0/432911728 learned_addr learned my addr 172.21.15.81:0/432911728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd137fff640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c29a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13d038640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c29a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 -- 172.21.15.81:0/432911728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 msgr2=0x561e6c29a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c29a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 -- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 msgr2=0x561e6c29a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c29a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 -- 172.21.15.81:0/432911728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6c29abe0 con 0x561e6beb52f0 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd137fff640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c29a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd13c837640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6beb52f0 0x561e6c29b4a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009230 tx=0x7fd12c005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1b0d61f7ab62cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.048+0000 7fd117fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd117fff640 1 -- 172.21.15.81:0/432911728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c05b060 con 0x561e6beb52f0 2024-09-21T03:02:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd117fff640 1 -- 172.21.15.81:0/432911728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fd12c003a00 con 0x561e6beb52f0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1240043c0 con 0x561e6beb52f0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd117fff640 1 -- 172.21.15.81:0/432911728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd12c062050 con 0x561e6beb52f0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 10 client.15795 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e6c299a00 con 0x561e6beb52f0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd117fff640 1 -- 172.21.15.81:0/432911728 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd1240043c0 con 0x561e6beb52f0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd117fff640 1 -- 172.21.15.81:0/432911728 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd12c031c50 con 0x561e6beb52f0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 10 client.15795 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 20 client.15795 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be721c0 0x561e6c30deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 4 client.15795 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e6c1f60f0 con 0x561e6be721c0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.049+0000 7fd137fff640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be721c0 0x561e6c30deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.050+0000 7fd117fff640 10 client.15795 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.050+0000 7fd137fff640 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be721c0 0x561e6c30deb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f31e760edd4dcdf server_cookie=13a41b92278c0400 in_seq=0 out_seq=0 2024-09-21T03:02:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.058+0000 7fd117fff640 1 -- 172.21.15.81:0/432911728 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e6c1f60f0 con 0x561e6be721c0 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.058+0000 7fd117fff640 10 client.15795 handle_command_reply: tid=0 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.058+0000 7fd145a11740 1 client.15795 shutdown 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.058+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6beb52f0 msgr2=0x561e6c29b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.058+0000 7fd145a11740 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6beb52f0 0x561e6c29b4a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009230 tx=0x7fd12c005a40 comp rx=0 tx=0).stop 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.058+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 shutdown_connections 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.058+0000 7fd145a11740 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561e6be721c0 0x561e6c30deb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd145a11740 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561e6bede1b0 0x561e6c29a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd117fff640 0 client.15795 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd145a11740 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561e6bebd4d0 0x561e6c29a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd145a11740 1 --2- 172.21.15.81:0/432911728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e6beb52f0 0x561e6c29b4a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 >> 172.21.15.81:0/432911728 conn(0x561e6bed2300 msgr2=0x561e6c292d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 shutdown_connections 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd145a11740 1 -- 172.21.15.81:0/432911728 wait complete. 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd145a11740 20 client.15795 trim_cache size 0 max 16384 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:02:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:02:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd1280b6510 msgr2=0x7fd1280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd1280b6510 0x7fd1280b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd12400bfd0 tx=0x7fd12400b810 comp rx=0 tx=0).stop 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd138103ff0 msgr2=0x7fd13819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd138103ff0 0x7fd13819a020 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd13000eb10 tx=0x7fd13000c2d0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 shutdown_connections 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd1280b6510 0x7fd1280b8a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd138103ff0 0x7fd13819a020 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd138103650 0x7fd138199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 --2- 172.21.15.81:0/3342509127 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1381025d0 0x7fd138198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.059+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 >> 172.21.15.81:0/3342509127 conn(0x7fd1380fdf30 msgr2=0x7fd138106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.060+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 shutdown_connections 2024-09-21T03:02:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:45.060+0000 7fd13ea9b640 1 -- 172.21.15.81:0/3342509127 wait complete. 2024-09-21T03:02:45.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:45 smithi081 ceph-mon[30991]: pgmap v430: 129 pgs: 129 active+clean; 1.2 GiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 68 MiB/s wr, 38 op/s 2024-09-21T03:02:45.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:45 smithi164 ceph-mon[34236]: pgmap v430: 129 pgs: 129 active+clean; 1.2 GiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 68 MiB/s wr, 38 op/s 2024-09-21T03:02:45.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:45 smithi181 ceph-mon[34096]: pgmap v430: 129 pgs: 129 active+clean; 1.2 GiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 68 MiB/s wr, 38 op/s 2024-09-21T03:02:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.573+0000 7f57c015e640 1 -- 172.21.15.81:0/78409136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8102ae0 msgr2=0x7f57b8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.573+0000 7f57c015e640 1 --2- 172.21.15.81:0/78409136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8102ae0 0x7f57b8102ef0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009900 tx=0x7f57b402a410 comp rx=0 tx=0).stop 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.574+0000 7f57c015e640 1 -- 172.21.15.81:0/78409136 shutdown_connections 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.574+0000 7f57c015e640 1 --2- 172.21.15.81:0/78409136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b8108d70 0x7f57b810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.574+0000 7f57c015e640 1 --2- 172.21.15.81:0/78409136 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b8108420 0x7f57b8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.574+0000 7f57c015e640 1 --2- 172.21.15.81:0/78409136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8102ae0 0x7f57b8102ef0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.574+0000 7f57c015e640 1 -- 172.21.15.81:0/78409136 >> 172.21.15.81:0/78409136 conn(0x7f57b8079770 msgr2=0x7f57b8079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.574+0000 7f57c015e640 1 -- 172.21.15.81:0/78409136 shutdown_connections 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.574+0000 7f57c015e640 1 -- 172.21.15.81:0/78409136 wait complete. 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 Processor -- start 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 -- start start 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b8102ae0 0x7f57b819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8108420 0x7f57b819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b8108d70 0x7f57b819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57b81129a0 con 0x7f57b8108420 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8112820 con 0x7f57b8108d70 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57c015e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8112b20 con 0x7f57b8102ae0 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8108420 0x7f57b819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8108420 0x7f57b819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46942/0 (socket says 172.21.15.81:46942) 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 -- 172.21.15.81:0/4110844104 learned_addr learned my addr 172.21.15.81:0/4110844104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bdefa640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b8102ae0 0x7f57b819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57be6fb640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b8108d70 0x7f57b819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 -- 172.21.15.81:0/4110844104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b8102ae0 msgr2=0x7f57b819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b8102ae0 0x7f57b819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 -- 172.21.15.81:0/4110844104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b8108d70 msgr2=0x7f57b819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b8108d70 0x7f57b819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.575+0000 7f57bd6f9640 1 -- 172.21.15.81:0/4110844104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b81a6600 con 0x7f57b8108420 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.576+0000 7f57bd6f9640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8108420 0x7f57b819b8b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006fd0 tx=0x7f57a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.576+0000 7f57aeffd640 1 -- 172.21.15.81:0/4110844104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8011830 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.576+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b81a68f0 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.576+0000 7f57aeffd640 1 -- 172.21.15.81:0/4110844104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57a8016070 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.576+0000 7f57aeffd640 1 -- 172.21.15.81:0/4110844104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8010d30 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.576+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b81a6f00 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.577+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b8103d60 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.578+0000 7f57aeffd640 1 -- 172.21.15.81:0/4110844104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f57a80119d0 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.579+0000 7f57aeffd640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57a40b6540 0x7f57a40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.579+0000 7f57bdefa640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57a40b6540 0x7f57a40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.579+0000 7f57aeffd640 1 -- 172.21.15.81:0/4110844104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f57a80e7120 con 0x7f57b8108420 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.580+0000 7f57bdefa640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57a40b6540 0x7f57a40b8a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f57b806c6c0 tx=0x7f57b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.582+0000 7f57aeffd640 1 -- 172.21.15.81:0/4110844104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57a80ad670 con 0x7f57b8108420 2024-09-21T03:02:46.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.801+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57b8102ef0 con 0x7f57b8108420 2024-09-21T03:02:46.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.802+0000 7f57aeffd640 1 -- 172.21.15.81:0/4110844104 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f57b8102ef0 con 0x7f57b8108420 2024-09-21T03:02:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:02:46.804 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-21T03:00:33:306479+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:00:32.488820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:02:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-21T03:02:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57a40b6540 msgr2=0x7f57a40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57a40b6540 0x7f57a40b8a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f57b806c6c0 tx=0x7f57b40058d0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8108420 msgr2=0x7f57b819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8108420 0x7f57b819b8b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006fd0 tx=0x7f57a800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 shutdown_connections 2024-09-21T03:02:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f57a40b6540 0x7f57a40b8a50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f57b8108d70 0x7f57b819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b8108420 0x7f57b819b8b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 --2- 172.21.15.81:0/4110844104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57b8102ae0 0x7f57b819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 >> 172.21.15.81:0/4110844104 conn(0x7f57b8079770 msgr2=0x7f57b81065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 shutdown_connections 2024-09-21T03:02:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:46.804+0000 7f57c015e640 1 -- 172.21.15.81:0/4110844104 wait complete. 2024-09-21T03:02:47.592 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T03:02:47.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T03:02:47.656 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:47 smithi081 ceph-mon[30991]: pgmap v431: 129 pgs: 129 active+clean; 1.0 GiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 122 MiB/s wr, 63 op/s 2024-09-21T03:02:47.656 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:47 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4110844104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:02:47.882 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:02:47.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:47 smithi164 ceph-mon[34236]: pgmap v431: 129 pgs: 129 active+clean; 1.0 GiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 122 MiB/s wr, 63 op/s 2024-09-21T03:02:47.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:47 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4110844104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:02:47.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:47 smithi181 ceph-mon[34096]: pgmap v431: 129 pgs: 129 active+clean; 1.0 GiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 122 MiB/s wr, 63 op/s 2024-09-21T03:02:47.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:47 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4110844104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:02:48.387 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:48.387 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 readers = 7570780.00 kB/sec 2024-09-21T03:02:48.387 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 readers = 7558004.18 kB/sec 2024-09-21T03:02:48.387 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 7570780.00 kB/sec 2024-09-21T03:02:48.387 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 7570780.00 kB/sec 2024-09-21T03:02:48.388 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 7570780.00 kB/sec 2024-09-21T03:02:48.388 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 -- 172.21.15.81:0/2531616387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc1031f0 msgr2=0x7f15dc103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 --2- 172.21.15.81:0/2531616387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc1031f0 0x7f15dc103600 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009900 tx=0x7f15d002a410 comp rx=0 tx=0).stop 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 -- 172.21.15.81:0/2531616387 shutdown_connections 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 --2- 172.21.15.81:0/2531616387 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15dc1051c0 0x7f15dc1055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 --2- 172.21.15.81:0/2531616387 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15dc105b10 0x7f15dc10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 --2- 172.21.15.81:0/2531616387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc1031f0 0x7f15dc103600 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 -- 172.21.15.81:0/2531616387 >> 172.21.15.81:0/2531616387 conn(0x7f15dc079e00 msgr2=0x7f15dc07a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 -- 172.21.15.81:0/2531616387 shutdown_connections 2024-09-21T03:02:48.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 -- 172.21.15.81:0/2531616387 wait complete. 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.401+0000 7f15e3846640 1 Processor -- start 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e3846640 1 -- start start 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e3846640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15dc1031f0 0x7f15dc19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e3846640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15dc1051c0 0x7f15dc19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e3846640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc105b10 0x7f15dc1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e3846640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc111540 con 0x7f15dc105b10 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e3846640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1113c0 con 0x7f15dc1051c0 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e3846640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1116c0 con 0x7f15dc1031f0 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc105b10 0x7f15dc1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc105b10 0x7f15dc1a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46954/0 (socket says 172.21.15.81:46954) 2024-09-21T03:02:48.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 -- 172.21.15.81:0/3090832630 learned_addr learned my addr 172.21.15.81:0/3090832630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e0de1640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15dc1051c0 0x7f15dc19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e15e2640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15dc1031f0 0x7f15dc19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 -- 172.21.15.81:0/3090832630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15dc1031f0 msgr2=0x7f15dc19c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15dc1031f0 0x7f15dc19c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 -- 172.21.15.81:0/3090832630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15dc1051c0 msgr2=0x7f15dc19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15dc1051c0 0x7f15dc19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.402+0000 7f15e1de3640 1 -- 172.21.15.81:0/3090832630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc1a2530 con 0x7f15dc105b10 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.403+0000 7f15e1de3640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc105b10 0x7f15dc1a1e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f15d400cad0 tx=0x7f15d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.403+0000 7f15ce7fc640 1 -- 172.21.15.81:0/3090832630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d400ae20 con 0x7f15dc105b10 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.403+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc1a2820 con 0x7f15dc105b10 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.403+0000 7f15ce7fc640 1 -- 172.21.15.81:0/3090832630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d4005020 con 0x7f15dc105b10 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.403+0000 7f15ce7fc640 1 -- 172.21.15.81:0/3090832630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d400f6b0 con 0x7f15dc105b10 2024-09-21T03:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.403+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc1a8f80 con 0x7f15dc105b10 2024-09-21T03:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 Processor -- start 2024-09-21T03:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15ce7fc640 1 -- 172.21.15.81:0/3090832630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f15d40051d0 con 0x7f15dc105b10 2024-09-21T03:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 -- start start 2024-09-21T03:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ad4840 0x55c6f0e7b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e7bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e7c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0df1b90 con 0x55c6f0aab980 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0de0fc0 con 0x55c6f0ab3b60 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e9dba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0de4dd0 con 0x55c6f0ad4840 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e15e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e7bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e15e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e7bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46958/0 (socket says 172.21.15.81:46958) 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e15e2640 1 -- 172.21.15.81:0/2387229478 learned_addr learned my addr 172.21.15.81:0/2387229478 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e0de1640 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e7c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e0de1640 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ad4840 0x55c6f0e7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e15e2640 1 -- 172.21.15.81:0/2387229478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ad4840 msgr2=0x55c6f0e7b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e15e2640 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ad4840 0x55c6f0e7b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.406+0000 7f15e15e2640 1 -- 172.21.15.81:0/2387229478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 msgr2=0x55c6f0e7c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15e15e2640 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e7c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15e15e2640 1 -- 172.21.15.81:0/2387229478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f0d68060 con 0x55c6f0aab980 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15e0de1640 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ad4840 0x55c6f0e7b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15ce7fc640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15c80b6510 0x7f15c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15e15e2640 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e7bb40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f15d002a930 tx=0x7f15d0032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31e3b38df0fa8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:48.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15e0de1640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15c80b6510 0x7f15c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15ce7fc640 1 -- 172.21.15.81:0/3090832630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f15d40e79d0 con 0x7f15dc105b10 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15c77fe640 1 -- 172.21.15.81:0/2387229478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d003f070 con 0x55c6f0aab980 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15c77fe640 1 -- 172.21.15.81:0/2387229478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d00044c0 con 0x55c6f0aab980 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.407+0000 7f15c77fe640 1 -- 172.21.15.81:0/2387229478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0035070 con 0x55c6f0aab980 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 -- 172.21.15.81:0/2387229478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 msgr2=0x55c6f0e7bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e7bb40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f15d002a930 tx=0x7f15d0032dd0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e0de1640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15c80b6510 0x7f15c80b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f15d8005d00 tx=0x7f15d8005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 -- 172.21.15.81:0/2387229478 shutdown_connections 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e7c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e7bb40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2387229478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ad4840 0x55c6f0e7b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 -- 172.21.15.81:0/2387229478 >> 172.21.15.81:0/2387229478 conn(0x55c6f0ac8990 msgr2=0x55c6f0e794f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:48.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 -- 172.21.15.81:0/2387229478 shutdown_connections 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.408+0000 7f15e9dba740 1 -- 172.21.15.81:0/2387229478 wait complete. 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 -- start start 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 Processor -- start 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e87210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e87770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ad4840 0x55c6f0e930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0c427a0 con 0x55c6f0aab980 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0d860a0 con 0x55c6f0ad4840 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55c6f0e89d80 con 0x55c6f0ab3b60 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e15e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e87210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e9dba740 10 client.0 _ll_register_callbacks cb 0x55c6f0d633c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e15e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e87210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46968/0 (socket says 172.21.15.81:46968) 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.409+0000 7f15e15e2640 1 -- 172.21.15.81:0/1215502462 learned_addr learned my addr 172.21.15.81:0/1215502462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:48.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e1de3640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ad4840 0x55c6f0e930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e0de1640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e87770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e15e2640 1 -- 172.21.15.81:0/1215502462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 msgr2=0x55c6f0e87770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e15e2640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e87770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e15e2640 1 -- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ad4840 msgr2=0x55c6f0e930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e15e2640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ad4840 0x55c6f0e930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e15e2640 1 -- 172.21.15.81:0/1215502462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f0d74880 con 0x55c6f0aab980 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e0de1640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e87770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e1de3640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ad4840 0x55c6f0e930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e15e2640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e87210 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f15d002a450 tx=0x7f15d0031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4bd9d93e6b5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15c4ff9640 1 -- 172.21.15.81:0/1215502462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0035030 con 0x55c6f0aab980 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15c4ff9640 1 -- 172.21.15.81:0/1215502462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f15d00046c0 con 0x55c6f0aab980 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c6f0df3ae0 con 0x55c6f0aab980 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15c4ff9640 1 -- 172.21.15.81:0/1215502462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15d003f040 con 0x55c6f0aab980 2024-09-21T03:02:48.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e9dba740 10 client.15813 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.410+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c6f0b4eb90 con 0x55c6f0aab980 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15c4ff9640 1 -- 172.21.15.81:0/1215502462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c6f0df3ae0 con 0x55c6f0aab980 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15c4ff9640 1 -- 172.21.15.81:0/1215502462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f15d003b5f0 con 0x55c6f0aab980 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15e9dba740 10 client.15813 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15e9dba740 10 client.15813 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15e9dba740 20 client.15813 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a931c0 0x55c6f0e98f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15e9dba740 4 client.15813 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6f0def590 con 0x55c6f0a931c0 2024-09-21T03:02:48.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.411+0000 7f15e0de1640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a931c0 0x55c6f0e98f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.412+0000 7f15c4ff9640 10 client.15813 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:48.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.412+0000 7f15e0de1640 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a931c0 0x55c6f0e98f80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=200959260b535e8 server_cookie=9d3290fcd0d1ccec in_seq=0 out_seq=0 2024-09-21T03:02:48.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.412+0000 7f15c4ff9640 1 -- 172.21.15.81:0/1215502462 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c6f0def590 con 0x55c6f0a931c0 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.412+0000 7f15c4ff9640 10 client.15813 handle_command_reply: tid=0 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 client.15813 shutdown 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 msgr2=0x55c6f0e87210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e87210 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f15d002a450 tx=0x7f15d0031d20 comp rx=0 tx=0).stop 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 shutdown_connections 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a931c0 0x55c6f0e98f80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e87770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ad4840 0x55c6f0e930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1215502462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0aab980 0x55c6f0e87210 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 >> 172.21.15.81:0/1215502462 conn(0x55c6f0ac8990 msgr2=0x55c6f0e7e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15c4ff9640 0 client.15813 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 shutdown_connections 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 1 -- 172.21.15.81:0/1215502462 wait complete. 2024-09-21T03:02:48.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.413+0000 7f15e9dba740 20 client.15813 trim_cache size 0 max 16384 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 Processor -- start 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 -- start start 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0aab980 0x55c6f0e88bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e93010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e93550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1b5310 con 0x55c6f0ad4840 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1b2be0 con 0x55c6f0aab980 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.430+0000 7f15e9dba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1b0a30 con 0x55c6f0ab3b60 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e93550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e93550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46970/0 (socket says 172.21.15.81:46970) 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 -- 172.21.15.81:0/1444742846 learned_addr learned my addr 172.21.15.81:0/1444742846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e0de1640 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e93010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e15e2640 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0aab980 0x55c6f0e88bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 -- 172.21.15.81:0/1444742846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 msgr2=0x55c6f0e93010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e93010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 -- 172.21.15.81:0/1444742846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0aab980 msgr2=0x55c6f0e88bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0aab980 0x55c6f0e88bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 -- 172.21.15.81:0/1444742846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f0e93a90 con 0x55c6f0ad4840 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e15e2640 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0aab980 0x55c6f0e88bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15e1de3640 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e93550 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ad520 tx=0x7f15d40ad050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a31f8e5c4d5f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15c6ffd640 1 -- 172.21.15.81:0/1444742846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d401d040 con 0x55c6f0ad4840 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15c6ffd640 1 -- 172.21.15.81:0/1444742846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d40b2300 con 0x55c6f0ad4840 2024-09-21T03:02:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.431+0000 7f15c6ffd640 1 -- 172.21.15.81:0/1444742846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d40a9170 con 0x55c6f0ad4840 2024-09-21T03:02:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 -- 172.21.15.81:0/1444742846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 msgr2=0x55c6f0e93550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e93550 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ad520 tx=0x7f15d40ad050 comp rx=0 tx=0).stop 2024-09-21T03:02:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 -- 172.21.15.81:0/1444742846 shutdown_connections 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e93010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e93550 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 --2- 172.21.15.81:0/1444742846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0aab980 0x55c6f0e88bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 -- 172.21.15.81:0/1444742846 >> 172.21.15.81:0/1444742846 conn(0x55c6f0ac8990 msgr2=0x55c6f0e884c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 -- 172.21.15.81:0/1444742846 shutdown_connections 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.432+0000 7f15e9dba740 1 -- 172.21.15.81:0/1444742846 wait complete. 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 -- start start 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 Processor -- start 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0aab980 0x55c6f0e9c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e9b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1b10a0 con 0x55c6f0ad4840 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1b2510 con 0x55c6f0ab3b60 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1b1770 con 0x55c6f0aab980 2024-09-21T03:02:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e9dba740 10 client.0 _ll_register_callbacks cb 0x7f15d800ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e1de3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e9b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e1de3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e9b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46972/0 (socket says 172.21.15.81:46972) 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e1de3640 1 -- 172.21.15.81:0/2232330518 learned_addr learned my addr 172.21.15.81:0/2232330518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e0de1640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e9abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.433+0000 7f15e15e2640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0aab980 0x55c6f0e9c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e1de3640 1 -- 172.21.15.81:0/2232330518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0aab980 msgr2=0x55c6f0e9c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e1de3640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0aab980 0x55c6f0e9c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e1de3640 1 -- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 msgr2=0x55c6f0e9abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e1de3640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e9abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e1de3640 1 -- 172.21.15.81:0/2232330518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f0e9b810 con 0x55c6f0ad4840 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e0de1640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e9abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e15e2640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0aab980 0x55c6f0e9c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:02:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e1de3640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e9b120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f15d4004ff0 tx=0x7f15d4005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbf1c1ae4a25e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15c4ff9640 1 -- 172.21.15.81:0/2232330518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d40acc80 con 0x55c6f0ad4840 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15c4ff9640 1 -- 172.21.15.81:0/2232330518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f15d40a9170 con 0x55c6f0ad4840 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15d40b2300 con 0x55c6f0ad4840 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15c4ff9640 1 -- 172.21.15.81:0/2232330518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15d40a9370 con 0x55c6f0ad4840 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e9dba740 10 client.15819 fetch_fsmap learned FSMap version 25 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c6f0f04500 con 0x55c6f0ad4840 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15c4ff9640 1 -- 172.21.15.81:0/2232330518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15d40b2300 con 0x55c6f0ad4840 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15c4ff9640 1 -- 172.21.15.81:0/2232330518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f15d40b36b0 con 0x55c6f0ad4840 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e9dba740 10 client.15819 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e9dba740 10 client.15819 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e9dba740 20 client.15819 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.434+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a68570 0x55c6f0f06d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.435+0000 7f15e9dba740 4 client.15819 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T03:02:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.435+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x55c6f0dec9c0 con 0x55c6f0a68570 2024-09-21T03:02:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.435+0000 7f15e15e2640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a68570 0x55c6f0f06d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.435+0000 7f15c4ff9640 10 client.15819 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.435+0000 7f15e15e2640 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a68570 0x55c6f0f06d20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e01544e1a874d18 server_cookie=76c3ebf0966297a in_seq=0 out_seq=0 2024-09-21T03:02:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.448+0000 7f15c4ff9640 1 -- 172.21.15.81:0/2232330518 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c6f0dec9c0 con 0x55c6f0a68570 2024-09-21T03:02:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.448+0000 7f15c4ff9640 10 client.15819 handle_command_reply: tid=0 2024-09-21T03:02:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.448+0000 7f15e9dba740 1 client.15819 shutdown 2024-09-21T03:02:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 msgr2=0x55c6f0e9b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e9b120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f15d4004ff0 tx=0x7f15d4005b20 comp rx=0 tx=0).stop 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 shutdown_connections 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55c6f0a68570 0x55c6f0f06d20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6f0ad4840 0x55c6f0e9b120 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c6f0ab3b60 0x55c6f0e9abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 --2- 172.21.15.81:0/2232330518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6f0aab980 0x55c6f0e9c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15c4ff9640 0 client.15819 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 >> 172.21.15.81:0/2232330518 conn(0x55c6f0ac8990 msgr2=0x55c6f0e88e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 shutdown_connections 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 1 -- 172.21.15.81:0/2232330518 wait complete. 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e9dba740 20 client.15819 trim_cache size 0 max 16384 2024-09-21T03:02:48.451 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 25, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 10, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "3e95b8e9": { 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 10, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 147.8, 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:02:48.452 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:02:48.453 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15c80b6510 msgr2=0x7f15c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e3846640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15c80b6510 0x7f15c80b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f15d8005d00 tx=0x7f15d8005c90 comp rx=0 tx=0).stop 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc105b10 msgr2=0x7f15dc1a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.449+0000 7f15e3846640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc105b10 0x7f15dc1a1e00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f15d400cad0 tx=0x7f15d400cf90 comp rx=0 tx=0).stop 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 shutdown_connections 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f15c80b6510 0x7f15c80b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15dc105b10 0x7f15dc1a1e00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15dc1051c0 0x7f15dc19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 --2- 172.21.15.81:0/3090832630 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f15dc1031f0 0x7f15dc19c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 >> 172.21.15.81:0/3090832630 conn(0x7f15dc079e00 msgr2=0x7f15dc100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 shutdown_connections 2024-09-21T03:02:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:02:48.450+0000 7f15e3846640 1 -- 172.21.15.81:0/3090832630 wait complete. 2024-09-21T03:02:49.559 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3e95b8e9', quiesce took 5.4 seconds. Will release after: 22.4 2024-09-21T03:02:49.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:49 smithi081 ceph-mon[30991]: pgmap v432: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 162 MiB/s wr, 72 op/s 2024-09-21T03:02:49.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:49 smithi164 ceph-mon[34236]: pgmap v432: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 162 MiB/s wr, 72 op/s 2024-09-21T03:02:49.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:49 smithi181 ceph-mon[34096]: pgmap v432: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 162 MiB/s wr, 72 op/s 2024-09-21T03:02:50.751 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:02:50.752 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 re-readers = 6977351.50 kB/sec 2024-09-21T03:02:50.752 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 re-readers = 6965803.10 kB/sec 2024-09-21T03:02:50.752 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 6977351.50 kB/sec 2024-09-21T03:02:50.752 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 6977351.50 kB/sec 2024-09-21T03:02:50.752 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 6977351.50 kB/sec 2024-09-21T03:02:50.752 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 1048576.00 kB 2024-09-21T03:02:51.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:51 smithi081 ceph-mon[30991]: pgmap v433: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 171 MiB/s wr, 75 op/s 2024-09-21T03:02:51.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:51 smithi081 ceph-mon[30991]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:02:51.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:51 smithi164 ceph-mon[34236]: pgmap v433: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 171 MiB/s wr, 75 op/s 2024-09-21T03:02:51.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:51 smithi164 ceph-mon[34236]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:02:51.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:51 smithi181 ceph-mon[34096]: pgmap v433: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 171 MiB/s wr, 75 op/s 2024-09-21T03:02:51.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:51 smithi181 ceph-mon[34096]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:02:53.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:53 smithi081 ceph-mon[30991]: pgmap v434: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 162 MiB/s wr, 74 op/s 2024-09-21T03:02:53.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:53 smithi164 ceph-mon[34236]: pgmap v434: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 162 MiB/s wr, 74 op/s 2024-09-21T03:02:53.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:53 smithi181 ceph-mon[34096]: pgmap v434: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 162 MiB/s wr, 74 op/s 2024-09-21T03:02:55.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:55 smithi081 ceph-mon[30991]: pgmap v435: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 116 MiB/s wr, 51 op/s 2024-09-21T03:02:55.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:55 smithi164 ceph-mon[34236]: pgmap v435: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 116 MiB/s wr, 51 op/s 2024-09-21T03:02:55.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:55 smithi181 ceph-mon[34096]: pgmap v435: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 116 MiB/s wr, 51 op/s 2024-09-21T03:02:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:57 smithi164 ceph-mon[34236]: pgmap v436: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 MiB/s wr, 45 op/s 2024-09-21T03:02:57.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:57 smithi181 ceph-mon[34096]: pgmap v436: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 MiB/s wr, 45 op/s 2024-09-21T03:02:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:57 smithi081 ceph-mon[30991]: pgmap v436: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 102 MiB/s wr, 45 op/s 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 -- 172.21.15.81:0/2195754451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 msgr2=0x7f62b010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 --2- 172.21.15.81:0/2195754451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b010a980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009ca0 tx=0x7f62a802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 -- 172.21.15.81:0/2195754451 shutdown_connections 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 --2- 172.21.15.81:0/2195754451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b010a980 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 --2- 172.21.15.81:0/2195754451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b0103640 0x7f62b0103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 --2- 172.21.15.81:0/2195754451 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b01025c0 0x7f62b0102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 -- 172.21.15.81:0/2195754451 >> 172.21.15.81:0/2195754451 conn(0x7f62b00fdf00 msgr2=0x7f62b01003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 -- 172.21.15.81:0/2195754451 shutdown_connections 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 -- 172.21.15.81:0/2195754451 wait complete. 2024-09-21T03:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.157+0000 7f62b53f1640 1 Processor -- start 2024-09-21T03:02:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62b53f1640 1 -- start start 2024-09-21T03:02:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62b53f1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b01025c0 0x7f62b006c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62b53f1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b0103640 0x7f62b019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62b53f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b01a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62b53f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62b010e060 con 0x7f62b0103fe0 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62b53f1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f62b010dee0 con 0x7f62b0103640 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62b53f1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62b010e1e0 con 0x7f62b01025c0 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b01a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b01a10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33462/0 (socket says 172.21.15.81:33462) 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 -- 172.21.15.81:0/4075543122 learned_addr learned my addr 172.21.15.81:0/4075543122 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62aeffd640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b01025c0 0x7f62b006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b0103640 0x7f62b019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 -- 172.21.15.81:0/4075543122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b01025c0 msgr2=0x7f62b006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b01025c0 0x7f62b006c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 -- 172.21.15.81:0/4075543122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b0103640 msgr2=0x7f62b019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b0103640 0x7f62b019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.158+0000 7f62af7fe640 1 -- 172.21.15.81:0/4075543122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b01a1840 con 0x7f62b0103fe0 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.159+0000 7f62af7fe640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b01a10b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009dc0 tx=0x7f62a8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.159+0000 7f6297fff640 1 -- 172.21.15.81:0/4075543122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8004240 con 0x7f62b0103fe0 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.159+0000 7f6297fff640 1 -- 172.21.15.81:0/4075543122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62a8040030 con 0x7f62b0103fe0 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.159+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b01a1ad0 con 0x7f62b0103fe0 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.159+0000 7f6297fff640 1 -- 172.21.15.81:0/4075543122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a803b430 con 0x7f62b0103fe0 2024-09-21T03:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.159+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b01a2020 con 0x7f62b0103fe0 2024-09-21T03:02:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.161+0000 7f6297fff640 1 -- 172.21.15.81:0/4075543122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f62a80306c0 con 0x7f62b0103fe0 2024-09-21T03:02:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.161+0000 7f62bc43a740 1 Processor -- start 2024-09-21T03:02:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62bc43a740 1 -- start start 2024-09-21T03:02:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb23a41b0 0x557fb274be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb237b2f0 0x557fb274c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb274d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62bc43a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557fb26be6f0 con 0x557fb23a41b0 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62bc43a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557fb26adb20 con 0x557fb237b2f0 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62bc43a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557fb26b1930 con 0x557fb23834d0 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb23a41b0 0x557fb274be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb23a41b0 0x557fb274be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33470/0 (socket says 172.21.15.81:33470) 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 -- 172.21.15.81:0/293033140 learned_addr learned my addr 172.21.15.81:0/293033140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62aeffd640 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb237b2f0 0x557fb274c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb274d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f6297fff640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f62980b6510 0x7f62980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 -- 172.21.15.81:0/293033140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 msgr2=0x557fb274d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb274d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 -- 172.21.15.81:0/293033140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb237b2f0 msgr2=0x557fb274c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb237b2f0 0x557fb274c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 -- 172.21.15.81:0/293033140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb2673530 con 0x557fb23a41b0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62af7fe640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f62980b6510 0x7f62980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.162+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb23a41b0 0x557fb274be50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f62a4012470 tx=0x7f62a400c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2112620af77c5bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.163+0000 7f6297fff640 1 -- 172.21.15.81:0/4075543122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f62a8108640 con 0x7f62b0103fe0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.163+0000 7f62957fa640 1 -- 172.21.15.81:0/293033140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4018030 con 0x557fb23a41b0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.163+0000 7f62957fa640 1 -- 172.21.15.81:0/293033140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62a40054b0 con 0x557fb23a41b0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.163+0000 7f62957fa640 1 -- 172.21.15.81:0/293033140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a40106a0 con 0x557fb23a41b0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.163+0000 7f62bc43a740 1 -- 172.21.15.81:0/293033140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb23a41b0 msgr2=0x557fb274be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.163+0000 7f62bc43a740 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb23a41b0 0x557fb274be50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f62a4012470 tx=0x7f62a400c5e0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.163+0000 7f62af7fe640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f62980b6510 0x7f62980b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f62a8005cc0 tx=0x7f62a80fef30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- 172.21.15.81:0/293033140 shutdown_connections 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb274d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb237b2f0 0x557fb274c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 --2- 172.21.15.81:0/293033140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb23a41b0 0x557fb274be50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- 172.21.15.81:0/293033140 >> 172.21.15.81:0/293033140 conn(0x557fb2398300 msgr2=0x557fb27478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- 172.21.15.81:0/293033140 shutdown_connections 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- 172.21.15.81:0/293033140 wait complete. 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- start start 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 Processor -- start 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2755610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb2755cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23a41b0 0x557fb2756840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557fb25e5ab0 con 0x557fb237b2f0 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557fb2653730 con 0x557fb23a41b0 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557fb274db30 con 0x557fb23834d0 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62ae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2755610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62bc43a740 10 client.0 _ll_register_callbacks cb 0x557fb26a76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.164+0000 7f62ae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2755610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33472/0 (socket says 172.21.15.81:33472) 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 -- 172.21.15.81:0/2975329300 learned_addr learned my addr 172.21.15.81:0/2975329300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62aeffd640 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb2755cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23a41b0 0x557fb2756840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 -- 172.21.15.81:0/2975329300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 msgr2=0x557fb2755cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb2755cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 -- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23a41b0 msgr2=0x557fb2756840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23a41b0 0x557fb2756840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 -- 172.21.15.81:0/2975329300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fb240f790 con 0x557fb237b2f0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2755610 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f62a4005d90 tx=0x7f62a4005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6cb64022b00ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f6292ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f6292ff5640 1 -- 172.21.15.81:0/2975329300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4021070 con 0x557fb237b2f0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f6292ff5640 1 -- 172.21.15.81:0/2975329300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f62a4004020 con 0x557fb237b2f0 2024-09-21T03:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a40054b0 con 0x557fb237b2f0 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f6292ff5640 1 -- 172.21.15.81:0/2975329300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62a4031050 con 0x557fb237b2f0 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62bc43a740 10 client.15831 fetch_fsmap learned FSMap version 26 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557fb2488620 con 0x557fb237b2f0 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.165+0000 7f6292ff5640 1 -- 172.21.15.81:0/2975329300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62a40054b0 con 0x557fb237b2f0 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f6292ff5640 1 -- 172.21.15.81:0/2975329300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f62a4010c90 con 0x557fb237b2f0 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f62bc43a740 10 client.15831 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f62bc43a740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f62bc43a740 20 client.15831 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb2362d80 0x557fb2762c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f62bc43a740 4 client.15831 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fb26c0640 con 0x557fb2362d80 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.166+0000 7f62aeffd640 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb2362d80 0x557fb2762c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f6292ff5640 10 client.15831 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62aeffd640 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb2362d80 0x557fb2762c20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25efd9f8b41a8f1 server_cookie=f56a30234757e2a2 in_seq=0 out_seq=0 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f6292ff5640 1 -- 172.21.15.81:0/2975329300 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fb26c0640 con 0x557fb2362d80 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f6292ff5640 10 client.15831 handle_command_reply: tid=0 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 client.15831 shutdown 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 msgr2=0x557fb2755610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2755610 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f62a4005d90 tx=0x7f62a4005d20 comp rx=0 tx=0).stop 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 shutdown_connections 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb2362d80 0x557fb2762c20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb23834d0 0x557fb2755cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f6292ff5640 0 client.15831 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23a41b0 0x557fb2756840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2975329300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2755610 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.167+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 >> 172.21.15.81:0/2975329300 conn(0x557fb2398300 msgr2=0x557fb2745ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.168+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 shutdown_connections 2024-09-21T03:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.168+0000 7f62bc43a740 1 -- 172.21.15.81:0/2975329300 wait complete. 2024-09-21T03:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.168+0000 7f62bc43a740 20 client.15831 trim_cache size 0 max 16384 2024-09-21T03:02:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 Processor -- start 2024-09-21T03:02:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 -- start start 2024-09-21T03:02:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 0x557fb2746610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2746b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb2753b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01aeba0 con 0x557fb237b2f0 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01ac470 con 0x557fb23834d0 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62bc43a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01aa2c0 con 0x557fb2362d80 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2746b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2746b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33486/0 (socket says 172.21.15.81:33486) 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 -- 172.21.15.81:0/2630261351 learned_addr learned my addr 172.21.15.81:0/2630261351 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 -- 172.21.15.81:0/2630261351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 msgr2=0x557fb2746610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 0x557fb2746610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb2753b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 -- 172.21.15.81:0/2630261351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 msgr2=0x557fb2753b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb2753b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 -- 172.21.15.81:0/2630261351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb2756bb0 con 0x557fb237b2f0 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb2753b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.182+0000 7f62aeffd640 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2746b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f62a0005e80 tx=0x7f62a000a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7058bcffe3c413 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f6294ff9640 1 -- 172.21.15.81:0/2630261351 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a001e6c0 con 0x557fb237b2f0 2024-09-21T03:02:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f6294ff9640 1 -- 172.21.15.81:0/2630261351 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62a0029070 con 0x557fb237b2f0 2024-09-21T03:02:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f6294ff9640 1 -- 172.21.15.81:0/2630261351 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0024ba0 con 0x557fb237b2f0 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 -- 172.21.15.81:0/2630261351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 msgr2=0x557fb2746b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2746b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f62a0005e80 tx=0x7f62a000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 -- 172.21.15.81:0/2630261351 shutdown_connections 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb2753b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb2746b50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 --2- 172.21.15.81:0/2630261351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 0x557fb2746610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 -- 172.21.15.81:0/2630261351 >> 172.21.15.81:0/2630261351 conn(0x557fb2398300 msgr2=0x557fb2754830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 -- 172.21.15.81:0/2630261351 shutdown_connections 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.183+0000 7f62bc43a740 1 -- 172.21.15.81:0/2630261351 wait complete. 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 -- start start 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 Processor -- start 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 0x557fb275cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb275d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb275bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01aa930 con 0x557fb237b2f0 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01abda0 con 0x557fb23834d0 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f62b01ab000 con 0x557fb2362d80 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62bc43a740 10 client.0 _ll_register_callbacks cb 0x7f62a000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb275d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb275d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33500/0 (socket says 172.21.15.81:33500) 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 -- 172.21.15.81:0/3108840221 learned_addr learned my addr 172.21.15.81:0/3108840221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:02:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb275bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 0x557fb275cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 -- 172.21.15.81:0/3108840221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 msgr2=0x557fb275cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 0x557fb275cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 -- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 msgr2=0x557fb275bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb275bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.184+0000 7f62aeffd640 1 -- 172.21.15.81:0/3108840221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fb275c4f0 con 0x557fb237b2f0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62aeffd640 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb275d670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f62a0024710 tx=0x7f62a0024920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8478f93e32c0d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f6292ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f6292ff5640 1 -- 172.21.15.81:0/3108840221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a001e6c0 con 0x557fb237b2f0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f6292ff5640 1 -- 172.21.15.81:0/3108840221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f62a001e860 con 0x557fb237b2f0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a0029070 con 0x557fb237b2f0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f6292ff5640 1 -- 172.21.15.81:0/3108840221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62a0024e10 con 0x557fb237b2f0 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 10 client.15837 fetch_fsmap learned FSMap version 26 2024-09-21T03:02:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557fb275b330 con 0x557fb237b2f0 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f6292ff5640 1 -- 172.21.15.81:0/3108840221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f62a0029070 con 0x557fb237b2f0 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f6292ff5640 1 -- 172.21.15.81:0/3108840221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f62a0037c50 con 0x557fb237b2f0 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 10 client.15837 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 20 client.15837 populate_metadata read hostname 'smithi081' 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb23a41b0 0x557fb27cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 4 client.15837 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.185+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557fb26bc0f0 con 0x557fb23a41b0 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.186+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb23a41b0 0x557fb27cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.186+0000 7f6292ff5640 10 client.15837 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.186+0000 7f62ae7fc640 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb23a41b0 0x557fb27cfb20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a4ceaf0b675fbc4 server_cookie=261d2c1771ff6fb0 in_seq=0 out_seq=0 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f6292ff5640 1 -- 172.21.15.81:0/3108840221 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557fb26bc0f0 con 0x557fb23a41b0 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f6292ff5640 10 client.15837 handle_command_reply: tid=0 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 client.15837 shutdown 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 msgr2=0x557fb275d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb275d670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f62a0024710 tx=0x7f62a0024920 comp rx=0 tx=0).stop 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 shutdown_connections 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557fb23a41b0 0x557fb27cfb20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557fb23834d0 0x557fb275bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557fb237b2f0 0x557fb275d670 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f6292ff5640 0 client.15837 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 --2- 172.21.15.81:0/3108840221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557fb2362d80 0x557fb275cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 >> 172.21.15.81:0/3108840221 conn(0x557fb2398300 msgr2=0x557fb27465b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 shutdown_connections 2024-09-21T03:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 1 -- 172.21.15.81:0/3108840221 wait complete. 2024-09-21T03:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.195+0000 7f62bc43a740 20 client.15837 trim_cache size 0 max 16384 2024-09-21T03:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f62980b6510 msgr2=0x7f62980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f62980b6510 0x7f62980b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f62a8005cc0 tx=0x7f62a80fef30 comp rx=0 tx=0).stop 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 msgr2=0x7f62b01a10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b01a10b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009dc0 tx=0x7f62a8003ba0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 shutdown_connections 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f62980b6510 0x7f62980b8a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b0103fe0 0x7f62b01a10b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b0103640 0x7f62b019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 --2- 172.21.15.81:0/4075543122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62b01025c0 0x7f62b006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:02:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 >> 172.21.15.81:0/4075543122 conn(0x7f62b00fdf00 msgr2=0x7f62b0106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:02:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 shutdown_connections 2024-09-21T03:02:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:02:58.196+0000 7f62b53f1640 1 -- 172.21.15.81:0/4075543122 wait complete. 2024-09-21T03:02:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:02:59 smithi164 ceph-mon[34236]: pgmap v437: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 48 MiB/s wr, 21 op/s 2024-09-21T03:02:59.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:02:59 smithi181 ceph-mon[34096]: pgmap v437: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 48 MiB/s wr, 21 op/s 2024-09-21T03:03:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:02:59 smithi081 ceph-mon[30991]: pgmap v437: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 48 MiB/s wr, 21 op/s 2024-09-21T03:03:01.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:01 smithi164 ceph-mon[34236]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 9.0 MiB/s wr, 11 op/s 2024-09-21T03:03:01.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:01 smithi181 ceph-mon[34096]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 9.0 MiB/s wr, 11 op/s 2024-09-21T03:03:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:01 smithi081 ceph-mon[30991]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 9.0 MiB/s wr, 11 op/s 2024-09-21T03:03:03.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:03 smithi164 ceph-mon[34236]: pgmap v439: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T03:03:03.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:03 smithi181 ceph-mon[34096]: pgmap v439: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T03:03:04.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:03 smithi081 ceph-mon[30991]: pgmap v439: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T03:03:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:05 smithi164 ceph-mon[34236]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:05.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:05 smithi181 ceph-mon[34096]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:06.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:05 smithi081 ceph-mon[30991]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:07.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:07 smithi164 ceph-mon[34236]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:07.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:07 smithi181 ceph-mon[34096]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:08.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:07 smithi081 ceph-mon[30991]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:09.857 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:09 smithi081 ceph-mon[30991]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:09.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:09 smithi164 ceph-mon[34236]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:09.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:09 smithi181 ceph-mon[34096]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.292+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3695850183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 msgr2=0x7f2cb010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3695850183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb010a960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009c90 tx=0x7f2ca802a880 comp rx=0 tx=0).stop 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3695850183 shutdown_connections 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3695850183 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb0103620 0x7f2cb0103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3695850183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb010a960 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3695850183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb01025a0 0x7f2cb0102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3695850183 >> 172.21.15.81:0/3695850183 conn(0x7f2cb00fdee0 msgr2=0x7f2cb0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3695850183 shutdown_connections 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3695850183 wait complete. 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 Processor -- start 2024-09-21T03:03:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.293+0000 7f2cb67eb640 1 -- start start 2024-09-21T03:03:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb67eb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb01025a0 0x7f2cb0198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb67eb640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb0103620 0x7f2cb0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb67eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb0199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb67eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb010e090 con 0x7f2cb0103fc0 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb67eb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb010df10 con 0x7f2cb01025a0 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb67eb640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb010e210 con 0x7f2cb0103620 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb0199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb0199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57550/0 (socket says 172.21.15.81:57550) 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 -- 172.21.15.81:0/3767189471 learned_addr learned my addr 172.21.15.81:0/3767189471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2caffff640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb01025a0 0x7f2cb0198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb0103620 0x7f2cb0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 -- 172.21.15.81:0/3767189471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb0103620 msgr2=0x7f2cb0199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb0103620 0x7f2cb0199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 -- 172.21.15.81:0/3767189471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb01025a0 msgr2=0x7f2cb0198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb01025a0 0x7f2cb0198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 -- 172.21.15.81:0/3767189471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb019a6c0 con 0x7f2cb0103fc0 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb0103620 0x7f2cb0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cb4d88640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb0199f30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80092e0 tx=0x7f2ca80307b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.294+0000 7f2cad7fa640 1 -- 172.21.15.81:0/3767189471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8030c60 con 0x7f2cb0103fc0 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.295+0000 7f2cad7fa640 1 -- 172.21.15.81:0/3767189471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca8003e50 con 0x7f2cb0103fc0 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.295+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb019a950 con 0x7f2cb0103fc0 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.295+0000 7f2cad7fa640 1 -- 172.21.15.81:0/3767189471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca803b400 con 0x7f2cb0103fc0 2024-09-21T03:03:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.295+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb01a0f50 con 0x7f2cb0103fc0 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 Processor -- start 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cad7fa640 1 -- 172.21.15.81:0/3767189471 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2ca80040e0 con 0x7f2cb0103fc0 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 -- start start 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d51e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d524c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d53010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aac6cc46f0 con 0x55aac69aa1b0 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55aac6cb3b20 con 0x55aac69894d0 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2cbd838740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55aac6cb7930 con 0x55aac69812f0 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.297+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d51e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d51e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57552/0 (socket says 172.21.15.81:57552) 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2014537882 learned_addr learned my addr 172.21.15.81:0/2014537882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caffff640 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d53010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2014537882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 msgr2=0x55aac6d524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2014537882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 msgr2=0x55aac6d53010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d53010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2cad7fa640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2c980b6510 0x7f2c980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2014537882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac6c79530 con 0x55aac69aa1b0 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2cb4d88640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2c980b6510 0x7f2c980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d51e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400be90 tx=0x7f2ca400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dcb672b72cb218 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2cad7fa640 1 -- 172.21.15.81:0/3767189471 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2ca8108800 con 0x7f2cb0103fc0 2024-09-21T03:03:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2c967fc640 1 -- 172.21.15.81:0/2014537882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4005220 con 0x55aac69aa1b0 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2c967fc640 1 -- 172.21.15.81:0/2014537882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca400fe10 con 0x55aac69aa1b0 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.298+0000 7f2c967fc640 1 -- 172.21.15.81:0/2014537882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40128c0 con 0x55aac69aa1b0 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 -- 172.21.15.81:0/2014537882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 msgr2=0x55aac6d51e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cb4d88640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2c980b6510 0x7f2c980b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ce350 tx=0x7f2ca809a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d51e50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400be90 tx=0x7f2ca400b610 comp rx=0 tx=0).stop 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 -- 172.21.15.81:0/2014537882 shutdown_connections 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d53010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2014537882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d51e50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 -- 172.21.15.81:0/2014537882 >> 172.21.15.81:0/2014537882 conn(0x55aac699e300 msgr2=0x55aac6d4d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 -- 172.21.15.81:0/2014537882 shutdown_connections 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.299+0000 7f2cbd838740 1 -- 172.21.15.81:0/2014537882 wait complete. 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 -- start start 2024-09-21T03:03:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 Processor -- start 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d5b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69894d0 0x55aac6d5bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69aa1b0 0x55aac6d5c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aac6bebab0 con 0x55aac69894d0 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55aac6c59730 con 0x55aac69aa1b0 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55aac6d53b30 con 0x55aac69812f0 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2cbd838740 10 client.0 _ll_register_callbacks cb 0x55aac6cad6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69894d0 0x55aac6d5bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69894d0 0x55aac6d5bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57556/0 (socket says 172.21.15.81:57556) 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 -- 172.21.15.81:0/3167227098 learned_addr learned my addr 172.21.15.81:0/3167227098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d5b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 -- 172.21.15.81:0/3167227098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 msgr2=0x55aac6d5b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d5b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69aa1b0 0x55aac6d5c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 -- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69aa1b0 msgr2=0x55aac6d5c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69aa1b0 0x55aac6d5c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.300+0000 7f2caffff640 1 -- 172.21.15.81:0/3167227098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac6a15790 con 0x55aac69894d0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2caffff640 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69894d0 0x55aac6d5bc70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000cec0 tx=0x7f2ca00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c629b62a204981e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2c8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/3167227098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00119f0 con 0x55aac69894d0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/3167227098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2ca0011b90 con 0x55aac69894d0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca400fe10 con 0x55aac69894d0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/3167227098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2ca0011d90 con 0x55aac69894d0 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2cbd838740 10 client.15849 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aac6a8e620 con 0x55aac69894d0 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/3167227098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca400fe10 con 0x55aac69894d0 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/3167227098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f2ca0018070 con 0x55aac69894d0 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2cbd838740 10 client.15849 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.301+0000 7f2cbd838740 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.302+0000 7f2cbd838740 20 client.15849 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.302+0000 7f2cbd838740 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac6968d80 0x55aac6d68e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.302+0000 7f2cbd838740 4 client.15849 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.302+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aac6cc6640 con 0x55aac6968d80 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.302+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac6968d80 0x55aac6d68e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.302+0000 7f2c8f7fe640 10 client.15849 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.302+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac6968d80 0x55aac6d68e10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1fc995fb58546c server_cookie=faaae8fc6aa461bf in_seq=0 out_seq=0 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/3167227098 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aac6cc6640 con 0x55aac6968d80 2024-09-21T03:03:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2c8f7fe640 10 client.15849 handle_command_reply: tid=0 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 client.15849 shutdown 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69894d0 msgr2=0x55aac6d5bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69894d0 0x55aac6d5bc70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000cec0 tx=0x7f2ca00039c0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 shutdown_connections 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac6968d80 0x55aac6d68e10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69aa1b0 0x55aac6d5c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69894d0 0x55aac6d5bc70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2c8f7fe640 0 client.15849 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 --2- 172.21.15.81:0/3167227098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d5b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.303+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 >> 172.21.15.81:0/3167227098 conn(0x55aac699e300 msgr2=0x55aac6d4bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.304+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 shutdown_connections 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.304+0000 7f2cbd838740 1 -- 172.21.15.81:0/3167227098 wait complete. 2024-09-21T03:03:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.304+0000 7f2cbd838740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T03:03:11.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 Processor -- start 2024-09-21T03:03:11.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 -- start start 2024-09-21T03:03:11.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69812f0 0x55aac6d5a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69894d0 0x55aac6d5b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d5baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01adae0 con 0x55aac69aa1b0 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01ab3b0 con 0x55aac69812f0 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2cbd838740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01a9200 con 0x55aac69894d0 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d5baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d5baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57562/0 (socket says 172.21.15.81:57562) 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2728712062 learned_addr learned my addr 172.21.15.81:0/2728712062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69812f0 0x55aac6d5a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caffff640 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69894d0 0x55aac6d5b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2728712062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69894d0 msgr2=0x55aac6d5b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69894d0 0x55aac6d5b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2728712062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69812f0 msgr2=0x55aac6d5a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69812f0 0x55aac6d5a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 -- 172.21.15.81:0/2728712062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac6d655f0 con 0x55aac69aa1b0 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.318+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d5baf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005fd0 tx=0x7f2ca4012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc05cac0d0713370 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2c95ffb640 1 -- 172.21.15.81:0/2728712062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400fe90 con 0x55aac69aa1b0 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2c95ffb640 1 -- 172.21.15.81:0/2728712062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca40054d0 con 0x55aac69aa1b0 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2c95ffb640 1 -- 172.21.15.81:0/2728712062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4012e60 con 0x55aac69aa1b0 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 -- 172.21.15.81:0/2728712062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 msgr2=0x55aac6d5baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d5baf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005fd0 tx=0x7f2ca4012660 comp rx=0 tx=0).stop 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 -- 172.21.15.81:0/2728712062 shutdown_connections 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69894d0 0x55aac6d5b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6d5baf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 --2- 172.21.15.81:0/2728712062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69812f0 0x55aac6d5a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 -- 172.21.15.81:0/2728712062 >> 172.21.15.81:0/2728712062 conn(0x55aac699e300 msgr2=0x55aac6d59ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 -- 172.21.15.81:0/2728712062 shutdown_connections 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.319+0000 7f2cbd838740 1 -- 172.21.15.81:0/2728712062 wait complete. 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 -- start start 2024-09-21T03:03:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 Processor -- start 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d62b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d63230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6dcd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01a9870 con 0x55aac69aa1b0 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01aace0 con 0x55aac69894d0 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01a9f40 con 0x55aac69812f0 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2cbd838740 10 client.0 _ll_register_callbacks cb 0x7f2ca0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6dcd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6dcd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57574/0 (socket says 172.21.15.81:57574) 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2caf7fe640 1 -- 172.21.15.81:0/491624006 learned_addr learned my addr 172.21.15.81:0/491624006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.320+0000 7f2caffff640 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d63230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d62b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2caf7fe640 1 -- 172.21.15.81:0/491624006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 msgr2=0x55aac6d62b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d62b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2caf7fe640 1 -- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 msgr2=0x55aac6d63230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d63230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2caf7fe640 1 -- 172.21.15.81:0/491624006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac6dce0d0 con 0x55aac69aa1b0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2caf7fe640 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6dcd970 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005890 tx=0x7f2ca4005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1093772840cf518 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2c8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/491624006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4005320 con 0x55aac69aa1b0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/491624006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2ca40129c0 con 0x55aac69aa1b0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca40054d0 con 0x55aac69aa1b0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/491624006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2ca4004660 con 0x55aac69aa1b0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2cbd838740 10 client.15855 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aac6dd53c0 con 0x55aac69aa1b0 2024-09-21T03:03:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/491624006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ca40054d0 con 0x55aac69aa1b0 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.321+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/491624006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f2ca402f750 con 0x55aac69aa1b0 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2cbd838740 10 client.15855 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2cbd838740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2cbd838740 20 client.15855 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2cbd838740 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac693e1c0 0x55aac6dd7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2cbd838740 4 client.15855 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aac6d4e090 con 0x55aac693e1c0 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2caffff640 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac693e1c0 0x55aac6dd7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2c8f7fe640 10 client.15855 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.322+0000 7f2caffff640 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac693e1c0 0x55aac6dd7bf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d5c062193bd8b99 server_cookie=1e48e999109d7397 in_seq=0 out_seq=0 2024-09-21T03:03:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2c8f7fe640 1 -- 172.21.15.81:0/491624006 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aac6d4e090 con 0x55aac693e1c0 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2c8f7fe640 10 client.15855 handle_command_reply: tid=0 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 client.15855 shutdown 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 msgr2=0x55aac6dcd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6dcd970 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005890 tx=0x7f2ca4005be0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 shutdown_connections 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55aac693e1c0 0x55aac6dd7bf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aac69aa1b0 0x55aac6dcd970 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55aac69894d0 0x55aac6d63230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2c8f7fe640 0 client.15855 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 --2- 172.21.15.81:0/491624006 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55aac69812f0 0x55aac6d62b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 >> 172.21.15.81:0/491624006 conn(0x55aac699e300 msgr2=0x55aac6d59a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 shutdown_connections 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 1 -- 172.21.15.81:0/491624006 wait complete. 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.328+0000 7f2cbd838740 20 client.15855 trim_cache size 0 max 16384 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:03:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:03:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2c980b6510 msgr2=0x7f2c980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2c980b6510 0x7f2c980b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ce350 tx=0x7f2ca809a250 comp rx=0 tx=0).stop 2024-09-21T03:03:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 msgr2=0x7f2cb0199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb0199f30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80092e0 tx=0x7f2ca80307b0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 shutdown_connections 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f2c980b6510 0x7f2c980b8a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2cb0103620 0x7f2cb0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb0103fc0 0x7f2cb0199f30 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 --2- 172.21.15.81:0/3767189471 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb01025a0 0x7f2cb0198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 >> 172.21.15.81:0/3767189471 conn(0x7f2cb00fdee0 msgr2=0x7f2cb0106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 shutdown_connections 2024-09-21T03:03:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:11.329+0000 7f2cb67eb640 1 -- 172.21.15.81:0/3767189471 wait complete. 2024-09-21T03:03:11.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:11 smithi164 ceph-mon[34236]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:11.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:03:11.982 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:11 smithi081 ceph-mon[30991]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:11.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:11 smithi181 ceph-mon[34096]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T03:03:12.208 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:03:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 -- 172.21.15.81:0/49196987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e701083a0 msgr2=0x7f7e701087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 --2- 172.21.15.81:0/49196987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e701083a0 0x7f7e701087b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009900 tx=0x7f7e6002a410 comp rx=0 tx=0).stop 2024-09-21T03:03:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 -- 172.21.15.81:0/49196987 shutdown_connections 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 --2- 172.21.15.81:0/49196987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e70108cf0 0x7f7e7010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 --2- 172.21.15.81:0/49196987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e701083a0 0x7f7e701087b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 --2- 172.21.15.81:0/49196987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e70102a60 0x7f7e70102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 -- 172.21.15.81:0/49196987 >> 172.21.15.81:0/49196987 conn(0x7f7e70079730 msgr2=0x7f7e70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 -- 172.21.15.81:0/49196987 shutdown_connections 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.702+0000 7f7e77ded640 1 -- 172.21.15.81:0/49196987 wait complete. 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 Processor -- start 2024-09-21T03:03:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 -- start start 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e70102a60 0x7f7e70199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e701083a0 0x7f7e701999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70108cf0 0x7f7e7019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70112810 con 0x7f7e70108cf0 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70112690 con 0x7f7e70102a60 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e77ded640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70112990 con 0x7f7e701083a0 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.703+0000 7f7e7638a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70108cf0 0x7f7e7019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70108cf0 0x7f7e7019ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57590/0 (socket says 172.21.15.81:57590) 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 -- 172.21.15.81:0/1128116177 learned_addr learned my addr 172.21.15.81:0/1128116177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e75b89640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e70102a60 0x7f7e70199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e75388640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e701083a0 0x7f7e701999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 -- 172.21.15.81:0/1128116177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e701083a0 msgr2=0x7f7e701999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e701083a0 0x7f7e701999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 -- 172.21.15.81:0/1128116177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e70102a60 msgr2=0x7f7e70199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e70102a60 0x7f7e70199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 -- 172.21.15.81:0/1128116177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7019f3c0 con 0x7f7e70108cf0 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e75388640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e701083a0 0x7f7e701999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e7638a640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70108cf0 0x7f7e7019ec90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800cad0 tx=0x7f7e6800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e66ffd640 1 -- 172.21.15.81:0/1128116177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800ae20 con 0x7f7e70108cf0 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7019f6b0 con 0x7f7e70108cf0 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e66ffd640 1 -- 172.21.15.81:0/1128116177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e68005020 con 0x7f7e70108cf0 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e66ffd640 1 -- 172.21.15.81:0/1128116177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800f6b0 con 0x7f7e70108cf0 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.704+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e701a5e10 con 0x7f7e70108cf0 2024-09-21T03:03:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.705+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e70102e70 con 0x7f7e70108cf0 2024-09-21T03:03:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.707+0000 7f7e66ffd640 1 -- 172.21.15.81:0/1128116177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7e680051d0 con 0x7f7e70108cf0 2024-09-21T03:03:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.708+0000 7f7e66ffd640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7e5c0b6510 0x7f7e5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.708+0000 7f7e75b89640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7e5c0b6510 0x7f7e5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.708+0000 7f7e66ffd640 1 -- 172.21.15.81:0/1128116177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f7e680e78f0 con 0x7f7e70108cf0 2024-09-21T03:03:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.708+0000 7f7e75b89640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7e5c0b6510 0x7f7e5c0b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00bbe0 tx=0x7f7e6c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:12.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.711+0000 7f7e66ffd640 1 -- 172.21.15.81:0/1128116177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e68014030 con 0x7f7e70108cf0 2024-09-21T03:03:12.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.931+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e7010ab40 con 0x7f7e70108cf0 2024-09-21T03:03:12.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.932+0000 7f7e66ffd640 1 -- 172.21.15.81:0/1128116177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11925 (secure 0 0 0) 0x7f7e680ade40 con 0x7f7e70108cf0 2024-09-21T03:03:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:03:12.934 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-21T03:02:50:539320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:02:50.244254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T03:03:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7e5c0b6510 msgr2=0x7f7e5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7e5c0b6510 0x7f7e5c0b8a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00bbe0 tx=0x7f7e6c00b390 comp rx=0 tx=0).stop 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70108cf0 msgr2=0x7f7e7019ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70108cf0 0x7f7e7019ec90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800cad0 tx=0x7f7e6800cf90 comp rx=0 tx=0).stop 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 shutdown_connections 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f7e5c0b6510 0x7f7e5c0b8a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e701083a0 0x7f7e701999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70108cf0 0x7f7e7019ec90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 --2- 172.21.15.81:0/1128116177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e70102a60 0x7f7e70199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 >> 172.21.15.81:0/1128116177 conn(0x7f7e70079730 msgr2=0x7f7e70104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 shutdown_connections 2024-09-21T03:03:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:12.934+0000 7f7e77ded640 1 -- 172.21.15.81:0/1128116177 wait complete. 2024-09-21T03:03:13.734 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:13 smithi081 ceph-mon[30991]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:03:13.734 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:13 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1128116177' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db --set-id 3e95b8e9 --release --await' 2024-09-21T03:03:13.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db --set-id 3e95b8e9 --release --await 2024-09-21T03:03:13.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:13 smithi164 ceph-mon[34236]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:03:13.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:13 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1128116177' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:13 smithi181 ceph-mon[34096]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:03:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:13 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1128116177' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:03:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 -- 172.21.15.81:0/3273873360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15901031c0 msgr2=0x7f15901035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 --2- 172.21.15.81:0/3273873360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15901031c0 0x7f15901035d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1580009900 tx=0x7f158002a410 comp rx=0 tx=0).stop 2024-09-21T03:03:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 -- 172.21.15.81:0/3273873360 shutdown_connections 2024-09-21T03:03:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 --2- 172.21.15.81:0/3273873360 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1590108f50 0x7f159010f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 --2- 172.21.15.81:0/3273873360 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590108600 0x7f1590108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 --2- 172.21.15.81:0/3273873360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15901031c0 0x7f15901035d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 -- 172.21.15.81:0/3273873360 >> 172.21.15.81:0/3273873360 conn(0x7f1590079e30 msgr2=0x7f159007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:14.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 -- 172.21.15.81:0/3273873360 shutdown_connections 2024-09-21T03:03:14.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.542+0000 7f15948de640 1 -- 172.21.15.81:0/3273873360 wait complete. 2024-09-21T03:03:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.543+0000 7f15948de640 1 Processor -- start 2024-09-21T03:03:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.543+0000 7f15948de640 1 -- start start 2024-09-21T03:03:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.543+0000 7f15948de640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15901031c0 0x7f159019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.543+0000 7f15948de640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1590108600 0x7f159019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.543+0000 7f15948de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1590108f50 0x7f159019ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15948de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1590112ac0 con 0x7f1590108f50 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15948de640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1590112940 con 0x7f15901031c0 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15948de640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1590112c40 con 0x7f1590108600 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1590108f50 0x7f159019ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1590108f50 0x7f159019ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57614/0 (socket says 172.21.15.81:57614) 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 -- 172.21.15.81:0/971699395 learned_addr learned my addr 172.21.15.81:0/971699395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158e59c640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15901031c0 0x7f159019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158dd9b640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1590108600 0x7f159019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 -- 172.21.15.81:0/971699395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1590108600 msgr2=0x7f159019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1590108600 0x7f159019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 -- 172.21.15.81:0/971699395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15901031c0 msgr2=0x7f159019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15901031c0 0x7f159019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 -- 172.21.15.81:0/971699395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15901a0630 con 0x7f1590108f50 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f158ed9d640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1590108f50 0x7f159019ff00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f158800eaa0 tx=0x7f158800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:14.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15877fe640 1 -- 172.21.15.81:0/971699395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158800cdb0 con 0x7f1590108f50 2024-09-21T03:03:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15901a0920 con 0x7f1590108f50 2024-09-21T03:03:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15877fe640 1 -- 172.21.15.81:0/971699395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1588005020 con 0x7f1590108f50 2024-09-21T03:03:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15877fe640 1 -- 172.21.15.81:0/971699395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880116d0 con 0x7f1590108f50 2024-09-21T03:03:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.544+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15901a7080 con 0x7f1590108f50 2024-09-21T03:03:14.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.547+0000 7f159ae52740 1 Processor -- start 2024-09-21T03:03:14.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.547+0000 7f15877fe640 1 -- 172.21.15.81:0/971699395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1588004b20 con 0x7f1590108f50 2024-09-21T03:03:14.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.547+0000 7f159ae52740 1 -- start start 2024-09-21T03:03:14.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f159ae52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663e20520 0x5576641c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f159ae52740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f159ae52740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x5576641c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f159ae52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5576640b1dc0 con 0x557663e20520 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f159ae52740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55766413e1f0 con 0x557663df7660 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f159ae52740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55766412d620 con 0x557663dff840 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663e20520 0x5576641c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663e20520 0x5576641c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57630/0 (socket says 172.21.15.81:57630) 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 -- 172.21.15.81:0/3609081602 learned_addr learned my addr 172.21.15.81:0/3609081602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158e59c640 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x5576641c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f15877fe640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f157c0b6510 0x7f157c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 -- 172.21.15.81:0/3609081602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 msgr2=0x5576641c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x5576641c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 -- 172.21.15.81:0/3609081602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 msgr2=0x5576641c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158dd9b640 1 -- 172.21.15.81:0/3609081602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576640f5fd0 con 0x557663e20520 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.548+0000 7f158ed9d640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f157c0b6510 0x7f157c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.549+0000 7f158dd9b640 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663e20520 0x5576641c6510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1578011410 tx=0x7f157800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5a4b58a6a913ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.549+0000 7f15877fe640 1 -- 172.21.15.81:0/971699395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f15880e76c0 con 0x7f1590108f50 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.549+0000 7f1584ff9640 1 -- 172.21.15.81:0/3609081602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578004020 con 0x557663e20520 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.549+0000 7f1584ff9640 1 -- 172.21.15.81:0/3609081602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15780041c0 con 0x557663e20520 2024-09-21T03:03:14.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.549+0000 7f1584ff9640 1 -- 172.21.15.81:0/3609081602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157800f450 con 0x557663e20520 2024-09-21T03:03:14.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 -- 172.21.15.81:0/3609081602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663e20520 msgr2=0x5576641c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f158ed9d640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f157c0b6510 0x7f157c0b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1588004fd0 tx=0x7f158801d680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663e20520 0x5576641c6510 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1578011410 tx=0x7f157800a6e0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 -- 172.21.15.81:0/3609081602 shutdown_connections 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x5576641c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 --2- 172.21.15.81:0/3609081602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663e20520 0x5576641c6510 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 -- 172.21.15.81:0/3609081602 >> 172.21.15.81:0/3609081602 conn(0x557663e14910 msgr2=0x5576641c4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 -- 172.21.15.81:0/3609081602 shutdown_connections 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 -- 172.21.15.81:0/3609081602 wait complete. 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 -- start start 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.550+0000 7f159ae52740 1 Processor -- start 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f159ae52740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f159ae52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663dff840 0x5576641d2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f159ae52740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663e20520 0x5576641d2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f159ae52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5576640c8300 con 0x557663dff840 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f159ae52740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557664131430 con 0x557663df7660 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f159ae52740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557663f8ebb0 con 0x557663e20520 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f159ae52740 10 client.0 _ll_register_callbacks cb 0x5576640e2120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663dff840 0x5576641d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663dff840 0x5576641d2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57638/0 (socket says 172.21.15.81:57638) 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 -- 172.21.15.81:0/1374631797 learned_addr learned my addr 172.21.15.81:0/1374631797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158dd9b640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158dd9b640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663e20520 0x5576641d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 -- 172.21.15.81:0/1374631797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663e20520 msgr2=0x5576641d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663e20520 0x5576641d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 -- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 msgr2=0x5576641d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 -- 172.21.15.81:0/1374631797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576640b7780 con 0x557663dff840 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158dd9b640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663e20520 0x5576641d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:14.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f158e59c640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663dff840 0x5576641d2010 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f158002a930 tx=0x7f1580031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155a1c0348623b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.551+0000 7f1575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f1575ffb640 1 -- 172.21.15.81:0/1374631797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580035040 con 0x557663dff840 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f1575ffb640 1 -- 172.21.15.81:0/1374631797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1580004240 con 0x557663dff840 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15780041c0 con 0x557663dff840 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f1575ffb640 1 -- 172.21.15.81:0/1374631797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1580004440 con 0x557663dff840 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 10 client.15873 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557663e8bb00 con 0x557663dff840 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f1575ffb640 1 -- 172.21.15.81:0/1374631797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15780041c0 con 0x557663dff840 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f1575ffb640 1 -- 172.21.15.81:0/1374631797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1580044020 con 0x557663dff840 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 10 client.15873 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 10 client.15873 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 20 client.15873 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:14.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663ddeea0 0x5576641e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 4 client.15873 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557664140140 con 0x557663ddeea0 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.552+0000 7f158dd9b640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663ddeea0 0x5576641e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.553+0000 7f1575ffb640 10 client.15873 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.553+0000 7f158dd9b640 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663ddeea0 0x5576641e3e50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4087e29e306bc00 server_cookie=fcb99fd98a7856bd in_seq=0 out_seq=0 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f1575ffb640 1 -- 172.21.15.81:0/1374631797 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557664140140 con 0x557663ddeea0 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f1575ffb640 10 client.15873 handle_command_reply: tid=0 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 client.15873 shutdown 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663dff840 msgr2=0x5576641d2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663dff840 0x5576641d2010 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f158002a930 tx=0x7f1580031400 comp rx=0 tx=0).stop 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 shutdown_connections 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663ddeea0 0x5576641e3e50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663e20520 0x5576641d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663dff840 0x5576641d2010 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f1575ffb640 0 client.15873 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 --2- 172.21.15.81:0/1374631797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 >> 172.21.15.81:0/1374631797 conn(0x557663e14910 msgr2=0x5576641c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 shutdown_connections 2024-09-21T03:03:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 1 -- 172.21.15.81:0/1374631797 wait complete. 2024-09-21T03:03:14.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.554+0000 7f159ae52740 20 client.15873 trim_cache size 0 max 16384 2024-09-21T03:03:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 Processor -- start 2024-09-21T03:03:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 -- start start 2024-09-21T03:03:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x5576641cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15901b3250 con 0x557663ddeea0 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f15901b0b20 con 0x557663df7660 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.572+0000 7f159ae52740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15901ae970 con 0x557663dff840 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57652/0 (socket says 172.21.15.81:57652) 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 -- 172.21.15.81:0/726043986 learned_addr learned my addr 172.21.15.81:0/726043986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158e59c640 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 -- 172.21.15.81:0/726043986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 msgr2=0x5576641cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x5576641cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 -- 172.21.15.81:0/726043986 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 msgr2=0x5576641cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 -- 172.21.15.81:0/726043986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557663f02960 con 0x557663ddeea0 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158e59c640 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f158dd9b640 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d39b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1578011d60 tx=0x7f1578003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3aa9a3d9c7c837 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f1577fff640 1 -- 172.21.15.81:0/726043986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578003940 con 0x557663ddeea0 2024-09-21T03:03:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f1577fff640 1 -- 172.21.15.81:0/726043986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15780054c0 con 0x557663ddeea0 2024-09-21T03:03:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.573+0000 7f1577fff640 1 -- 172.21.15.81:0/726043986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578004d00 con 0x557663ddeea0 2024-09-21T03:03:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 -- 172.21.15.81:0/726043986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 msgr2=0x5576641d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d39b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1578011d60 tx=0x7f1578003b20 comp rx=0 tx=0).stop 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 -- 172.21.15.81:0/726043986 shutdown_connections 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x5576641cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 --2- 172.21.15.81:0/726043986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d39b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 -- 172.21.15.81:0/726043986 >> 172.21.15.81:0/726043986 conn(0x557663e14910 msgr2=0x5576641c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 -- 172.21.15.81:0/726043986 shutdown_connections 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 -- 172.21.15.81:0/726043986 wait complete. 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.574+0000 7f159ae52740 1 -- start start 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 1 Processor -- start 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x55766424d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15901aefe0 con 0x557663ddeea0 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f15901b0450 con 0x557663df7660 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f15901af6b0 con 0x557663dff840 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f159ae52740 10 client.0 _ll_register_callbacks cb 0x7f1580031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57658/0 (socket says 172.21.15.81:57658) 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 -- 172.21.15.81:0/983731232 learned_addr learned my addr 172.21.15.81:0/983731232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158e59c640 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x55766424d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 -- 172.21.15.81:0/983731232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 msgr2=0x55766424d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x55766424d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 -- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 msgr2=0x5576641d8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 -- 172.21.15.81:0/983731232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55766424dd60 con 0x557663ddeea0 2024-09-21T03:03:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f158dd9b640 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d8530 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1578003af0 tx=0x7f157800ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d121efacd181716 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.575+0000 7f1575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f1575ffb640 1 -- 172.21.15.81:0/983731232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578003dc0 con 0x557663ddeea0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f1575ffb640 1 -- 172.21.15.81:0/983731232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1578003f60 con 0x557663ddeea0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15780054c0 con 0x557663ddeea0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f1575ffb640 1 -- 172.21.15.81:0/983731232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1578004160 con 0x557663ddeea0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f159ae52740 10 client.15879 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55766424ef90 con 0x557663ddeea0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f1575ffb640 1 -- 172.21.15.81:0/983731232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15780054c0 con 0x557663ddeea0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f1575ffb640 1 -- 172.21.15.81:0/983731232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1578030070 con 0x557663ddeea0 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f159ae52740 10 client.15879 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f159ae52740 10 client.15879 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.576+0000 7f159ae52740 20 client.15879 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.577+0000 7f159ae52740 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663e20520 0x557664251530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.577+0000 7f159ae52740 4 client.15879 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3e95b8e9", "release": true, "await": true}] 2024-09-21T03:03:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.577+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3e95b8e9", "release": true, "await": true}) -- 0x55766413bbf0 con 0x557663e20520 2024-09-21T03:03:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.577+0000 7f158e59c640 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663e20520 0x557664251530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.577+0000 7f1575ffb640 10 client.15879 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.577+0000 7f158e59c640 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663e20520 0x557664251530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9076afa6fe339b00 server_cookie=d82136917889a8be in_seq=0 out_seq=0 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f1575ffb640 1 -- 172.21.15.81:0/983731232 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55766413bbf0 con 0x557663e20520 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f1575ffb640 10 client.15879 handle_command_reply: tid=0 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 client.15879 shutdown 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 msgr2=0x5576641d8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d8530 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1578003af0 tx=0x7f157800ae50 comp rx=0 tx=0).stop 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 shutdown_connections 2024-09-21T03:03:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557663e20520 0x557664251530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557663dff840 0x55766424d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f1575ffb640 0 client.15879 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557663df7660 0x5576641d8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.580+0000 7f159ae52740 1 --2- 172.21.15.81:0/983731232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557663ddeea0 0x5576641d8530 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 >> 172.21.15.81:0/983731232 conn(0x557663e14910 msgr2=0x5576641c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 shutdown_connections 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f159ae52740 1 -- 172.21.15.81:0/983731232 wait complete. 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f159ae52740 20 client.15879 trim_cache size 0 max 16384 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 26, 2024-09-21T03:03:14.584 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 12, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "3e95b8e9": { 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 12, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 147.8, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:03:14.585 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:14.586 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f157c0b6510 msgr2=0x7f157c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f157c0b6510 0x7f157c0b8a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1588004fd0 tx=0x7f158801d680 comp rx=0 tx=0).stop 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1590108f50 msgr2=0x7f159019ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1590108f50 0x7f159019ff00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f158800eaa0 tx=0x7f158800ef60 comp rx=0 tx=0).stop 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 shutdown_connections 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f157c0b6510 0x7f157c0b8a20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1590108600 0x7f159019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1590108f50 0x7f159019ff00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 --2- 172.21.15.81:0/971699395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15901031c0 0x7f159019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.581+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 >> 172.21.15.81:0/971699395 conn(0x7f1590079e30 msgr2=0x7f15901013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.582+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 shutdown_connections 2024-09-21T03:03:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:14.582+0000 7f15948de640 1 -- 172.21.15.81:0/971699395 wait complete. 2024-09-21T03:03:15.796 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:15 smithi081 ceph-mon[30991]: pgmap v445: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:03:15.826 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3e95b8e9', total seconds elapsed: 31.7 2024-09-21T03:03:15.827 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T03:03:15.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:03:15.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:15 smithi164 ceph-mon[34236]: pgmap v445: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:03:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:15 smithi181 ceph-mon[34096]: pgmap v445: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:03:16.075 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:03:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 -- 172.21.15.81:0/765429267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 msgr2=0x7efdec103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 --2- 172.21.15.81:0/765429267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec103550 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efde8009900 tx=0x7efde802a410 comp rx=0 tx=0).stop 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 -- 172.21.15.81:0/765429267 shutdown_connections 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 --2- 172.21.15.81:0/765429267 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdec108d00 0x7efdec10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 --2- 172.21.15.81:0/765429267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdec1083b0 0x7efdec1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 --2- 172.21.15.81:0/765429267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec103550 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 -- 172.21.15.81:0/765429267 >> 172.21.15.81:0/765429267 conn(0x7efdec077c60 msgr2=0x7efdec0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 -- 172.21.15.81:0/765429267 shutdown_connections 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.556+0000 7efdf42fe640 1 -- 172.21.15.81:0/765429267 wait complete. 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 Processor -- start 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 -- start start 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdec1083b0 0x7efdec199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdec108d00 0x7efdec19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efdec112870 con 0x7efdec103140 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1126f0 con 0x7efdec108d00 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.557+0000 7efdf42fe640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1129f0 con 0x7efdec1083b0 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57676/0 (socket says 172.21.15.81:57676) 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 -- 172.21.15.81:0/2905523679 learned_addr learned my addr 172.21.15.81:0/2905523679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf1899640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdec1083b0 0x7efdec199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf289b640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdec108d00 0x7efdec19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 -- 172.21.15.81:0/2905523679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdec1083b0 msgr2=0x7efdec199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdec1083b0 0x7efdec199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 -- 172.21.15.81:0/2905523679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdec108d00 msgr2=0x7efdec19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdec108d00 0x7efdec19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 -- 172.21.15.81:0/2905523679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec19f190 con 0x7efdec103140 2024-09-21T03:03:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf209a640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec1992e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efde8009a20 tx=0x7efde8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efde37fe640 1 -- 172.21.15.81:0/2905523679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8035050 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efde37fe640 1 -- 172.21.15.81:0/2905523679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efde80035f0 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdec19f420 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efde37fe640 1 -- 172.21.15.81:0/2905523679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8032260 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.558+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdec19f8a0 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.559+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdec103550 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.562+0000 7efde37fe640 1 -- 172.21.15.81:0/2905523679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7efde8048060 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.563+0000 7efde37fe640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efdd80b6540 0x7efdd80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.563+0000 7efdf1899640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efdd80b6540 0x7efdd80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.563+0000 7efde37fe640 1 -- 172.21.15.81:0/2905523679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7efde8109350 con 0x7efdec103140 2024-09-21T03:03:16.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.563+0000 7efdf1899640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efdd80b6540 0x7efdd80b8a50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efdec105480 tx=0x7efddc00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:16.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.565+0000 7efde37fe640 1 -- 172.21.15.81:0/2905523679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efde80cf8a0 con 0x7efdec103140 2024-09-21T03:03:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.791+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdec10a6e0 con 0x7efdec103140 2024-09-21T03:03:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.792+0000 7efde37fe640 1 -- 172.21.15.81:0/2905523679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11925 (secure 0 0 0) 0x7efde80f2090 con 0x7efdec103140 2024-09-21T03:03:16.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:03:16.794 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-21T03:02:50:539320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:02:50.244254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T03:03:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-21T03:03:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efdd80b6540 msgr2=0x7efdd80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efdd80b6540 0x7efdd80b8a50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efdec105480 tx=0x7efddc00a4c0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 msgr2=0x7efdec1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec1992e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efde8009a20 tx=0x7efde8004270 comp rx=0 tx=0).stop 2024-09-21T03:03:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 shutdown_connections 2024-09-21T03:03:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efdd80b6540 0x7efdd80b8a50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efdec1083b0 0x7efdec199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efdec108d00 0x7efdec19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 --2- 172.21.15.81:0/2905523679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdec103140 0x7efdec1992e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.794+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 >> 172.21.15.81:0/2905523679 conn(0x7efdec077c60 msgr2=0x7efdec106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.795+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 shutdown_connections 2024-09-21T03:03:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:16.795+0000 7efdf42fe640 1 -- 172.21.15.81:0/2905523679 wait complete. 2024-09-21T03:03:17.148 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:03:17.148 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:03:17.148 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:03:17.148 INFO:tasks.workunit.client.0.smithi081.stdout:iozone test complete. 2024-09-21T03:03:17.149 INFO:tasks.workunit.client.0.smithi081.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-21T03:03:17.228 INFO:tasks.workunit.client.0.smithi081.stdout: Iozone: Performance Test of File I/O 2024-09-21T03:03:17.228 INFO:tasks.workunit.client.0.smithi081.stdout: Version $Revision: 3.494 $ 2024-09-21T03:03:17.228 INFO:tasks.workunit.client.0.smithi081.stdout: Compiled for 64 bit mode. 2024-09-21T03:03:17.228 INFO:tasks.workunit.client.0.smithi081.stdout: Build: linux-AMD64 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Run began: Sat Sep 21 03:03:17 2024 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Include close in write timing 2024-09-21T03:03:17.229 INFO:tasks.workunit.client.0.smithi081.stdout: Include fsync in write timing 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: File size set to 10485760 kB 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Record Size 1024 kB 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Output is in kBytes/sec 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Processor cache line size set to 32 bytes. 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: File stride size set to 17 * record size. 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Throughput test with 1 process 2024-09-21T03:03:17.230 INFO:tasks.workunit.client.0.smithi081.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-21T03:03:17.758 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:17 smithi081 ceph-mon[30991]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:03:17.758 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:17 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2905523679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:17.826 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T03:03:17.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T03:03:17.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:17 smithi164 ceph-mon[34236]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:03:17.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:17 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2905523679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:17.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:17 smithi181 ceph-mon[34096]: pgmap v446: 129 pgs: 129 active+clean; 1.0 GiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:03:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:17 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2905523679' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:18.253 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:03:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.869+0000 7f1925928640 1 -- 172.21.15.81:0/3910939785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19201027a0 msgr2=0x7f1920102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.869+0000 7f1925928640 1 --2- 172.21.15.81:0/3910939785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19201027a0 0x7f1920102bb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1910009900 tx=0x7f191002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.870+0000 7f1925928640 1 -- 172.21.15.81:0/3910939785 shutdown_connections 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.870+0000 7f1925928640 1 --2- 172.21.15.81:0/3910939785 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19201030f0 0x7f1920107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.870+0000 7f1925928640 1 --2- 172.21.15.81:0/3910939785 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1920107be0 0x7f19201080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.870+0000 7f1925928640 1 --2- 172.21.15.81:0/3910939785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19201027a0 0x7f1920102bb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.870+0000 7f1925928640 1 -- 172.21.15.81:0/3910939785 >> 172.21.15.81:0/3910939785 conn(0x7f1920079760 msgr2=0x7f1920079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.870+0000 7f1925928640 1 -- 172.21.15.81:0/3910939785 shutdown_connections 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.870+0000 7f1925928640 1 -- 172.21.15.81:0/3910939785 wait complete. 2024-09-21T03:03:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 Processor -- start 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 -- start start 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19201027a0 0x7f19201a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19201030f0 0x7f19201a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1920107be0 0x7f19201a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1920119fc0 con 0x7f1920107be0 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1920119e40 con 0x7f19201030f0 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.871+0000 7f1925928640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f192011a140 con 0x7f19201027a0 2024-09-21T03:03:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.872+0000 7f191e7fc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19201030f0 0x7f19201a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.872+0000 7f191e7fc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19201030f0 0x7f19201a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:49760/0 (socket says 172.21.15.81:49760) 2024-09-21T03:03:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.872+0000 7f191e7fc640 1 -- 172.21.15.81:0/2912038396 learned_addr learned my addr 172.21.15.81:0/2912038396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.872+0000 7f191f7fe640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1920107be0 0x7f19201a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.873+0000 7f191e7fc640 1 -- 172.21.15.81:0/2912038396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19201027a0 msgr2=0x7f19201a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.873+0000 7f191e7fc640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19201027a0 0x7f19201a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.873+0000 7f191e7fc640 1 -- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1920107be0 msgr2=0x7f19201a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.873+0000 7f191e7fc640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1920107be0 0x7f19201a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.873+0000 7f191e7fc640 1 -- 172.21.15.81:0/2912038396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19201a68e0 con 0x7f19201030f0 2024-09-21T03:03:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.874+0000 7f191e7fc640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19201030f0 0x7f19201a0fd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f191400c970 tx=0x7f191400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.874+0000 7f1924926640 1 -- 172.21.15.81:0/2912038396 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914004220 con 0x7f19201030f0 2024-09-21T03:03:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.874+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19201a6bd0 con 0x7f19201030f0 2024-09-21T03:03:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.874+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19201ad3f0 con 0x7f19201030f0 2024-09-21T03:03:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.875+0000 7f1924926640 1 -- 172.21.15.81:0/2912038396 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1914007e40 con 0x7f19201030f0 2024-09-21T03:03:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.875+0000 7f1924926640 1 -- 172.21.15.81:0/2912038396 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19140047a0 con 0x7f19201030f0 2024-09-21T03:03:18.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.878+0000 7f192be9c740 1 Processor -- start 2024-09-21T03:03:18.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.879+0000 7f192be9c740 1 -- start start 2024-09-21T03:03:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.879+0000 7f1924926640 1 -- 172.21.15.81:0/2912038396 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f19140079b0 con 0x7f19201030f0 2024-09-21T03:03:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f192be9c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560922484840 0x56092282b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f192be9c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56092245b980 0x56092282bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f192be9c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092282c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f192be9c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609227a1b90 con 0x560922484840 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f192be9c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560922790fc0 con 0x560922463b60 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f192be9c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560922794dd0 con 0x56092245b980 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560922484840 0x56092282b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560922484840 0x56092282b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57708/0 (socket says 172.21.15.81:57708) 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 -- 172.21.15.81:0/1304032179 learned_addr learned my addr 172.21.15.81:0/1304032179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191effd640 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56092245b980 0x56092282bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191e7fc640 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092282c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 -- 172.21.15.81:0/1304032179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56092245b980 msgr2=0x56092282bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56092245b980 0x56092282bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 -- 172.21.15.81:0/1304032179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 msgr2=0x56092282c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092282c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.880+0000 7f191f7fe640 1 -- 172.21.15.81:0/1304032179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560922718060 con 0x560922484840 2024-09-21T03:03:18.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.881+0000 7f191f7fe640 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560922484840 0x56092282b600 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1918007f40 tx=0x7f191800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80725363a1f23bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.881+0000 7f1924926640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19080b65c0 0x7f19080b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.881+0000 7f1905ffb640 1 -- 172.21.15.81:0/1304032179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918010900 con 0x560922484840 2024-09-21T03:03:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.881+0000 7f1905ffb640 1 -- 172.21.15.81:0/1304032179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19180183f0 con 0x560922484840 2024-09-21T03:03:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.881+0000 7f1905ffb640 1 -- 172.21.15.81:0/1304032179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918010900 con 0x560922484840 2024-09-21T03:03:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.881+0000 7f191effd640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19080b65c0 0x7f19080b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.881+0000 7f1924926640 1 -- 172.21.15.81:0/2912038396 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f19140e7040 con 0x7f19201030f0 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 -- 172.21.15.81:0/1304032179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560922484840 msgr2=0x56092282b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560922484840 0x56092282b600 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1918007f40 tx=0x7f191800f850 comp rx=0 tx=0).stop 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 -- 172.21.15.81:0/1304032179 shutdown_connections 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56092245b980 0x56092282bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092282c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 --2- 172.21.15.81:0/1304032179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560922484840 0x56092282b600 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 -- 172.21.15.81:0/1304032179 >> 172.21.15.81:0/1304032179 conn(0x560922478990 msgr2=0x5609228294f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 -- 172.21.15.81:0/1304032179 shutdown_connections 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.882+0000 7f192be9c740 1 -- 172.21.15.81:0/1304032179 wait complete. 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.883+0000 7f192be9c740 1 -- start start 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.883+0000 7f191effd640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19080b65c0 0x7f19080b8ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f19100057c0 tx=0x7f1910000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.883+0000 7f192be9c740 1 Processor -- start 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.883+0000 7f192be9c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x560922837130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.883+0000 7f192be9c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922837670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f192be9c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922484840 0x560922843130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f192be9c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5609225f27a0 con 0x56092245b980 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f192be9c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5609227360a0 con 0x560922484840 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f192be9c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x560922839de0 con 0x560922463b60 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x560922837130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f192be9c740 10 client.0 _ll_register_callbacks cb 0x5609227133c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x560922837130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57722/0 (socket says 172.21.15.81:57722) 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 -- 172.21.15.81:0/2169776518 learned_addr learned my addr 172.21.15.81:0/2169776518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191f7fe640 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922484840 0x560922843130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 -- 172.21.15.81:0/2169776518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 msgr2=0x560922837670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922837670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 -- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922484840 msgr2=0x560922843130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922484840 0x560922843130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 -- 172.21.15.81:0/2169776518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560922724880 con 0x56092245b980 2024-09-21T03:03:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f191effd640 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x560922837130 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1910033000 tx=0x7f1910005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50b0d12dce4f554 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.884+0000 7f18feffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f18feffd640 1 -- 172.21.15.81:0/2169776518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191004d020 con 0x56092245b980 2024-09-21T03:03:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f18feffd640 1 -- 172.21.15.81:0/2169776518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1910049680 con 0x56092245b980 2024-09-21T03:03:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19180183f0 con 0x56092245b980 2024-09-21T03:03:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f18feffd640 1 -- 172.21.15.81:0/2169776518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1910058050 con 0x56092245b980 2024-09-21T03:03:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f192be9c740 10 client.15897 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5609224feb90 con 0x56092245b980 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f18feffd640 1 -- 172.21.15.81:0/2169776518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19180183f0 con 0x56092245b980 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.885+0000 7f18feffd640 1 -- 172.21.15.81:0/2169776518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f191003c7b0 con 0x56092245b980 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.886+0000 7f192be9c740 10 client.15897 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.886+0000 7f192be9c740 10 client.15897 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.886+0000 7f192be9c740 20 client.15897 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.886+0000 7f192be9c740 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5609224431c0 0x5609228492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.886+0000 7f192be9c740 4 client.15897 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.886+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609227a3ae0 con 0x5609224431c0 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.886+0000 7f191e7fc640 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5609224431c0 0x5609228492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.887+0000 7f18feffd640 10 client.15897 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.887+0000 7f191e7fc640 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5609224431c0 0x5609228492b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=585f7fb6e9f6f125 server_cookie=9db8efd6ba32c67a in_seq=0 out_seq=0 2024-09-21T03:03:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.888+0000 7f18feffd640 1 -- 172.21.15.81:0/2169776518 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1914086e50 con 0x5609224431c0 2024-09-21T03:03:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.888+0000 7f18feffd640 10 client.15897 handle_command_reply: tid=0 2024-09-21T03:03:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 client.15897 shutdown 2024-09-21T03:03:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 msgr2=0x560922837130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x560922837130 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1910033000 tx=0x7f1910005fd0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 shutdown_connections 2024-09-21T03:03:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5609224431c0 0x5609228492b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f18feffd640 0 client.15897 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922837670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922484840 0x560922843130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 --2- 172.21.15.81:0/2169776518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x560922837130 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.889+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 >> 172.21.15.81:0/2169776518 conn(0x560922478990 msgr2=0x56092282e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.890+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 shutdown_connections 2024-09-21T03:03:18.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.890+0000 7f192be9c740 1 -- 172.21.15.81:0/2169776518 wait complete. 2024-09-21T03:03:18.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.890+0000 7f192be9c740 20 client.15897 trim_cache size 0 max 16384 2024-09-21T03:03:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 Processor -- start 2024-09-21T03:03:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 -- start start 2024-09-21T03:03:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609224431c0 0x56092282cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56092245b980 0x560922843030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922843570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f190c012310 con 0x5609224431c0 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f190c00fbe0 con 0x56092245b980 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f192be9c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f190c00da30 con 0x560922463b60 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f191effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609224431c0 0x56092282cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f191effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609224431c0 0x56092282cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57730/0 (socket says 172.21.15.81:57730) 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.918+0000 7f191effd640 1 -- 172.21.15.81:0/1375522289 learned_addr learned my addr 172.21.15.81:0/1375522289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191f7fe640 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922843570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191effd640 1 -- 172.21.15.81:0/1375522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 msgr2=0x560922843570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191effd640 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922843570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191effd640 1 -- 172.21.15.81:0/1375522289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56092245b980 msgr2=0x560922843030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191effd640 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56092245b980 0x560922843030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191effd640 1 -- 172.21.15.81:0/1375522289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56092282db20 con 0x5609224431c0 2024-09-21T03:03:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191f7fe640 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922843570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.919+0000 7f191effd640 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609224431c0 0x56092282cff0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f191003cd60 tx=0x7f1910003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271a40e5bccda34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.920+0000 7f19057fa640 1 -- 172.21.15.81:0/1375522289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191004d070 con 0x5609224431c0 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.920+0000 7f19057fa640 1 -- 172.21.15.81:0/1375522289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f191003c8d0 con 0x5609224431c0 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.920+0000 7f19057fa640 1 -- 172.21.15.81:0/1375522289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910035040 con 0x5609224431c0 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 -- 172.21.15.81:0/1375522289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609224431c0 msgr2=0x56092282cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609224431c0 0x56092282cff0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f191003cd60 tx=0x7f1910003ed0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 -- 172.21.15.81:0/1375522289 shutdown_connections 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560922463b60 0x560922843570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56092245b980 0x560922843030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 --2- 172.21.15.81:0/1375522289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5609224431c0 0x56092282cff0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 -- 172.21.15.81:0/1375522289 >> 172.21.15.81:0/1375522289 conn(0x560922478990 msgr2=0x56092282efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 -- 172.21.15.81:0/1375522289 shutdown_connections 2024-09-21T03:03:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.921+0000 7f192be9c740 1 -- 172.21.15.81:0/1375522289 wait complete. 2024-09-21T03:03:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.922+0000 7f192be9c740 1 -- start start 2024-09-21T03:03:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.922+0000 7f192be9c740 1 Processor -- start 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f192be9c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609224431c0 0x56092283c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f192be9c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x56092283c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f192be9c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092283cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f192be9c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f190c00e0a0 con 0x56092245b980 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f192be9c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f190c00f510 con 0x560922463b60 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f192be9c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f190c00e770 con 0x5609224431c0 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f192be9c740 10 client.0 _ll_register_callbacks cb 0x7f1910040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f191e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x56092283c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f191e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x56092283c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57740/0 (socket says 172.21.15.81:57740) 2024-09-21T03:03:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f191e7fc640 1 -- 172.21.15.81:0/3458928907 learned_addr learned my addr 172.21.15.81:0/3458928907 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f191effd640 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609224431c0 0x56092283c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f191f7fe640 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092283cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f191e7fc640 1 -- 172.21.15.81:0/3458928907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609224431c0 msgr2=0x56092283c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.923+0000 7f191e7fc640 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609224431c0 0x56092283c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.924+0000 7f191e7fc640 1 -- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 msgr2=0x56092283cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.924+0000 7f191e7fc640 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092283cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.924+0000 7f191e7fc640 1 -- 172.21.15.81:0/3458928907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609228b3cc0 con 0x56092245b980 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.924+0000 7f191e7fc640 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x56092283c5c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f191400c940 tx=0x7f19140e7240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb98619dd42cfe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.924+0000 7f18feffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.925+0000 7f18feffd640 1 -- 172.21.15.81:0/3458928907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191401d040 con 0x56092245b980 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.925+0000 7f18feffd640 1 -- 172.21.15.81:0/3458928907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f19140a9100 con 0x56092245b980 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.925+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191003c8d0 con 0x56092245b980 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.925+0000 7f18feffd640 1 -- 172.21.15.81:0/3458928907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f19140ac600 con 0x56092245b980 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.925+0000 7f192be9c740 10 client.15903 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.925+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5609228b4ef0 con 0x56092245b980 2024-09-21T03:03:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f18feffd640 1 -- 172.21.15.81:0/3458928907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f191003c8d0 con 0x56092245b980 2024-09-21T03:03:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f18feffd640 1 -- 172.21.15.81:0/3458928907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f19140b1020 con 0x56092245b980 2024-09-21T03:03:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f192be9c740 10 client.15903 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f192be9c740 10 client.15903 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:03:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f192be9c740 20 client.15903 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f192be9c740 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560922484840 0x5609228b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f192be9c740 4 client.15903 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T03:03:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.926+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x56092279f590 con 0x560922484840 2024-09-21T03:03:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.927+0000 7f191effd640 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560922484840 0x5609228b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.928+0000 7f18feffd640 10 client.15903 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.928+0000 7f191effd640 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560922484840 0x5609228b76b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d26829881f825e9 server_cookie=8f48a57997af6023 in_seq=0 out_seq=0 2024-09-21T03:03:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f18feffd640 1 -- 172.21.15.81:0/3458928907 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56092279f590 con 0x560922484840 2024-09-21T03:03:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f18feffd640 10 client.15903 handle_command_reply: tid=0 2024-09-21T03:03:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 client.15903 shutdown 2024-09-21T03:03:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 msgr2=0x56092283c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x56092283c5c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f191400c940 tx=0x7f19140e7240 comp rx=0 tx=0).stop 2024-09-21T03:03:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 shutdown_connections 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x560922484840 0x5609228b76b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560922463b60 0x56092283cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56092245b980 0x56092283c5c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 --2- 172.21.15.81:0/3458928907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5609224431c0 0x56092283c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.945+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 >> 172.21.15.81:0/3458928907 conn(0x560922478990 msgr2=0x5609228383b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f18feffd640 0 client.15903 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 shutdown_connections 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f192be9c740 1 -- 172.21.15.81:0/3458928907 wait complete. 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f192be9c740 20 client.15903 trim_cache size 0 max 16384 2024-09-21T03:03:18.948 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 26, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 14, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "86c63001": { 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 14, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 147.8, 2024-09-21T03:03:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:18.950 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19080b65c0 msgr2=0x7f19080b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19080b65c0 0x7f19080b8ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f19100057c0 tx=0x7f1910000bc0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19201030f0 msgr2=0x7f19201a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19201030f0 0x7f19201a0fd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f191400c970 tx=0x7f191400ce30 comp rx=0 tx=0).stop 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 shutdown_connections 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f19080b65c0 0x7f19080b8ad0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1920107be0 0x7f19201a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19201030f0 0x7f19201a0fd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 --2- 172.21.15.81:0/2912038396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19201027a0 0x7f19201a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.946+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 >> 172.21.15.81:0/2912038396 conn(0x7f1920079760 msgr2=0x7f19201055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.947+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 shutdown_connections 2024-09-21T03:03:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:18.947+0000 7f1925928640 1 -- 172.21.15.81:0/2912038396 wait complete. 2024-09-21T03:03:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:19 smithi081 ceph-mon[30991]: pgmap v447: 129 pgs: 129 active+clean; 1001 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:03:19.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:19 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:03:19.845 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '86c63001', quiesce took 4.0 seconds. Will release after: 23.8 2024-09-21T03:03:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:19 smithi164 ceph-mon[34236]: pgmap v447: 129 pgs: 129 active+clean; 1001 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:03:19.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:19 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:03:19.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:19 smithi181 ceph-mon[34096]: pgmap v447: 129 pgs: 129 active+clean; 1001 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:03:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:19 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:03:20.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:03:20.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:03:20.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:03:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:03:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:03:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:03:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:03:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:03:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:03:21.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:21 smithi164 ceph-mon[34236]: pgmap v448: 129 pgs: 129 active+clean; 941 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-09-21T03:03:21.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:21 smithi181 ceph-mon[34096]: pgmap v448: 129 pgs: 129 active+clean; 941 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-09-21T03:03:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:21 smithi081 ceph-mon[30991]: pgmap v448: 129 pgs: 129 active+clean; 941 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 29 MiB/s wr, 23 op/s 2024-09-21T03:03:23.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:23 smithi164 ceph-mon[34236]: pgmap v449: 129 pgs: 129 active+clean; 901 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 73 MiB/s wr, 48 op/s 2024-09-21T03:03:23.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:23 smithi181 ceph-mon[34096]: pgmap v449: 129 pgs: 129 active+clean; 901 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 73 MiB/s wr, 48 op/s 2024-09-21T03:03:24.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:23 smithi081 ceph-mon[30991]: pgmap v449: 129 pgs: 129 active+clean; 901 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 73 MiB/s wr, 48 op/s 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 -- 172.21.15.81:0/3589923917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 msgr2=0x7f1f7c103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/3589923917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c103b40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009900 tx=0x7f1f6c02a410 comp rx=0 tx=0).stop 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 -- 172.21.15.81:0/3589923917 shutdown_connections 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/3589923917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f7c1050f0 0x7f1f7c10ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/3589923917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f7c104750 0x7f1f7c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/3589923917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c103b40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 -- 172.21.15.81:0/3589923917 >> 172.21.15.81:0/3589923917 conn(0x7f1f7c0ff030 msgr2=0x7f1f7c1014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 -- 172.21.15.81:0/3589923917 shutdown_connections 2024-09-21T03:03:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.434+0000 7f1f82cbd640 1 -- 172.21.15.81:0/3589923917 wait complete. 2024-09-21T03:03:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 Processor -- start 2024-09-21T03:03:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 -- start start 2024-09-21T03:03:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f7c104750 0x7f1f7c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f7c1050f0 0x7f1f7c19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c10f1c0 con 0x7f1f7c1036d0 2024-09-21T03:03:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c10f040 con 0x7f1f7c104750 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f82cbd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c10f340 con 0x7f1f7c1050f0 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55166/0 (socket says 172.21.15.81:55166) 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 -- 172.21.15.81:0/1345099770 learned_addr learned my addr 172.21.15.81:0/1345099770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f7c104750 0x7f1f7c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f8125a640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f7c1050f0 0x7f1f7c19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 -- 172.21.15.81:0/1345099770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f7c1050f0 msgr2=0x7f1f7c19b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f7c1050f0 0x7f1f7c19b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 -- 172.21.15.81:0/1345099770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f7c104750 msgr2=0x7f1f7c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f7c104750 0x7f1f7c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 -- 172.21.15.81:0/1345099770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c19b8c0 con 0x7f1f7c1036d0 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.435+0000 7f1f80a59640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c199e80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009230 tx=0x7f1f6c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.436+0000 7f1f79ffb640 1 -- 172.21.15.81:0/1345099770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c03f030 con 0x7f1f7c1036d0 2024-09-21T03:03:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.436+0000 7f1f79ffb640 1 -- 172.21.15.81:0/1345099770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f6c004440 con 0x7f1f7c1036d0 2024-09-21T03:03:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.436+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c19bb50 con 0x7f1f7c1036d0 2024-09-21T03:03:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.436+0000 7f1f79ffb640 1 -- 172.21.15.81:0/1345099770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c035070 con 0x7f1f7c1036d0 2024-09-21T03:03:24.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.436+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c1a22a0 con 0x7f1f7c1036d0 2024-09-21T03:03:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.438+0000 7f1f89c2d740 1 Processor -- start 2024-09-21T03:03:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.438+0000 7f1f79ffb640 1 -- 172.21.15.81:0/1345099770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1f6c042030 con 0x7f1f7c1036d0 2024-09-21T03:03:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.438+0000 7f1f89c2d740 1 -- start start 2024-09-21T03:03:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b13e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b144c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 0x55bc47b15010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc47a866f0 con 0x55bc4776c1b0 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bc47a75b20 con 0x55bc4774b4d0 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bc47a79930 con 0x55bc477432f0 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b13e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b13e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55170/0 (socket says 172.21.15.81:55170) 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 -- 172.21.15.81:0/164963516 learned_addr learned my addr 172.21.15.81:0/164963516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f80a59640 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 -- 172.21.15.81:0/164963516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 msgr2=0x55bc47b144c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b144c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 -- 172.21.15.81:0/164963516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 msgr2=0x55bc47b15010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 0x55bc47b15010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 -- 172.21.15.81:0/164963516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc47a3b530 con 0x55bc4776c1b0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f79ffb640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f640b6590 0x7f1f640b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f8125a640 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b13e50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009fc0 tx=0x7f1f74010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c9b058ed8ce7dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.439+0000 7f1f80a59640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f640b6590 0x7f1f640b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.440+0000 7f1f62ffd640 1 -- 172.21.15.81:0/164963516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74003b70 con 0x55bc4776c1b0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.440+0000 7f1f79ffb640 1 -- 172.21.15.81:0/1345099770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1f6c107b70 con 0x7f1f7c1036d0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.440+0000 7f1f62ffd640 1 -- 172.21.15.81:0/164963516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f74003d10 con 0x55bc4776c1b0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.440+0000 7f1f62ffd640 1 -- 172.21.15.81:0/164963516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74011920 con 0x55bc4776c1b0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 -- 172.21.15.81:0/164963516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 msgr2=0x55bc47b13e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f80a59640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f640b6590 0x7f1f640b8aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c005760 tx=0x7f1f6c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b13e50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009fc0 tx=0x7f1f74010860 comp rx=0 tx=0).stop 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 -- 172.21.15.81:0/164963516 shutdown_connections 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b144c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 0x55bc47b15010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/164963516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b13e50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 -- 172.21.15.81:0/164963516 >> 172.21.15.81:0/164963516 conn(0x55bc47760300 msgr2=0x55bc47b0f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 -- 172.21.15.81:0/164963516 shutdown_connections 2024-09-21T03:03:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 -- 172.21.15.81:0/164963516 wait complete. 2024-09-21T03:03:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 -- start start 2024-09-21T03:03:24.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.441+0000 7f1f89c2d740 1 Processor -- start 2024-09-21T03:03:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 0x55bc47b1dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b1e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc479adab0 con 0x55bc4776c1b0 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bc47a1b730 con 0x55bc4774b4d0 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bc47b15b30 con 0x55bc477432f0 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 10 client.0 _ll_register_callbacks cb 0x55bc47a6f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b1e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b1e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55182/0 (socket says 172.21.15.81:55182) 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 -- 172.21.15.81:0/1937030679 learned_addr learned my addr 172.21.15.81:0/1937030679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 0x55bc47b1dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 -- 172.21.15.81:0/1937030679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 msgr2=0x55bc47b1d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 -- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 msgr2=0x55bc47b1dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 0x55bc47b1dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 -- 172.21.15.81:0/1937030679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc477d7790 con 0x55bc4776c1b0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f8125a640 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b1e860 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009dd0 tx=0x7f1f74010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964795e29266a0aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f5bfff640 1 -- 172.21.15.81:0/1937030679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7401f030 con 0x55bc4776c1b0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f5bfff640 1 -- 172.21.15.81:0/1937030679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1f74024070 con 0x55bc4776c1b0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f74003d10 con 0x55bc4776c1b0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.442+0000 7f1f5bfff640 1 -- 172.21.15.81:0/1937030679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1f7402f050 con 0x55bc4776c1b0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 10 client.15915 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bc47850620 con 0x55bc4776c1b0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f5bfff640 1 -- 172.21.15.81:0/1937030679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f74003d10 con 0x55bc4776c1b0 2024-09-21T03:03:24.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f5bfff640 1 -- 172.21.15.81:0/1937030679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1f7401b750 con 0x55bc4776c1b0 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 10 client.15915 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 20 client.15915 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc4772ad80 0x55bc47b2aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 4 client.15915 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc47a88640 con 0x55bc4772ad80 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.443+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc4772ad80 0x55bc47b2aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.444+0000 7f1f5bfff640 10 client.15915 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.444+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc4772ad80 0x55bc47b2aba0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a863407576d4ab7 server_cookie=5c635a6a0bfdc601 in_seq=0 out_seq=0 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f5bfff640 1 -- 172.21.15.81:0/1937030679 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc47a88640 con 0x55bc4772ad80 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f5bfff640 10 client.15915 handle_command_reply: tid=0 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 client.15915 shutdown 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 msgr2=0x55bc47b1e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b1e860 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009dd0 tx=0x7f1f74010fd0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 shutdown_connections 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc4772ad80 0x55bc47b2aba0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4776c1b0 0x55bc47b1e860 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4774b4d0 0x55bc47b1dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f5bfff640 0 client.15915 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/1937030679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 >> 172.21.15.81:0/1937030679 conn(0x55bc47760300 msgr2=0x55bc47b0dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 shutdown_connections 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 1 -- 172.21.15.81:0/1937030679 wait complete. 2024-09-21T03:03:24.452 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.445+0000 7f1f89c2d740 20 client.15915 trim_cache size 0 max 16384 2024-09-21T03:03:24.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 Processor -- start 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 -- start start 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b1c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4776c1b0 0x55bc47b13df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1aed50 con 0x55bc4774b4d0 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1ac620 con 0x55bc4776c1b0 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1aa470 con 0x55bc477432f0 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b1c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b1c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55190/0 (socket says 172.21.15.81:55190) 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f7bfff640 1 -- 172.21.15.81:0/2186614510 learned_addr learned my addr 172.21.15.81:0/2186614510 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f7bfff640 1 -- 172.21.15.81:0/2186614510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 msgr2=0x55bc47b1bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:24.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f8125a640 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f7bfff640 1 -- 172.21.15.81:0/2186614510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4776c1b0 msgr2=0x55bc47b13df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.460+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4776c1b0 0x55bc47b13df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.461+0000 7f1f7bfff640 1 -- 172.21.15.81:0/2186614510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc47b1b7c0 con 0x55bc4774b4d0 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.461+0000 7f1f8125a640 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.461+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b1c080 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1f70000c00 tx=0x7f1f70005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f41a85e8225654e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.461+0000 7f1f627fc640 1 -- 172.21.15.81:0/2186614510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7001f070 con 0x55bc4774b4d0 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.461+0000 7f1f627fc640 1 -- 172.21.15.81:0/2186614510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f70004250 con 0x55bc4774b4d0 2024-09-21T03:03:24.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.461+0000 7f1f627fc640 1 -- 172.21.15.81:0/2186614510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7000f6b0 con 0x55bc4774b4d0 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 -- 172.21.15.81:0/2186614510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 msgr2=0x55bc47b1c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b1c080 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1f70000c00 tx=0x7f1f70005f90 comp rx=0 tx=0).stop 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 -- 172.21.15.81:0/2186614510 shutdown_connections 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc4776c1b0 0x55bc47b13df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b1c080 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/2186614510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc477432f0 0x55bc47b1bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 -- 172.21.15.81:0/2186614510 >> 172.21.15.81:0/2186614510 conn(0x55bc47760300 msgr2=0x55bc47b14ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 -- 172.21.15.81:0/2186614510 shutdown_connections 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 -- 172.21.15.81:0/2186614510 wait complete. 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 -- start start 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 Processor -- start 2024-09-21T03:03:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.462+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc477432f0 0x55bc47b24c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b23910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc4776c1b0 0x55bc47b23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1aaae0 con 0x55bc4774b4d0 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1abf50 con 0x55bc477432f0 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1ab1b0 con 0x55bc4776c1b0 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 10 client.0 _ll_register_callbacks cb 0x7f1f74009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b23910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b23910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55204/0 (socket says 172.21.15.81:55204) 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 -- 172.21.15.81:0/3937785066 learned_addr learned my addr 172.21.15.81:0/3937785066 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f8125a640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc4776c1b0 0x55bc47b23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f8125a640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc477432f0 0x55bc47b24c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 -- 172.21.15.81:0/3937785066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc4776c1b0 msgr2=0x55bc47b23e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc4776c1b0 0x55bc47b23e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 -- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc477432f0 msgr2=0x55bc47b24c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc477432f0 0x55bc47b24c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 -- 172.21.15.81:0/3937785066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc47b24390 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f8125a640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc477432f0 0x55bc47b24c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b23910 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1f700099a0 tx=0x7f1f70003b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defaf6fde0f2d4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f5bfff640 1 -- 172.21.15.81:0/3937785066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7001f070 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f5bfff640 1 -- 172.21.15.81:0/3937785066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1f70004400 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f70004250 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f5bfff640 1 -- 172.21.15.81:0/3937785066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1f70036050 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 10 client.15921 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.463+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bc47b231b0 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f5bfff640 1 -- 172.21.15.81:0/3937785066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f70004250 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f5bfff640 1 -- 172.21.15.81:0/3937785066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1f740039f0 con 0x55bc4774b4d0 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f89c2d740 10 client.15921 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:24.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f89c2d740 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f89c2d740 20 client.15921 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc477001c0 0x55bc47b97b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f89c2d740 4 client.15921 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:03:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc47a840f0 con 0x55bc477001c0 2024-09-21T03:03:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.464+0000 7f1f8125a640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc477001c0 0x55bc47b97b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.465+0000 7f1f5bfff640 10 client.15921 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:24.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.465+0000 7f1f8125a640 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc477001c0 0x55bc47b97b50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9597ef447d5d9c4a server_cookie=b9fb4c255a9dff4d in_seq=0 out_seq=0 2024-09-21T03:03:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f5bfff640 1 -- 172.21.15.81:0/3937785066 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc47a840f0 con 0x55bc477001c0 2024-09-21T03:03:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f5bfff640 10 client.15921 handle_command_reply: tid=0 2024-09-21T03:03:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 client.15921 shutdown 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 msgr2=0x55bc47b23910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b23910 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1f700099a0 tx=0x7f1f70003b10 comp rx=0 tx=0).stop 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 shutdown_connections 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bc477001c0 0x55bc47b97b50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bc4776c1b0 0x55bc47b23e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc4774b4d0 0x55bc47b23910 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f5bfff640 0 client.15921 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.475+0000 7f1f89c2d740 1 --2- 172.21.15.81:0/3937785066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bc477432f0 0x55bc47b24c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 >> 172.21.15.81:0/3937785066 conn(0x55bc47760300 msgr2=0x55bc47b1b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 shutdown_connections 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f89c2d740 1 -- 172.21.15.81:0/3937785066 wait complete. 2024-09-21T03:03:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f89c2d740 20 client.15921 trim_cache size 0 max 16384 2024-09-21T03:03:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:03:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:03:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:03:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f640b6590 msgr2=0x7f1f640b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f640b6590 0x7f1f640b8aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c005760 tx=0x7f1f6c009260 comp rx=0 tx=0).stop 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 msgr2=0x7f1f7c199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c199e80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009230 tx=0x7f1f6c004040 comp rx=0 tx=0).stop 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 shutdown_connections 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f640b6590 0x7f1f640b8aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f7c1050f0 0x7f1f7c19b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f7c104750 0x7f1f7c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 --2- 172.21.15.81:0/1345099770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f7c1036d0 0x7f1f7c199e80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.476+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 >> 172.21.15.81:0/1345099770 conn(0x7f1f7c0ff030 msgr2=0x7f1f7c107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.477+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 shutdown_connections 2024-09-21T03:03:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:24.477+0000 7f1f82cbd640 1 -- 172.21.15.81:0/1345099770 wait complete. 2024-09-21T03:03:25.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:25 smithi164 ceph-mon[34236]: pgmap v450: 129 pgs: 129 active+clean; 917 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 76 MiB/s wr, 48 op/s 2024-09-21T03:03:25.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:25 smithi181 ceph-mon[34096]: pgmap v450: 129 pgs: 129 active+clean; 917 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 76 MiB/s wr, 48 op/s 2024-09-21T03:03:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:25 smithi081 ceph-mon[30991]: pgmap v450: 129 pgs: 129 active+clean; 917 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 76 MiB/s wr, 48 op/s 2024-09-21T03:03:27.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:27 smithi164 ceph-mon[34236]: pgmap v451: 129 pgs: 129 active+clean; 929 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 77 MiB/s wr, 50 op/s 2024-09-21T03:03:27.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:27 smithi181 ceph-mon[34096]: pgmap v451: 129 pgs: 129 active+clean; 929 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 77 MiB/s wr, 50 op/s 2024-09-21T03:03:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:27 smithi081 ceph-mon[30991]: pgmap v451: 129 pgs: 129 active+clean; 929 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 77 MiB/s wr, 50 op/s 2024-09-21T03:03:29.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:29 smithi164 ceph-mon[34236]: pgmap v452: 129 pgs: 129 active+clean; 936 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 78 MiB/s wr, 51 op/s 2024-09-21T03:03:29.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:29 smithi181 ceph-mon[34096]: pgmap v452: 129 pgs: 129 active+clean; 936 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 78 MiB/s wr, 51 op/s 2024-09-21T03:03:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:29 smithi081 ceph-mon[30991]: pgmap v452: 129 pgs: 129 active+clean; 936 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 78 MiB/s wr, 51 op/s 2024-09-21T03:03:31.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:31 smithi164 ceph-mon[34236]: pgmap v453: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 78 MiB/s wr, 51 op/s 2024-09-21T03:03:31.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:31 smithi181 ceph-mon[34096]: pgmap v453: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 78 MiB/s wr, 51 op/s 2024-09-21T03:03:32.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:31 smithi081 ceph-mon[30991]: pgmap v453: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 78 MiB/s wr, 51 op/s 2024-09-21T03:03:33.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:33 smithi164 ceph-mon[34236]: pgmap v454: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 49 MiB/s wr, 36 op/s 2024-09-21T03:03:33.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:33 smithi181 ceph-mon[34096]: pgmap v454: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 49 MiB/s wr, 36 op/s 2024-09-21T03:03:34.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:33 smithi081 ceph-mon[30991]: pgmap v454: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 49 MiB/s wr, 36 op/s 2024-09-21T03:03:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:35 smithi164 ceph-mon[34236]: pgmap v455: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-09-21T03:03:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:35 smithi181 ceph-mon[34096]: pgmap v455: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-09-21T03:03:36.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:35 smithi081 ceph-mon[30991]: pgmap v455: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5.3 MiB/s wr, 10 op/s 2024-09-21T03:03:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 -- 172.21.15.81:0/4031375992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278103650 msgr2=0x7fe278103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/4031375992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278103650 0x7fe278103a60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe260009900 tx=0x7fe26002a410 comp rx=0 tx=0).stop 2024-09-21T03:03:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 -- 172.21.15.81:0/4031375992 shutdown_connections 2024-09-21T03:03:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/4031375992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe278103ff0 0x7fe27810a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/4031375992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe278103650 0x7fe278103a60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/4031375992 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe2781025d0 0x7fe278102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 -- 172.21.15.81:0/4031375992 >> 172.21.15.81:0/4031375992 conn(0x7fe2780fdf30 msgr2=0x7fe2781003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 -- 172.21.15.81:0/4031375992 shutdown_connections 2024-09-21T03:03:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.582+0000 7fe27d2ec640 1 -- 172.21.15.81:0/4031375992 wait complete. 2024-09-21T03:03:37.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 Processor -- start 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 -- start start 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781025d0 0x7fe27806c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe278103650 0x7fe27819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe278103ff0 0x7fe2781a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe27810e0b0 con 0x7fe2781025d0 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe27810df30 con 0x7fe278103ff0 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe27d2ec640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe27810e230 con 0x7fe278103650 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781025d0 0x7fe27806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781025d0 0x7fe27806c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54042/0 (socket says 172.21.15.81:54042) 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe276ffd640 1 -- 172.21.15.81:0/600520438 learned_addr learned my addr 172.21.15.81:0/600520438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:37.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.583+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe278103650 0x7fe27819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe2777fe640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe278103ff0 0x7fe2781a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe276ffd640 1 -- 172.21.15.81:0/600520438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe278103650 msgr2=0x7fe27819ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe276ffd640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe278103650 0x7fe27819ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe276ffd640 1 -- 172.21.15.81:0/600520438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe278103ff0 msgr2=0x7fe2781a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe276ffd640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe278103ff0 0x7fe2781a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe276ffd640 1 -- 172.21.15.81:0/600520438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2781a1990 con 0x7fe2781025d0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe278103650 0x7fe27819ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe276ffd640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781025d0 0x7fe27806c230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe26800e9f0 tx=0x7fe26800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe274ff9640 1 -- 172.21.15.81:0/600520438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26800cd80 con 0x7fe2781025d0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2781a1c80 con 0x7fe2781025d0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe274ff9640 1 -- 172.21.15.81:0/600520438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2680108c0 con 0x7fe2781025d0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe274ff9640 1 -- 172.21.15.81:0/600520438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680187c0 con 0x7fe2781025d0 2024-09-21T03:03:37.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.584+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2781a21d0 con 0x7fe2781025d0 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 Processor -- start 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 -- start start 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe274ff9640 1 -- 172.21.15.81:0/600520438 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe268010430 con 0x7fe2781025d0 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdef420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bdacd5c6f0 con 0x55bdaca192f0 2024-09-21T03:03:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bdacd4bb20 con 0x55bdaca421b0 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe284258740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bdacd4f930 con 0x55bdaca214d0 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdee8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54054/0 (socket says 172.21.15.81:54054) 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.587+0000 7fe276ffd640 1 -- 172.21.15.81:0/2308084581 learned_addr learned my addr 172.21.15.81:0/2308084581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe2777fe640 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe276ffd640 1 -- 172.21.15.81:0/2308084581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 msgr2=0x55bdacdef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe276ffd640 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe276ffd640 1 -- 172.21.15.81:0/2308084581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 msgr2=0x55bdacdee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe276ffd640 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe276ffd640 1 -- 172.21.15.81:0/2308084581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdacd11530 con 0x55bdaca192f0 2024-09-21T03:03:37.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe276ffd640 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdee8d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ebcb0 tx=0x7fe2680f05e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddd777d562d266f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe26d7fa640 1 -- 172.21.15.81:0/2308084581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680ed050 con 0x55bdaca192f0 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe26d7fa640 1 -- 172.21.15.81:0/2308084581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2680f9070 con 0x55bdaca192f0 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe26d7fa640 1 -- 172.21.15.81:0/2308084581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680f35b0 con 0x55bdaca192f0 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe274ff9640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe2640b6510 0x7fe2640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe2777fe640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe2640b6510 0x7fe2640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.588+0000 7fe274ff9640 1 -- 172.21.15.81:0/600520438 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe2680e7b10 con 0x7fe2781025d0 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 -- 172.21.15.81:0/2308084581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 msgr2=0x55bdacdee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe2777fe640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe2640b6510 0x7fe2640b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe270005fd0 tx=0x7fe270009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdee8d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ebcb0 tx=0x7fe2680f05e0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 -- 172.21.15.81:0/2308084581 shutdown_connections 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdee8d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 --2- 172.21.15.81:0/2308084581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 -- 172.21.15.81:0/2308084581 >> 172.21.15.81:0/2308084581 conn(0x55bdaca36300 msgr2=0x55bdacde58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 -- 172.21.15.81:0/2308084581 shutdown_connections 2024-09-21T03:03:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.589+0000 7fe284258740 1 -- 172.21.15.81:0/2308084581 wait complete. 2024-09-21T03:03:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 -- start start 2024-09-21T03:03:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 Processor -- start 2024-09-21T03:03:37.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdf7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdf7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdf8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bdacc83ab0 con 0x55bdaca192f0 2024-09-21T03:03:37.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55bdaccf1730 con 0x55bdaca421b0 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55bdacdefee0 con 0x55bdaca214d0 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe284258740 10 client.0 _ll_register_callbacks cb 0x55bdacd456b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdf7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdf7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54064/0 (socket says 172.21.15.81:54064) 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 -- 172.21.15.81:0/1935782043 learned_addr learned my addr 172.21.15.81:0/1935782043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 -- 172.21.15.81:0/1935782043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 msgr2=0x55bdacdf7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdf7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe2777fe640 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdf8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 -- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 msgr2=0x55bdacdf8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdf8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.590+0000 7fe276ffd640 1 -- 172.21.15.81:0/1935782043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdacaad790 con 0x55bdaca192f0 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe276ffd640 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdf7920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe26801f040 tx=0x7fe2680eb190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cecf7563f1238d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe25e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1935782043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a9fb0 con 0x55bdaca192f0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1935782043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe268010a70 con 0x55bdaca192f0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2680f9070 con 0x55bdaca192f0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1935782043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2680ed020 con 0x55bdaca192f0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 10 client.15933 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bdacb26620 con 0x55bdaca192f0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1935782043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2680f9070 con 0x55bdaca192f0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1935782043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fe2680f3070 con 0x55bdaca192f0 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 10 client.15933 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 20 client.15933 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca00d80 0x55bdace04ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 4 client.15933 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:03:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.591+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdacd5e640 con 0x55bdaca00d80 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.592+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca00d80 0x55bdace04ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.592+0000 7fe25e7fc640 10 client.15933 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.592+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca00d80 0x55bdace04ce0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e31dd235e95d6b server_cookie=8b614ab5135c91d5 in_seq=0 out_seq=0 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1935782043 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bdacd5e640 con 0x55bdaca00d80 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe25e7fc640 10 client.15933 handle_command_reply: tid=0 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 client.15933 shutdown 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 msgr2=0x55bdacdf7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdf7920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe26801f040 tx=0x7fe2680eb190 comp rx=0 tx=0).stop 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 shutdown_connections 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca00d80 0x55bdace04ce0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdf7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe25e7fc640 0 client.15933 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca421b0 0x55bdacdf8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 --2- 172.21.15.81:0/1935782043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca192f0 0x55bdacdf7920 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 >> 172.21.15.81:0/1935782043 conn(0x55bdaca36300 msgr2=0x55bdacdef2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 shutdown_connections 2024-09-21T03:03:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.593+0000 7fe284258740 1 -- 172.21.15.81:0/1935782043 wait complete. 2024-09-21T03:03:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.594+0000 7fe284258740 20 client.15933 trim_cache size 0 max 16384 2024-09-21T03:03:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 Processor -- start 2024-09-21T03:03:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 -- start start 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca00d80 0x55bdacdf5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca192f0 0x55bdacdf63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca214d0 0x55bdacdf02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781acbd0 con 0x55bdaca214d0 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781aa4a0 con 0x55bdaca00d80 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe284258740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781a82f0 con 0x55bdaca192f0 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca214d0 0x55bdacdf02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe2777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca214d0 0x55bdacdf02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54078/0 (socket says 172.21.15.81:54078) 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.608+0000 7fe2777fe640 1 -- 172.21.15.81:0/3794051129 learned_addr learned my addr 172.21.15.81:0/3794051129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca192f0 0x55bdacdf63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe276ffd640 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca00d80 0x55bdacdf5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe2777fe640 1 -- 172.21.15.81:0/3794051129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca192f0 msgr2=0x55bdacdf63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe2777fe640 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca192f0 0x55bdacdf63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe2777fe640 1 -- 172.21.15.81:0/3794051129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca00d80 msgr2=0x55bdacdf5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe2777fe640 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca00d80 0x55bdacdf5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe2777fe640 1 -- 172.21.15.81:0/3794051129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdacdf68f0 con 0x55bdaca214d0 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe276ffd640 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca00d80 0x55bdacdf5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe2777fe640 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca214d0 0x55bdacdf02e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe27001e4a0 tx=0x7fe270016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2084e86f6aba6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe26cff9640 1 -- 172.21.15.81:0/3794051129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27002c070 con 0x55bdaca214d0 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe26cff9640 1 -- 172.21.15.81:0/3794051129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe27001e0d0 con 0x55bdaca214d0 2024-09-21T03:03:37.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.609+0000 7fe26cff9640 1 -- 172.21.15.81:0/3794051129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe270027e60 con 0x55bdaca214d0 2024-09-21T03:03:37.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 -- 172.21.15.81:0/3794051129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca214d0 msgr2=0x55bdacdf02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca214d0 0x55bdacdf02e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe27001e4a0 tx=0x7fe270016000 comp rx=0 tx=0).stop 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 -- 172.21.15.81:0/3794051129 shutdown_connections 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca192f0 0x55bdacdf63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca214d0 0x55bdacdf02e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 --2- 172.21.15.81:0/3794051129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca00d80 0x55bdacdf5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 -- 172.21.15.81:0/3794051129 >> 172.21.15.81:0/3794051129 conn(0x55bdaca36300 msgr2=0x55bdacde05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 -- 172.21.15.81:0/3794051129 shutdown_connections 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 -- 172.21.15.81:0/3794051129 wait complete. 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 -- start start 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.610+0000 7fe284258740 1 Processor -- start 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca00d80 0x55bdacdfcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca192f0 0x55bdacdfd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdfdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781a8960 con 0x55bdaca00d80 2024-09-21T03:03:37.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781a9dd0 con 0x55bdaca192f0 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fe2781a9030 con 0x55bdaca214d0 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 10 client.0 _ll_register_callbacks cb 0x7fe2700099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca00d80 0x55bdacdfcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca00d80 0x55bdacdfcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54080/0 (socket says 172.21.15.81:54080) 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 -- 172.21.15.81:0/1567777497 learned_addr learned my addr 172.21.15.81:0/1567777497 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe2777fe640 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdfdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 -- 172.21.15.81:0/1567777497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 msgr2=0x55bdacdfdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdfdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 -- 172.21.15.81:0/1567777497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca192f0 msgr2=0x55bdacdfd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca192f0 0x55bdacdfd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 -- 172.21.15.81:0/1567777497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdacdfe4e0 con 0x55bdaca00d80 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe2777fe640 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdfdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:37.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe276ffd640 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca00d80 0x55bdacdfcb50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ebcb0 tx=0x7fe2680ebba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35af4587353f2a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe25e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1567777497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe268010720 con 0x55bdaca00d80 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1567777497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fe2680eb3c0 con 0x55bdaca00d80 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.611+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe27001e0d0 con 0x55bdaca00d80 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1567777497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2680ad0d0 con 0x55bdaca00d80 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 10 client.15939 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bdacdff740 con 0x55bdaca00d80 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1567777497 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe27001e0d0 con 0x55bdaca00d80 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1567777497 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fe2680f3070 con 0x55bdaca00d80 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 10 client.15939 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 20 client.15939 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca421b0 0x55bdace71700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 4 client.15939 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:03:37.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bdacd5a0f0 con 0x55bdaca421b0 2024-09-21T03:03:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.612+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca421b0 0x55bdace71700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.613+0000 7fe25e7fc640 10 client.15939 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.613+0000 7fe26e7fc640 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca421b0 0x55bdace71700 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=353b6dcc4c5e1c84 server_cookie=46e0c5bd022a2eef in_seq=0 out_seq=0 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe25e7fc640 1 -- 172.21.15.81:0/1567777497 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bdacd5a0f0 con 0x55bdaca421b0 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe25e7fc640 10 client.15939 handle_command_reply: tid=0 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 client.15939 shutdown 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca00d80 msgr2=0x55bdacdfcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca00d80 0x55bdacdfcb50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ebcb0 tx=0x7fe2680ebba0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 shutdown_connections 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55bdaca421b0 0x55bdace71700 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bdaca214d0 0x55bdacdfdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55bdaca192f0 0x55bdacdfd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe25e7fc640 0 client.15939 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 --2- 172.21.15.81:0/1567777497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdaca00d80 0x55bdacdfcb50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 >> 172.21.15.81:0/1567777497 conn(0x55bdaca36300 msgr2=0x55bdacde05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 shutdown_connections 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 1 -- 172.21.15.81:0/1567777497 wait complete. 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.621+0000 7fe284258740 20 client.15939 trim_cache size 0 max 16384 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:03:37.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:03:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe2640b6510 msgr2=0x7fe2640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe2640b6510 0x7fe2640b8a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe270005fd0 tx=0x7fe270009500 comp rx=0 tx=0).stop 2024-09-21T03:03:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781025d0 msgr2=0x7fe27806c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781025d0 0x7fe27806c230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe26800e9f0 tx=0x7fe26800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 shutdown_connections 2024-09-21T03:03:37.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fe2640b6510 0x7fe2640b8a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe278103650 0x7fe27819ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe278103ff0 0x7fe2781a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 --2- 172.21.15.81:0/600520438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2781025d0 0x7fe27806c230 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 >> 172.21.15.81:0/600520438 conn(0x7fe2780fdf30 msgr2=0x7fe278106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 shutdown_connections 2024-09-21T03:03:37.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:37.622+0000 7fe27d2ec640 1 -- 172.21.15.81:0/600520438 wait complete. 2024-09-21T03:03:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:37 smithi164 ceph-mon[34236]: pgmap v456: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-09-21T03:03:37.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:37 smithi181 ceph-mon[34096]: pgmap v456: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-09-21T03:03:38.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:37 smithi081 ceph-mon[30991]: pgmap v456: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 MiB/s wr, 9 op/s 2024-09-21T03:03:39.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:39 smithi081 ceph-mon[30991]: pgmap v457: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 640 KiB/s wr, 8 op/s 2024-09-21T03:03:39.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:39 smithi164 ceph-mon[34236]: pgmap v457: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 640 KiB/s wr, 8 op/s 2024-09-21T03:03:39.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:39 smithi181 ceph-mon[34096]: pgmap v457: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 640 KiB/s wr, 8 op/s 2024-09-21T03:03:41.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:41 smithi164 ceph-mon[34236]: pgmap v458: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:03:41.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:41 smithi181 ceph-mon[34096]: pgmap v458: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:03:42.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:41 smithi081 ceph-mon[30991]: pgmap v458: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:03:43.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:03:43.912 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:03:43.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:43 smithi164 ceph-mon[34236]: pgmap v459: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:03:43.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:43 smithi181 ceph-mon[34096]: pgmap v459: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:03:44.031 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:43 smithi081 ceph-mon[30991]: pgmap v459: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:03:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 -- 172.21.15.81:0/884963476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a810de30 msgr2=0x7f87a8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 --2- 172.21.15.81:0/884963476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a810de30 0x7f87a8110300 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8798009900 tx=0x7f879802a410 comp rx=0 tx=0).stop 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 -- 172.21.15.81:0/884963476 shutdown_connections 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 --2- 172.21.15.81:0/884963476 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87a81052b0 0x7f87a810d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 --2- 172.21.15.81:0/884963476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a810de30 0x7f87a8110300 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 --2- 172.21.15.81:0/884963476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87a8104880 0x7f87a8104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 -- 172.21.15.81:0/884963476 >> 172.21.15.81:0/884963476 conn(0x7f87a8079730 msgr2=0x7f87a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 -- 172.21.15.81:0/884963476 shutdown_connections 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.409+0000 7f87afc6d640 1 -- 172.21.15.81:0/884963476 wait complete. 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 Processor -- start 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 -- start start 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a8104880 0x7f87a819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87a81052b0 0x7f87a819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87a810de30 0x7f87a819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:44.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87a8113980 con 0x7f87a8104880 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f87a8113800 con 0x7f87a81052b0 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87afc6d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f87a8113b00 con 0x7f87a810de30 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87ada09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a8104880 0x7f87a819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87ada09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a8104880 0x7f87a819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32782/0 (socket says 172.21.15.81:32782) 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87ada09640 1 -- 172.21.15.81:0/1125894284 learned_addr learned my addr 172.21.15.81:0/1125894284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.410+0000 7f87ad208640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87a81052b0 0x7f87a819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ada09640 1 -- 172.21.15.81:0/1125894284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87a810de30 msgr2=0x7f87a819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ae20a640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87a810de30 0x7f87a819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ada09640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87a810de30 0x7f87a819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ada09640 1 -- 172.21.15.81:0/1125894284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87a81052b0 msgr2=0x7f87a819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ada09640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87a81052b0 0x7f87a819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ada09640 1 -- 172.21.15.81:0/1125894284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a81a0320 con 0x7f87a8104880 2024-09-21T03:03:44.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ad208640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87a81052b0 0x7f87a819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:03:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87ada09640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a8104880 0x7f87a819a470 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f87a000ccb0 tx=0x7f87a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87a6ffd640 1 -- 172.21.15.81:0/1125894284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0003b70 con 0x7f87a8104880 2024-09-21T03:03:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a81a0610 con 0x7f87a8104880 2024-09-21T03:03:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87a6ffd640 1 -- 172.21.15.81:0/1125894284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87a000ae50 con 0x7f87a8104880 2024-09-21T03:03:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87a6ffd640 1 -- 172.21.15.81:0/1125894284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a000f6b0 con 0x7f87a8104880 2024-09-21T03:03:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.411+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a81a6e30 con 0x7f87a8104880 2024-09-21T03:03:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.412+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a8104c90 con 0x7f87a8104880 2024-09-21T03:03:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.414+0000 7f87a6ffd640 1 -- 172.21.15.81:0/1125894284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f87a0004000 con 0x7f87a8104880 2024-09-21T03:03:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.414+0000 7f87a6ffd640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f87900b6540 0x7f87900b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.414+0000 7f87ad208640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f87900b6540 0x7f87900b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.414+0000 7f87a6ffd640 1 -- 172.21.15.81:0/1125894284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f87a00e7c00 con 0x7f87a8104880 2024-09-21T03:03:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.415+0000 7f87ad208640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f87900b6540 0x7f87900b8a50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f87a8102390 tx=0x7f879c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:44.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.418+0000 7f87a6ffd640 1 -- 172.21.15.81:0/1125894284 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87a0014070 con 0x7f87a8104880 2024-09-21T03:03:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.633+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87a8108f60 con 0x7f87a8104880 2024-09-21T03:03:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.633+0000 7f87a6ffd640 1 -- 172.21.15.81:0/1125894284 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11925 (secure 0 0 0) 0x7f87a00ae150 con 0x7f87a8104880 2024-09-21T03:03:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:03:44.635 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-21T03:02:50:539320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:02:50.244254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24568,24572,24599]},"id":1}]} 2024-09-21T03:03:44.636 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f87900b6540 msgr2=0x7f87900b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f87900b6540 0x7f87900b8a50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f87a8102390 tx=0x7f879c008040 comp rx=0 tx=0).stop 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a8104880 msgr2=0x7f87a819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a8104880 0x7f87a819a470 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f87a000ccb0 tx=0x7f87a000a620 comp rx=0 tx=0).stop 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 shutdown_connections 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f87900b6540 0x7f87900b8a50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87a810de30 0x7f87a819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87a81052b0 0x7f87a819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 --2- 172.21.15.81:0/1125894284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87a8104880 0x7f87a819a470 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:44.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 >> 172.21.15.81:0/1125894284 conn(0x7f87a8079730 msgr2=0x7f87a81009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:44.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 shutdown_connections 2024-09-21T03:03:44.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:44.636+0000 7f87afc6d640 1 -- 172.21.15.81:0/1125894284 wait complete. 2024-09-21T03:03:45.393 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db --set-id 86c63001 --release --await' 2024-09-21T03:03:45.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db --set-id 86c63001 --release --await 2024-09-21T03:03:45.641 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:03:45.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:45 smithi081 ceph-mon[30991]: pgmap v460: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T03:03:45.898 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:45 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1125894284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:45.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:45 smithi164 ceph-mon[34236]: pgmap v460: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T03:03:45.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:45 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1125894284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:45 smithi181 ceph-mon[34096]: pgmap v460: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T03:03:45.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:45 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1125894284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 -- 172.21.15.81:0/3095677753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4103b70 msgr2=0x7f6af4103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 --2- 172.21.15.81:0/3095677753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4103b70 0x7f6af4103f80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009ca0 tx=0x7f6ae402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 -- 172.21.15.81:0/3095677753 shutdown_connections 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 --2- 172.21.15.81:0/3095677753 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6af41094b0 0x7f6af41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 --2- 172.21.15.81:0/3095677753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6af4109e00 0x7f6af4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 --2- 172.21.15.81:0/3095677753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4103b70 0x7f6af4103f80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 -- 172.21.15.81:0/3095677753 >> 172.21.15.81:0/3095677753 conn(0x7f6af40ff5e0 msgr2=0x7f6af4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 -- 172.21.15.81:0/3095677753 shutdown_connections 2024-09-21T03:03:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.120+0000 7f6af9321640 1 -- 172.21.15.81:0/3095677753 wait complete. 2024-09-21T03:03:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.121+0000 7f6af9321640 1 Processor -- start 2024-09-21T03:03:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.121+0000 7f6af9321640 1 -- start start 2024-09-21T03:03:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af9321640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6af4103b70 0x7f6af419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af9321640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6af41094b0 0x7f6af419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af9321640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4109e00 0x7f6af419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af9321640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6af41139c0 con 0x7f6af4109e00 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af9321640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6af4113840 con 0x7f6af4103b70 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af9321640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6af4113b40 con 0x7f6af41094b0 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4109e00 0x7f6af419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4109e00 0x7f6af419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32808/0 (socket says 172.21.15.81:32808) 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 -- 172.21.15.81:0/3652323208 learned_addr learned my addr 172.21.15.81:0/3652323208 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6af4103b70 0x7f6af419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6af41094b0 0x7f6af419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 -- 172.21.15.81:0/3652323208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6af41094b0 msgr2=0x7f6af419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6af41094b0 0x7f6af419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 -- 172.21.15.81:0/3652323208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6af4103b70 msgr2=0x7f6af419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6af4103b70 0x7f6af419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.122+0000 7f6af37fe640 1 -- 172.21.15.81:0/3652323208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af41a0340 con 0x7f6af4109e00 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.123+0000 7f6af37fe640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4109e00 0x7f6af419fc10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00d750 tx=0x7f6aec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.123+0000 7f6af0ff9640 1 -- 172.21.15.81:0/3652323208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec017070 con 0x7f6af4109e00 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.123+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af41a0630 con 0x7f6af4109e00 2024-09-21T03:03:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.123+0000 7f6af0ff9640 1 -- 172.21.15.81:0/3652323208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6aec0054b0 con 0x7f6af4109e00 2024-09-21T03:03:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.123+0000 7f6af0ff9640 1 -- 172.21.15.81:0/3652323208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec004b90 con 0x7f6af4109e00 2024-09-21T03:03:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.123+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af41a6d90 con 0x7f6af4109e00 2024-09-21T03:03:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6af0ff9640 1 -- 172.21.15.81:0/3652323208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6aec004d30 con 0x7f6af4109e00 2024-09-21T03:03:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 Processor -- start 2024-09-21T03:03:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 -- start start 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd5f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd5f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd5f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5567bd4e1dc0 con 0x5567bd22f840 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5567bd56e1f0 con 0x5567bd227660 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.126+0000 7f6aff895740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5567bd55d620 con 0x5567bd250520 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd5f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd5f6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32814/0 (socket says 172.21.15.81:32814) 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 -- 172.21.15.81:0/3331148586 learned_addr learned my addr 172.21.15.81:0/3331148586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd5f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd5f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 -- 172.21.15.81:0/3331148586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 msgr2=0x5567bd5f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd5f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 -- 172.21.15.81:0/3331148586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 msgr2=0x5567bd5f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd5f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 -- 172.21.15.81:0/3331148586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567bd525fd0 con 0x5567bd22f840 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6af0ff9640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ae00b6510 0x7f6ae00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ae00b6510 0x7f6ae00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd5f6f90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00bf80 tx=0x7f6adc005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c20a24e94badf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6af0ff9640 1 -- 172.21.15.81:0/3652323208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f6aec0e7000 con 0x7f6af4109e00 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6ae97fa640 1 -- 172.21.15.81:0/3331148586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc004220 con 0x5567bd22f840 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6ae97fa640 1 -- 172.21.15.81:0/3331148586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6adc0043c0 con 0x5567bd22f840 2024-09-21T03:03:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.127+0000 7f6ae97fa640 1 -- 172.21.15.81:0/3331148586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc004d10 con 0x5567bd22f840 2024-09-21T03:03:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.128+0000 7f6aff895740 1 -- 172.21.15.81:0/3331148586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 msgr2=0x5567bd5f6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.128+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ae00b6510 0x7f6ae00b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000f80 tx=0x7f6ae4031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.128+0000 7f6aff895740 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd5f6f90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00bf80 tx=0x7f6adc005c90 comp rx=0 tx=0).stop 2024-09-21T03:03:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.128+0000 7f6aff895740 1 -- 172.21.15.81:0/3331148586 shutdown_connections 2024-09-21T03:03:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.128+0000 7f6aff895740 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd5f6f90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.128+0000 7f6aff895740 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd5f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 --2- 172.21.15.81:0/3331148586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd5f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 -- 172.21.15.81:0/3331148586 >> 172.21.15.81:0/3331148586 conn(0x5567bd244910 msgr2=0x5567bd5f4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 -- 172.21.15.81:0/3331148586 shutdown_connections 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 -- 172.21.15.81:0/3331148586 wait complete. 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 -- start start 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 Processor -- start 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd227660 0x5567bd601bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd602100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd250520 0x5567bd60de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5567bd4f8300 con 0x5567bd250520 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5567bd561430 con 0x5567bd22f840 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.129+0000 7f6aff895740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x5567bd3bebb0 con 0x5567bd227660 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6aff895740 10 client.0 _ll_register_callbacks cb 0x5567bd512120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd250520 0x5567bd60de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd250520 0x5567bd60de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32828/0 (socket says 172.21.15.81:32828) 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6aea7fc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd602100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 -- 172.21.15.81:0/3348392538 learned_addr learned my addr 172.21.15.81:0/3348392538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd227660 0x5567bd601bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 -- 172.21.15.81:0/3348392538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd227660 msgr2=0x5567bd601bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd227660 0x5567bd601bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 -- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 msgr2=0x5567bd602100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd602100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 -- 172.21.15.81:0/3348392538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567bd4e7780 con 0x5567bd250520 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd227660 0x5567bd601bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd602100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6af37fe640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd250520 0x5567bd60de60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0a94d0 tx=0x7f6aec0ac670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a18bca293af0113 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6ada7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6ada7fc640 1 -- 172.21.15.81:0/3348392538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec020070 con 0x5567bd250520 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6ada7fc640 1 -- 172.21.15.81:0/3348392538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f6aec0942b0 con 0x5567bd250520 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.130+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6adc0043c0 con 0x5567bd250520 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6ada7fc640 1 -- 172.21.15.81:0/3348392538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6aec0cee60 con 0x5567bd250520 2024-09-21T03:03:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 10 client.15957 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5567bd2bbb00 con 0x5567bd250520 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6ada7fc640 1 -- 172.21.15.81:0/3348392538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6adc0043c0 con 0x5567bd250520 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6ada7fc640 1 -- 172.21.15.81:0/3348392538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f6aec0d40c0 con 0x5567bd250520 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 10 client.15957 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 10 client.15957 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 20 client.15957 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd20eea0 0x5567bd613fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 4 client.15957 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567bd570140 con 0x5567bd20eea0 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.131+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd20eea0 0x5567bd613fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.132+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd20eea0 0x5567bd613fd0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9956b4d3b1cca85 server_cookie=ca7b3c4117780df9 in_seq=0 out_seq=0 2024-09-21T03:03:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.132+0000 7f6ada7fc640 10 client.15957 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6ada7fc640 1 -- 172.21.15.81:0/3348392538 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567bd570140 con 0x5567bd20eea0 2024-09-21T03:03:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6ada7fc640 10 client.15957 handle_command_reply: tid=0 2024-09-21T03:03:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 client.15957 shutdown 2024-09-21T03:03:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd250520 msgr2=0x5567bd60de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd250520 0x5567bd60de60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0a94d0 tx=0x7f6aec0ac670 comp rx=0 tx=0).stop 2024-09-21T03:03:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 shutdown_connections 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd20eea0 0x5567bd613fd0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd250520 0x5567bd60de60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd602100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 --2- 172.21.15.81:0/3348392538 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd227660 0x5567bd601bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 >> 172.21.15.81:0/3348392538 conn(0x5567bd244910 msgr2=0x5567bd5f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6ada7fc640 0 client.15957 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 shutdown_connections 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 1 -- 172.21.15.81:0/3348392538 wait complete. 2024-09-21T03:03:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.133+0000 7f6aff895740 20 client.15957 trim_cache size 0 max 16384 2024-09-21T03:03:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 Processor -- start 2024-09-21T03:03:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 -- start start 2024-09-21T03:03:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd227660 0x5567bd5fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd5ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6197d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6af41b3120 con 0x5567bd227660 2024-09-21T03:03:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6af41b09f0 con 0x5567bd22f840 2024-09-21T03:03:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6aff895740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6af41ae840 con 0x5567bd250520 2024-09-21T03:03:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6af2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd227660 0x5567bd5fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6af2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd227660 0x5567bd5fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32834/0 (socket says 172.21.15.81:32834) 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.150+0000 7f6af2ffd640 1 -- 172.21.15.81:0/379793663 learned_addr learned my addr 172.21.15.81:0/379793663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd5ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6af37fe640 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6197d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6af2ffd640 1 -- 172.21.15.81:0/379793663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 msgr2=0x5567bd6197d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6197d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6af2ffd640 1 -- 172.21.15.81:0/379793663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 msgr2=0x5567bd5ff2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd5ff2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6af2ffd640 1 -- 172.21.15.81:0/379793663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567bd332960 con 0x5567bd227660 2024-09-21T03:03:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd5ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:03:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd227660 0x5567bd5fedb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009ca0 tx=0x7f6ae4041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22f271182a2f9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6ae8ff9640 1 -- 172.21.15.81:0/379793663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4032da0 con 0x5567bd227660 2024-09-21T03:03:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6ae8ff9640 1 -- 172.21.15.81:0/379793663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ae4036050 con 0x5567bd227660 2024-09-21T03:03:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.151+0000 7f6ae8ff9640 1 -- 172.21.15.81:0/379793663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4054d50 con 0x5567bd227660 2024-09-21T03:03:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 -- 172.21.15.81:0/379793663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd227660 msgr2=0x5567bd5fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd227660 0x5567bd5fedb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009ca0 tx=0x7f6ae4041000 comp rx=0 tx=0).stop 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 -- 172.21.15.81:0/379793663 shutdown_connections 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6197d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd22f840 0x5567bd5ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 --2- 172.21.15.81:0/379793663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd227660 0x5567bd5fedb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 -- 172.21.15.81:0/379793663 >> 172.21.15.81:0/379793663 conn(0x5567bd244910 msgr2=0x5567bd6030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.152+0000 7f6aff895740 1 -- 172.21.15.81:0/379793663 shutdown_connections 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 -- 172.21.15.81:0/379793663 wait complete. 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 -- start start 2024-09-21T03:03:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 Processor -- start 2024-09-21T03:03:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd6088a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd608e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6769a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6af41aeeb0 con 0x5567bd22f840 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6af41b0320 con 0x5567bd227660 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6af41af580 con 0x5567bd250520 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.153+0000 7f6aff895740 10 client.0 _ll_register_callbacks cb 0x7f6aec00de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd6088a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6aea7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd608e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd6088a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:48522/0 (socket says 172.21.15.81:48522) 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 -- 172.21.15.81:0/736890864 learned_addr learned my addr 172.21.15.81:0/736890864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af37fe640 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 -- 172.21.15.81:0/736890864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 msgr2=0x5567bd6769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6769a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 -- 172.21.15.81:0/736890864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 msgr2=0x5567bd608e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd608e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 -- 172.21.15.81:0/736890864 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567bd677010 con 0x5567bd227660 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd608e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:03:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6af2ffd640 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd6088a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4032bf0 tx=0x7f6ae4032f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc308d4f3e5b55b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6ada7fc640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6ada7fc640 1 -- 172.21.15.81:0/736890864 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4054400 con 0x5567bd227660 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.154+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae4036050 con 0x5567bd227660 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6ada7fc640 1 -- 172.21.15.81:0/736890864 <== mon.2 v2:172.21.15.164:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f6ae40545a0 con 0x5567bd227660 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6ada7fc640 1 -- 172.21.15.81:0/736890864 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6ae4071050 con 0x5567bd227660 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 10 client.25460 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5567bd67f530 con 0x5567bd227660 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6ada7fc640 1 -- 172.21.15.81:0/736890864 <== mon.2 v2:172.21.15.164:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ae4036050 con 0x5567bd227660 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6ada7fc640 1 -- 172.21.15.81:0/736890864 <== mon.2 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f6ae4003970 con 0x5567bd227660 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 10 client.25460 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 10 client.25460 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 20 client.25460 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd1e4250 0x5567bd681d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 4 client.25460 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "86c63001", "release": true, "await": true}] 2024-09-21T03:03:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.155+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "set_id": "86c63001", "release": true, "await": true}) -- 0x5567bd56bbf0 con 0x5567bd1e4250 2024-09-21T03:03:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.156+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd1e4250 0x5567bd681d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.156+0000 7f6ada7fc640 10 client.25460 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.156+0000 7f6aea7fc640 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd1e4250 0x5567bd681d20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb25e386fc64a72e server_cookie=ddfe1a21b2d66807 in_seq=0 out_seq=0 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.158+0000 7f6ada7fc640 1 -- 172.21.15.81:0/736890864 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5567bd56bbf0 con 0x5567bd1e4250 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.158+0000 7f6ada7fc640 10 client.25460 handle_command_reply: tid=0 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.158+0000 7f6aff895740 1 client.25460 shutdown 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 msgr2=0x5567bd6088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd6088a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4032bf0 tx=0x7f6ae4032f80 comp rx=0 tx=0).stop 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 shutdown_connections 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5567bd1e4250 0x5567bd681d20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567bd250520 0x5567bd6769a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567bd22f840 0x5567bd608e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6ada7fc640 0 client.25460 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 --2- 172.21.15.81:0/736890864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5567bd227660 0x5567bd6088a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 >> 172.21.15.81:0/736890864 conn(0x5567bd244910 msgr2=0x5567bd600440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 shutdown_connections 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 1 -- 172.21.15.81:0/736890864 wait complete. 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.159+0000 7f6aff895740 20 client.25460 trim_cache size 0 max 16384 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 26, 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 16, 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "86c63001": { 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 16, 2024-09-21T03:03:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 147.8, 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:46.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:46.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:46.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:03:46.221 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:03:46.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ae00b6510 msgr2=0x7f6ae00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ae00b6510 0x7f6ae00b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000f80 tx=0x7f6ae4031000 comp rx=0 tx=0).stop 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4109e00 msgr2=0x7f6af419fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4109e00 0x7f6af419fc10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00d750 tx=0x7f6aec00dc10 comp rx=0 tx=0).stop 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 shutdown_connections 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6ae00b6510 0x7f6ae00b8a20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6af41094b0 0x7f6af419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6af4109e00 0x7f6af419fc10 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 --2- 172.21.15.81:0/3652323208 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6af4103b70 0x7f6af419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.160+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 >> 172.21.15.81:0/3652323208 conn(0x7f6af40ff5e0 msgr2=0x7f6af4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.161+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 shutdown_connections 2024-09-21T03:03:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:03:46.161+0000 7f6af9321640 1 -- 172.21.15.81:0/3652323208 wait complete. 2024-09-21T03:03:47.184 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '86c63001', total seconds elapsed: 31.4 2024-09-21T03:03:47.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:47 smithi164 ceph-mon[34236]: pgmap v461: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:03:47.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:47 smithi181 ceph-mon[34096]: pgmap v461: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:03:48.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:47 smithi081 ceph-mon[30991]: pgmap v461: 129 pgs: 129 active+clean; 936 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:03:49.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:49 smithi164 ceph-mon[34236]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 9.4 MiB/s wr, 10 op/s 2024-09-21T03:03:49.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:49 smithi181 ceph-mon[34096]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 9.4 MiB/s wr, 10 op/s 2024-09-21T03:03:50.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:49 smithi081 ceph-mon[30991]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 9.4 MiB/s wr, 10 op/s 2024-09-21T03:03:50.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 -- 172.21.15.81:0/2953470527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 msgr2=0x7fa0c810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 --2- 172.21.15.81:0/2953470527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810a960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009850 tx=0x7fa0bc02a320 comp rx=0 tx=0).stop 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 -- 172.21.15.81:0/2953470527 shutdown_connections 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 --2- 172.21.15.81:0/2953470527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c8103620 0x7fa0c8103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 --2- 172.21.15.81:0/2953470527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810a960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 --2- 172.21.15.81:0/2953470527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c81025a0 0x7fa0c8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 -- 172.21.15.81:0/2953470527 >> 172.21.15.81:0/2953470527 conn(0x7fa0c80fdee0 msgr2=0x7fa0c8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 -- 172.21.15.81:0/2953470527 shutdown_connections 2024-09-21T03:03:50.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 -- 172.21.15.81:0/2953470527 wait complete. 2024-09-21T03:03:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.771+0000 7fa0cd590640 1 Processor -- start 2024-09-21T03:03:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0cd590640 1 -- start start 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0cd590640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c81025a0 0x7fa0c810cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0cd590640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c8103620 0x7fa0c810b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0cd590640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0cd590640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810f1d0 con 0x7fa0c8103620 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0cd590640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810f050 con 0x7fa0c8103fc0 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0cd590640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810f350 con 0x7fa0c81025a0 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0c77fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0c77fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:48540/0 (socket says 172.21.15.81:48540) 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0c67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c8103620 0x7fa0c810b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0c77fe640 1 -- 172.21.15.81:0/4038458152 learned_addr learned my addr 172.21.15.81:0/4038458152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.772+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c81025a0 0x7fa0c810cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.773+0000 7fa0c77fe640 1 -- 172.21.15.81:0/4038458152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c81025a0 msgr2=0x7fa0c810cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.773+0000 7fa0c77fe640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c81025a0 0x7fa0c810cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.773+0000 7fa0c77fe640 1 -- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c8103620 msgr2=0x7fa0c810b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.773+0000 7fa0c77fe640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c8103620 0x7fa0c810b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.773+0000 7fa0c77fe640 1 -- 172.21.15.81:0/4038458152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c810c040 con 0x7fa0c8103fc0 2024-09-21T03:03:50.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.773+0000 7fa0c77fe640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810b910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc005930 tx=0x7fa0bc0307d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.774+0000 7fa0affff640 1 -- 172.21.15.81:0/4038458152 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc037040 con 0x7fa0c8103fc0 2024-09-21T03:03:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.774+0000 7fa0affff640 1 -- 172.21.15.81:0/4038458152 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0bc042070 con 0x7fa0c8103fc0 2024-09-21T03:03:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.774+0000 7fa0affff640 1 -- 172.21.15.81:0/4038458152 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc003640 con 0x7fa0c8103fc0 2024-09-21T03:03:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.774+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c81a3f00 con 0x7fa0c8103fc0 2024-09-21T03:03:50.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.774+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c81a42b0 con 0x7fa0c8103fc0 2024-09-21T03:03:50.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.777+0000 7fa0d45dd740 1 Processor -- start 2024-09-21T03:03:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.777+0000 7fa0affff640 1 -- 172.21.15.81:0/4038458152 <== mon.2 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa0bc030a70 con 0x7fa0c8103fc0 2024-09-21T03:03:50.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0d45dd740 1 -- start start 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616532731b0 0x56165361ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165361b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165361c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56165358d6f0 con 0x56165324a2f0 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56165357cb20 con 0x5616532524d0 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x561653580930 con 0x5616532731b0 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0c6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165361b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0c6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165361b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32886/0 (socket says 172.21.15.81:32886) 2024-09-21T03:03:50.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/2057341264 learned_addr learned my addr 172.21.15.81:0/2057341264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:50.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.778+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165361c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/2057341264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616532731b0 msgr2=0x56165361ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616532731b0 0x56165361ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/2057341264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 msgr2=0x56165361c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165361c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/2057341264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561653542530 con 0x56165324a2f0 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165361b4c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000e5d0 tx=0x7fa0c00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9688947567ab4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0affff640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0b00b6590 0x7fa0b00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.779+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0b00b6590 0x7fa0b00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.780+0000 7fa0affff640 1 -- 172.21.15.81:0/4038458152 <== mon.2 v2:172.21.15.164:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fa0bc107790 con 0x7fa0c8103fc0 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.780+0000 7fa0ad7fa640 1 -- 172.21.15.81:0/2057341264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000dad0 con 0x56165324a2f0 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.780+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0b00b6590 0x7fa0b00b8aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80058c0 tx=0x7fa0b8012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.780+0000 7fa0ad7fa640 1 -- 172.21.15.81:0/2057341264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c001c070 con 0x56165324a2f0 2024-09-21T03:03:50.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.780+0000 7fa0ad7fa640 1 -- 172.21.15.81:0/2057341264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0016380 con 0x56165324a2f0 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2057341264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 msgr2=0x56165361b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165361b4c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000e5d0 tx=0x7fa0c00095c0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2057341264 shutdown_connections 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165361c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165361b4c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2057341264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616532731b0 0x56165361ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2057341264 >> 172.21.15.81:0/2057341264 conn(0x561653267300 msgr2=0x5616536168e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2057341264 shutdown_connections 2024-09-21T03:03:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.782+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2057341264 wait complete. 2024-09-21T03:03:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.783+0000 7fa0d45dd740 1 -- start start 2024-09-21T03:03:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.783+0000 7fa0d45dd740 1 Processor -- start 2024-09-21T03:03:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.783+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x5616536246c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x561653624d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616532731b0 0x561653625880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616532731b0 0x561653625880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616532731b0 0x561653625880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32896/0 (socket says 172.21.15.81:32896) 2024-09-21T03:03:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 -- 172.21.15.81:0/2825609773 learned_addr learned my addr 172.21.15.81:0/2825609773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616534b4ab0 con 0x5616532731b0 2024-09-21T03:03:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561653522730 con 0x5616532524d0 2024-09-21T03:03:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x56165361cb30 con 0x56165324a2f0 2024-09-21T03:03:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x561653624d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0d45dd740 10 client.0 _ll_register_callbacks cb 0x5616535766b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x5616536246c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 -- 172.21.15.81:0/2825609773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 msgr2=0x5616536246c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x5616536246c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 -- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 msgr2=0x561653624d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x561653624d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.784+0000 7fa0c77fe640 1 -- 172.21.15.81:0/2825609773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616532de790 con 0x5616532731b0 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.785+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0c001c070 con 0x5616532731b0 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.785+0000 7fa0c77fe640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616532731b0 0x561653625880 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0c9c40 tx=0x7fa0bc030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a4bbd7d7c14119 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.785+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x5616536246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:03:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.785+0000 7fa0aaff5640 10 client.15975 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:03:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.785+0000 7fa0aaff5640 1 -- 172.21.15.81:0/2825609773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0cd180 con 0x5616532731b0 2024-09-21T03:03:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.786+0000 7fa0aaff5640 1 -- 172.21.15.81:0/2825609773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fa0bc0d6040 con 0x5616532731b0 2024-09-21T03:03:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.786+0000 7fa0aaff5640 1 -- 172.21.15.81:0/2825609773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa0bc0d6280 con 0x5616532731b0 2024-09-21T03:03:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.786+0000 7fa0d45dd740 10 client.15975 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.786+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=26}) -- 0x561653357620 con 0x5616532731b0 2024-09-21T03:03:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.787+0000 7fa0aaff5640 1 -- 172.21.15.81:0/2825609773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fa0bc03a030 con 0x5616532731b0 2024-09-21T03:03:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.787+0000 7fa0d45dd740 10 client.15975 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.787+0000 7fa0d45dd740 10 client.15975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.787+0000 7fa0d45dd740 20 client.15975 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.787+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561653231d80 0x561653631fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.787+0000 7fa0d45dd740 4 client.15975 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:03:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.787+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa0c001c070 con 0x561653231d80 2024-09-21T03:03:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.788+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561653231d80 0x561653631fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.789+0000 7fa0aaff5640 10 client.15975 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.789+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561653231d80 0x561653631fc0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fd1a7dabb805b11 server_cookie=73776038f6c0ba29 in_seq=0 out_seq=0 2024-09-21T03:03:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.790+0000 7fa0aaff5640 1 -- 172.21.15.81:0/2825609773 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa0c001c070 con 0x561653231d80 2024-09-21T03:03:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.790+0000 7fa0aaff5640 10 client.15975 handle_command_reply: tid=0 2024-09-21T03:03:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.790+0000 7fa0d45dd740 1 client.15975 shutdown 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616532731b0 msgr2=0x561653625880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616532731b0 0x561653625880 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0c9c40 tx=0x7fa0bc030f90 comp rx=0 tx=0).stop 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 shutdown_connections 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x561653231d80 0x561653631fc0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616532731b0 0x561653625880 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x561653624d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/2825609773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x5616536246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0aaff5640 0 client.15975 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 >> 172.21.15.81:0/2825609773 conn(0x561653267300 msgr2=0x5616536174e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 shutdown_connections 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 1 -- 172.21.15.81:0/2825609773 wait complete. 2024-09-21T03:03:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.791+0000 7fa0d45dd740 20 client.15975 trim_cache size 0 max 16384 2024-09-21T03:03:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 Processor -- start 2024-09-21T03:03:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 -- start start 2024-09-21T03:03:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561653231d80 0x5616536232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x561653611630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x561653616220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c81acb70 con 0x561653231d80 2024-09-21T03:03:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c81aa440 con 0x5616532524d0 2024-09-21T03:03:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c81a8290 con 0x56165324a2f0 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0c6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561653231d80 0x5616536232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0c6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561653231d80 0x5616536232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32898/0 (socket says 172.21.15.81:32898) 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/1890337779 learned_addr learned my addr 172.21.15.81:0/1890337779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.813+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x561653611630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0c67fc640 1 -- 172.21.15.81:0/1890337779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 msgr2=0x561653616220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x561653616220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0c67fc640 1 -- 172.21.15.81:0/1890337779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561653231d80 msgr2=0x5616536232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561653231d80 0x5616536232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0c67fc640 1 -- 172.21.15.81:0/1890337779 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561653622850 con 0x56165324a2f0 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561653231d80 0x5616536232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:03:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x561653611630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8010c90 tx=0x7fa0b8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a86062a47e596af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:50.818 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.814+0000 7fa0acff9640 1 -- 172.21.15.81:0/1890337779 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8004cf0 con 0x56165324a2f0 2024-09-21T03:03:50.818 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.815+0000 7fa0acff9640 1 -- 172.21.15.81:0/1890337779 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0b800f8b0 con 0x56165324a2f0 2024-09-21T03:03:50.818 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.815+0000 7fa0acff9640 1 -- 172.21.15.81:0/1890337779 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b801c650 con 0x56165324a2f0 2024-09-21T03:03:50.818 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 -- 172.21.15.81:0/1890337779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 msgr2=0x561653611630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x561653611630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8010c90 tx=0x7fa0b8018000 comp rx=0 tx=0).stop 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 -- 172.21.15.81:0/1890337779 shutdown_connections 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56165324a2f0 0x561653611630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x561653616220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/1890337779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561653231d80 0x5616536232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 -- 172.21.15.81:0/1890337779 >> 172.21.15.81:0/1890337779 conn(0x561653267300 msgr2=0x561653622bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 -- 172.21.15.81:0/1890337779 shutdown_connections 2024-09-21T03:03:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.816+0000 7fa0d45dd740 1 -- 172.21.15.81:0/1890337779 wait complete. 2024-09-21T03:03:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.817+0000 7fa0d45dd740 1 -- start start 2024-09-21T03:03:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.817+0000 7fa0d45dd740 1 Processor -- start 2024-09-21T03:03:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.817+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561653231d80 0x56165362c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.817+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165362ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0d45dd740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165362b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c81a8900 con 0x56165324a2f0 2024-09-21T03:03:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c81a9d70 con 0x5616532524d0 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0d45dd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c81a8fd0 con 0x561653231d80 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561653231d80 0x56165362c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561653231d80 0x56165362c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.81:44284/0 (socket says 172.21.15.81:44284) 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/53915981 learned_addr learned my addr 172.21.15.81:0/53915981 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c77fe640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165362b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165362ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0d45dd740 10 client.0 _ll_register_callbacks cb 0x7fa0bc033d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 msgr2=0x56165362b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165362b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/53915981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 msgr2=0x56165362ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165362ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c6ffd640 1 -- 172.21.15.81:0/53915981 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165362bb60 con 0x561653231d80 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165362ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.818+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b800f8b0 con 0x561653231d80 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.819+0000 7fa0c6ffd640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561653231d80 0x56165362c070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006010 tx=0x7fa0c000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187d0fff1356b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.819+0000 7fa0aaff5640 10 client.25393 ms_handle_connect on v2:172.21.15.181:3300/0 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.819+0000 7fa0aaff5640 1 -- 172.21.15.81:0/53915981 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000dce0 con 0x561653231d80 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.819+0000 7fa0aaff5640 1 -- 172.21.15.81:0/53915981 <== mon.1 v2:172.21.15.181:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fa0c0017420 con 0x561653231d80 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.819+0000 7fa0aaff5640 1 -- 172.21.15.81:0/53915981 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa0c0017660 con 0x561653231d80 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.819+0000 7fa0d45dd740 10 client.25393 fetch_fsmap learned FSMap version 26 2024-09-21T03:03:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.819+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56165369c9b0 con 0x561653231d80 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0aaff5640 1 -- 172.21.15.81:0/53915981 <== mon.1 v2:172.21.15.181:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fa0c000b040 con 0x561653231d80 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0d45dd740 10 client.25393 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0d45dd740 10 client.25393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0d45dd740 20 client.25393 populate_metadata read hostname 'smithi081' 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5616532731b0 0x56165369efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0d45dd740 4 client.25393 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56165358f640 con 0x5616532731b0 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5616532731b0 0x56165369efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:03:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0aaff5640 10 client.25393 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.820+0000 7fa0c67fc640 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5616532731b0 0x56165369efd0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8221aa84d7ff68d3 server_cookie=2f512b12b6819eae in_seq=0 out_seq=0 2024-09-21T03:03:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0aaff5640 1 -- 172.21.15.81:0/53915981 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56165358f640 con 0x5616532731b0 2024-09-21T03:03:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0aaff5640 10 client.25393 handle_command_reply: tid=0 2024-09-21T03:03:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 client.25393 shutdown 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561653231d80 msgr2=0x56165362c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561653231d80 0x56165362c070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006010 tx=0x7fa0c000d460 comp rx=0 tx=0).stop 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 shutdown_connections 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x5616532731b0 0x56165369efd0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5616532524d0 0x56165362b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0aaff5640 0 client.25393 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56165324a2f0 0x56165362ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 --2- 172.21.15.81:0/53915981 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561653231d80 0x56165362c070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 >> 172.21.15.81:0/53915981 conn(0x561653267300 msgr2=0x5616536115c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 shutdown_connections 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.835+0000 7fa0d45dd740 1 -- 172.21.15.81:0/53915981 wait complete. 2024-09-21T03:03:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.836+0000 7fa0d45dd740 20 client.25393 trim_cache size 0 max 16384 2024-09-21T03:03:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:03:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:03:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:03:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:03:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0b00b6590 msgr2=0x7fa0b00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0b00b6590 0x7fa0b00b8aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80058c0 tx=0x7fa0b8012040 comp rx=0 tx=0).stop 2024-09-21T03:03:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 msgr2=0x7fa0c810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:03:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810b910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc005930 tx=0x7fa0bc0307d0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 shutdown_connections 2024-09-21T03:03:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fa0b00b6590 0x7fa0b00b8aa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa0c8103fc0 0x7fa0c810b910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0c8103620 0x7fa0c810b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 --2- 172.21.15.81:0/4038458152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa0c81025a0 0x7fa0c810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:03:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 >> 172.21.15.81:0/4038458152 conn(0x7fa0c80fdee0 msgr2=0x7fa0c8106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:03:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 shutdown_connections 2024-09-21T03:03:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:03:50.837+0000 7fa0cd590640 1 -- 172.21.15.81:0/4038458152 wait complete. 2024-09-21T03:03:51.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:51 smithi164 ceph-mon[34236]: pgmap v463: 129 pgs: 129 active+clean; 1.7 GiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 65 MiB/s wr, 23 op/s 2024-09-21T03:03:51.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:51 smithi181 ceph-mon[34096]: pgmap v463: 129 pgs: 129 active+clean; 1.7 GiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 65 MiB/s wr, 23 op/s 2024-09-21T03:03:52.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:51 smithi081 ceph-mon[30991]: pgmap v463: 129 pgs: 129 active+clean; 1.7 GiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 65 MiB/s wr, 23 op/s 2024-09-21T03:03:53.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:53 smithi164 ceph-mon[34236]: pgmap v464: 129 pgs: 129 active+clean; 3.4 GiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 211 MiB/s wr, 62 op/s 2024-09-21T03:03:53.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:53 smithi181 ceph-mon[34096]: pgmap v464: 129 pgs: 129 active+clean; 3.4 GiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 211 MiB/s wr, 62 op/s 2024-09-21T03:03:54.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:53 smithi081 ceph-mon[30991]: pgmap v464: 129 pgs: 129 active+clean; 3.4 GiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 211 MiB/s wr, 62 op/s 2024-09-21T03:03:55.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:55 smithi164 ceph-mon[34236]: pgmap v465: 129 pgs: 129 active+clean; 3.8 GiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 244 MiB/s wr, 67 op/s 2024-09-21T03:03:55.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:55 smithi181 ceph-mon[34096]: pgmap v465: 129 pgs: 129 active+clean; 3.8 GiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 244 MiB/s wr, 67 op/s 2024-09-21T03:03:56.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:55 smithi081 ceph-mon[30991]: pgmap v465: 129 pgs: 129 active+clean; 3.8 GiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 244 MiB/s wr, 67 op/s 2024-09-21T03:03:57.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:57 smithi164 ceph-mon[34236]: pgmap v466: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 363 MiB/s wr, 100 op/s 2024-09-21T03:03:57.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:57 smithi181 ceph-mon[34096]: pgmap v466: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 363 MiB/s wr, 100 op/s 2024-09-21T03:03:58.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:57 smithi081 ceph-mon[30991]: pgmap v466: 129 pgs: 129 active+clean; 5.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 363 MiB/s wr, 100 op/s 2024-09-21T03:03:59.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:03:59 smithi164 ceph-mon[34236]: pgmap v467: 129 pgs: 129 active+clean; 6.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 477 MiB/s wr, 128 op/s 2024-09-21T03:03:59.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:03:59 smithi181 ceph-mon[34096]: pgmap v467: 129 pgs: 129 active+clean; 6.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 477 MiB/s wr, 128 op/s 2024-09-21T03:04:00.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:03:59 smithi081 ceph-mon[30991]: pgmap v467: 129 pgs: 129 active+clean; 6.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 477 MiB/s wr, 128 op/s 2024-09-21T03:04:01.396 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:04:01.396 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 initial writers = 237593.50 kB/sec 2024-09-21T03:04:01.396 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 initial writers = 237592.31 kB/sec 2024-09-21T03:04:01.396 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 237593.50 kB/sec 2024-09-21T03:04:01.396 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 237593.50 kB/sec 2024-09-21T03:04:01.396 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 237593.50 kB/sec 2024-09-21T03:04:01.396 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 10485760.00 kB 2024-09-21T03:04:01.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:01 smithi164 ceph-mon[34236]: pgmap v468: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 561 MiB/s wr, 148 op/s 2024-09-21T03:04:01.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:01 smithi181 ceph-mon[34096]: pgmap v468: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 561 MiB/s wr, 148 op/s 2024-09-21T03:04:02.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:01 smithi081 ceph-mon[30991]: pgmap v468: 129 pgs: 129 active+clean; 7.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 561 MiB/s wr, 148 op/s 2024-09-21T03:04:03.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:03 smithi164 ceph-mon[34236]: pgmap v469: 129 pgs: 129 active+clean; 9.3 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 652 MiB/s wr, 173 op/s 2024-09-21T03:04:03.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 -- 172.21.15.81:0/492967125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc360106850 msgr2=0x7fc360108cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 --2- 172.21.15.81:0/492967125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc360106850 0x7fc360108cd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc348009900 tx=0x7fc34802a410 comp rx=0 tx=0).stop 2024-09-21T03:04:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 -- 172.21.15.81:0/492967125 shutdown_connections 2024-09-21T03:04:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 --2- 172.21.15.81:0/492967125 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc360109410 0x7fc36010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 --2- 172.21.15.81:0/492967125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc360106850 0x7fc360108cd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 --2- 172.21.15.81:0/492967125 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc36006c4b0 0x7fc360106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 -- 172.21.15.81:0/492967125 >> 172.21.15.81:0/492967125 conn(0x7fc3600fdf30 msgr2=0x7fc3601003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 -- 172.21.15.81:0/492967125 shutdown_connections 2024-09-21T03:04:03.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.951+0000 7fc364f20640 1 -- 172.21.15.81:0/492967125 wait complete. 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 Processor -- start 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 -- start start 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc36006c4b0 0x7fc360199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc360106850 0x7fc36019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc360109410 0x7fc36019b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc36010f1d0 con 0x7fc36006c4b0 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc36010f050 con 0x7fc360109410 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc364f20640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc36010f350 con 0x7fc360106850 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc36006c4b0 0x7fc360199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.958 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc36006c4b0 0x7fc360199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33344/0 (socket says 172.21.15.81:33344) 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc35e59c640 1 -- 172.21.15.81:0/3353465152 learned_addr learned my addr 172.21.15.81:0/3353465152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc360109410 0x7fc36019b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc35e59c640 1 -- 172.21.15.81:0/3353465152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc360106850 msgr2=0x7fc36019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.952+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc360106850 0x7fc36019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc35e59c640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc360106850 0x7fc36019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc35e59c640 1 -- 172.21.15.81:0/3353465152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc360109410 msgr2=0x7fc36019b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc35e59c640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc360109410 0x7fc36019b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc35e59c640 1 -- 172.21.15.81:0/3353465152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36019b8f0 con 0x7fc36006c4b0 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc360106850 0x7fc36019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc360109410 0x7fc36019b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc35e59c640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc36006c4b0 0x7fc360199eb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc35000d950 tx=0x7fc35000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc3577fe640 1 -- 172.21.15.81:0/3353465152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350017070 con 0x7fc36006c4b0 2024-09-21T03:04:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36019bbe0 con 0x7fc36006c4b0 2024-09-21T03:04:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc3577fe640 1 -- 172.21.15.81:0/3353465152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc350009c30 con 0x7fc36006c4b0 2024-09-21T03:04:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc3577fe640 1 -- 172.21.15.81:0/3353465152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35000f620 con 0x7fc36006c4b0 2024-09-21T03:04:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.953+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3601a22d0 con 0x7fc36006c4b0 2024-09-21T03:04:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.955+0000 7fc36be8c740 1 Processor -- start 2024-09-21T03:04:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc36be8c740 1 -- start start 2024-09-21T03:04:03.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446dade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc3577fe640 1 -- 172.21.15.81:0/3353465152 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc350010460 con 0x7fc36006c4b0 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446dae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446daf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc36be8c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f446d206f0 con 0x55f4469e54d0 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc36be8c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f446d0fb20 con 0x55f4469dd2f0 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc36be8c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f446d13930 con 0x55f446a061b0 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446daf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446daf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33350/0 (socket says 172.21.15.81:33350) 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc35dd9b640 1 -- 172.21.15.81:0/1249634778 learned_addr learned my addr 172.21.15.81:0/1249634778 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446dade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.956+0000 7fc35e59c640 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446dae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc35dd9b640 1 -- 172.21.15.81:0/1249634778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 msgr2=0x55f446dade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446dade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc35dd9b640 1 -- 172.21.15.81:0/1249634778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 msgr2=0x55f446dae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446dae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc35dd9b640 1 -- 172.21.15.81:0/1249634778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f446cd5530 con 0x55f4469e54d0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446daf010 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc348006010 tx=0x7fc348031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42759d0d655edae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc3577fe640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc34c0b6510 0x7fc34c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc354ff9640 1 -- 172.21.15.81:0/1249634778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348035030 con 0x55f4469e54d0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc354ff9640 1 -- 172.21.15.81:0/1249634778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc348004030 con 0x55f4469e54d0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc354ff9640 1 -- 172.21.15.81:0/1249634778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348003af0 con 0x55f4469e54d0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc34c0b6510 0x7fc34c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.957+0000 7fc3577fe640 1 -- 172.21.15.81:0/3353465152 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fc3500e7330 con 0x7fc36006c4b0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 -- 172.21.15.81:0/1249634778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 msgr2=0x55f446daf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc34c0b6510 0x7fc34c0b8a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc358005fd0 tx=0x7fc358009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:03.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446daf010 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc348006010 tx=0x7fc348031630 comp rx=0 tx=0).stop 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 -- 172.21.15.81:0/1249634778 shutdown_connections 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446daf010 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446dae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1249634778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446dade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 -- 172.21.15.81:0/1249634778 >> 172.21.15.81:0/1249634778 conn(0x55f4469fa300 msgr2=0x55f446da98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 -- 172.21.15.81:0/1249634778 shutdown_connections 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 -- 172.21.15.81:0/1249634778 wait complete. 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.958+0000 7fc36be8c740 1 -- start start 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 1 Processor -- start 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4469e54d0 0x55f446db7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f446a061b0 0x55f446db8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f446c47ab0 con 0x55f4469dd2f0 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f446cb5730 con 0x55f446a061b0 2024-09-21T03:04:03.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x55f446dafad0 con 0x55f4469e54d0 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc36be8c740 10 client.0 _ll_register_callbacks cb 0x55f446d096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33364/0 (socket says 172.21.15.81:33364) 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 -- 172.21.15.81:0/1600198033 learned_addr learned my addr 172.21.15.81:0/1600198033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4469e54d0 0x55f446db7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 -- 172.21.15.81:0/1600198033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4469e54d0 msgr2=0x55f446db7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4469e54d0 0x55f446db7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f446a061b0 0x55f446db8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 -- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f446a061b0 msgr2=0x55f446db8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f446a061b0 0x55f446db8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 -- 172.21.15.81:0/1600198033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f446a71790 con 0x55f4469dd2f0 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4469e54d0 0x55f446db7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:03.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc35e59c640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db7560 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc3500e4af0 tx=0x7fc350010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae183b06b9382325 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.959+0000 7fc345ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc345ffb640 1 -- 172.21.15.81:0/1600198033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350020030 con 0x55f4469dd2f0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc345ffb640 1 -- 172.21.15.81:0/1600198033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fc3500a8ce0 con 0x55f4469dd2f0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc348004030 con 0x55f4469dd2f0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc345ffb640 1 -- 172.21.15.81:0/1600198033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc3500acf50 con 0x55f4469dd2f0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 10 client.15993 fetch_fsmap learned FSMap version 26 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f446aea620 con 0x55f4469dd2f0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc345ffb640 1 -- 172.21.15.81:0/1600198033 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc348004030 con 0x55f4469dd2f0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc345ffb640 1 -- 172.21.15.81:0/1600198033 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fc3500abe50 con 0x55f4469dd2f0 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 10 client.15993 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 10 client.15993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 20 client.15993 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f4469c4d80 0x55f446dc4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 4 client.15993 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.960+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f446d22640 con 0x55f4469c4d80 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.961+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f4469c4d80 0x55f446dc4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.961+0000 7fc345ffb640 10 client.15993 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.961+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f4469c4d80 0x55f446dc4cf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b46787d8a073d452 server_cookie=e36fe3bfffe6d0ee in_seq=0 out_seq=0 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc345ffb640 1 -- 172.21.15.81:0/1600198033 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f446d22640 con 0x55f4469c4d80 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc345ffb640 10 client.15993 handle_command_reply: tid=0 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 client.15993 shutdown 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 msgr2=0x55f446db7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db7560 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc3500e4af0 tx=0x7fc350010f70 comp rx=0 tx=0).stop 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 shutdown_connections 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f4469c4d80 0x55f446dc4cf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f4469e54d0 0x55f446db7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f446a061b0 0x55f446db8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc345ffb640 0 client.15993 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1600198033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db7560 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 >> 172.21.15.81:0/1600198033 conn(0x55f4469fa300 msgr2=0x55f446da7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 shutdown_connections 2024-09-21T03:04:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 1 -- 172.21.15.81:0/1600198033 wait complete. 2024-09-21T03:04:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.962+0000 7fc36be8c740 20 client.15993 trim_cache size 0 max 16384 2024-09-21T03:04:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.976+0000 7fc36be8c740 1 Processor -- start 2024-09-21T03:04:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.976+0000 7fc36be8c740 1 -- start start 2024-09-21T03:04:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469e54d0 0x55f446db6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446db6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc36be8c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601aeda0 con 0x55f4469dd2f0 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc36be8c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601ac670 con 0x55f4469e54d0 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc36be8c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601aa4c0 con 0x55f446a061b0 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33370/0 (socket says 172.21.15.81:33370) 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 -- 172.21.15.81:0/1695680522 learned_addr learned my addr 172.21.15.81:0/1695680522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 -- 172.21.15.81:0/1695680522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 msgr2=0x55f446db6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 --2- 172.21.15.81:0/1695680522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446db6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 -- 172.21.15.81:0/1695680522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469e54d0 msgr2=0x55f446db6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 --2- 172.21.15.81:0/1695680522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469e54d0 0x55f446db6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 -- 172.21.15.81:0/1695680522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f446db5720 con 0x55f4469dd2f0 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc35e59c640 1 --2- 172.21.15.81:0/1695680522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db5fc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ad110 tx=0x7fc3500e76c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b23f868808d84b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc347fff640 1 -- 172.21.15.81:0/1695680522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350098070 con 0x55f4469dd2f0 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc347fff640 1 -- 172.21.15.81:0/1695680522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3500ad880 con 0x55f4469dd2f0 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.977+0000 7fc347fff640 1 -- 172.21.15.81:0/1695680522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350020070 con 0x55f4469dd2f0 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 -- 172.21.15.81:0/1695680522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 msgr2=0x55f446db5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1695680522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db5fc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ad110 tx=0x7fc3500e76c0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 -- 172.21.15.81:0/1695680522 shutdown_connections 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1695680522 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446db6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1695680522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469e54d0 0x55f446db6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 --2- 172.21.15.81:0/1695680522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469dd2f0 0x55f446db5fc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 -- 172.21.15.81:0/1695680522 >> 172.21.15.81:0/1695680522 conn(0x55f4469fa300 msgr2=0x55f446daddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 -- 172.21.15.81:0/1695680522 shutdown_connections 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 -- 172.21.15.81:0/1695680522 wait complete. 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.978+0000 7fc36be8c740 1 -- start start 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 1 Processor -- start 2024-09-21T03:04:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446e2ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446e2b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446e2bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601aab30 con 0x55f4469e54d0 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601abfa0 con 0x55f4469dd2f0 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fc3601ab200 con 0x55f446a061b0 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc36be8c740 10 client.0 _ll_register_callbacks cb 0x7fc35000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446e2b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446e2b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33378/0 (socket says 172.21.15.81:33378) 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 -- 172.21.15.81:0/3933271561 learned_addr learned my addr 172.21.15.81:0/3933271561 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35e59c640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446e2ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 -- 172.21.15.81:0/3933271561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 msgr2=0x55f446e2bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446e2bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446e2bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 -- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 msgr2=0x55f446e2ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446e2ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 -- 172.21.15.81:0/3933271561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f446e2c620 con 0x55f4469e54d0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35e59c640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446e2ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35ed9d640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446e2bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc35dd9b640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446e2b350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc348005f70 tx=0x7fc348005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde23ba367ed5bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.979+0000 7fc345ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc345ffb640 1 -- 172.21.15.81:0/3933271561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348035040 con 0x55f4469e54d0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc345ffb640 1 -- 172.21.15.81:0/3933271561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fc348031d50 con 0x55f4469e54d0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3500ad880 con 0x55f4469e54d0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc345ffb640 1 -- 172.21.15.81:0/3933271561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc3480044a0 con 0x55f4469e54d0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 10 client.15999 fetch_fsmap learned FSMap version 26 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f446e33a50 con 0x55f4469e54d0 2024-09-21T03:04:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc345ffb640 1 -- 172.21.15.81:0/3933271561 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3500ad880 con 0x55f4469e54d0 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc345ffb640 1 -- 172.21.15.81:0/3933271561 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fc34803a040 con 0x55f4469e54d0 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 10 client.15999 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 20 client.15999 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f44699a1c0 0x55f446e36050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 4 client.15999 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f446d1e0f0 con 0x55f44699a1c0 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.980+0000 7fc35e59c640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f44699a1c0 0x55f446e36050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.981+0000 7fc345ffb640 10 client.15999 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.981+0000 7fc35e59c640 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f44699a1c0 0x55f446e36050 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=599c4c896259dec3 server_cookie=44e98c53ee52d991 in_seq=0 out_seq=0 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc345ffb640 1 -- 172.21.15.81:0/3933271561 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f446d1e0f0 con 0x55f44699a1c0 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc345ffb640 10 client.15999 handle_command_reply: tid=0 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 client.15999 shutdown 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 msgr2=0x55f446e2b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446e2b350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc348005f70 tx=0x7fc348005df0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 shutdown_connections 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x55f44699a1c0 0x55f446e36050 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f446a061b0 0x55f446e2bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f4469e54d0 0x55f446e2b350 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc345ffb640 0 client.15999 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 --2- 172.21.15.81:0/3933271561 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f4469dd2f0 0x55f446e2ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 >> 172.21.15.81:0/3933271561 conn(0x55f4469fa300 msgr2=0x55f446db5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 shutdown_connections 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 1 -- 172.21.15.81:0/3933271561 wait complete. 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.989+0000 7fc36be8c740 20 client.15999 trim_cache size 0 max 16384 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:04:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:04:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:04:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc34c0b6510 msgr2=0x7fc34c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc34c0b6510 0x7fc34c0b8a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc358005fd0 tx=0x7fc358009800 comp rx=0 tx=0).stop 2024-09-21T03:04:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc36006c4b0 msgr2=0x7fc360199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc36006c4b0 0x7fc360199eb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc35000d950 tx=0x7fc35000de10 comp rx=0 tx=0).stop 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 shutdown_connections 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fc34c0b6510 0x7fc34c0b8a20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc360106850 0x7fc36019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc360109410 0x7fc36019b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 --2- 172.21.15.81:0/3353465152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc36006c4b0 0x7fc360199eb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 >> 172.21.15.81:0/3353465152 conn(0x7fc3600fdf30 msgr2=0x7fc360104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 shutdown_connections 2024-09-21T03:04:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:03.990+0000 7fc364f20640 1 -- 172.21.15.81:0/3353465152 wait complete. 2024-09-21T03:04:03.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:03 smithi181 ceph-mon[34096]: pgmap v469: 129 pgs: 129 active+clean; 9.3 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 652 MiB/s wr, 173 op/s 2024-09-21T03:04:04.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:03 smithi081 ceph-mon[30991]: pgmap v469: 129 pgs: 129 active+clean; 9.3 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 652 MiB/s wr, 173 op/s 2024-09-21T03:04:05.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:05 smithi164 ceph-mon[34236]: pgmap v470: 129 pgs: 129 active+clean; 9.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 528 MiB/s wr, 139 op/s 2024-09-21T03:04:05.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:05 smithi181 ceph-mon[34096]: pgmap v470: 129 pgs: 129 active+clean; 9.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 528 MiB/s wr, 139 op/s 2024-09-21T03:04:06.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:05 smithi081 ceph-mon[30991]: pgmap v470: 129 pgs: 129 active+clean; 9.6 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 528 MiB/s wr, 139 op/s 2024-09-21T03:04:07.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:07 smithi164 ceph-mon[34236]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 536 MiB/s wr, 143 op/s 2024-09-21T03:04:07.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:07 smithi181 ceph-mon[34096]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 536 MiB/s wr, 143 op/s 2024-09-21T03:04:08.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:07 smithi081 ceph-mon[30991]: pgmap v471: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 536 MiB/s wr, 143 op/s 2024-09-21T03:04:09.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:09 smithi164 ceph-mon[34236]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 444 MiB/s wr, 119 op/s 2024-09-21T03:04:09.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:09 smithi181 ceph-mon[34096]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 444 MiB/s wr, 119 op/s 2024-09-21T03:04:10.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:09 smithi081 ceph-mon[30991]: pgmap v472: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 444 MiB/s wr, 119 op/s 2024-09-21T03:04:11.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:11 smithi164 ceph-mon[34236]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 416 MiB/s wr, 112 op/s 2024-09-21T03:04:11.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:11 smithi181 ceph-mon[34096]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 416 MiB/s wr, 112 op/s 2024-09-21T03:04:12.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:11 smithi081 ceph-mon[30991]: pgmap v473: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 416 MiB/s wr, 112 op/s 2024-09-21T03:04:13.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:13 smithi164 ceph-mon[34236]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 491 MiB/s wr, 132 op/s 2024-09-21T03:04:13.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:13 smithi181 ceph-mon[34096]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 491 MiB/s wr, 132 op/s 2024-09-21T03:04:14.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:13 smithi081 ceph-mon[30991]: pgmap v474: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 491 MiB/s wr, 132 op/s 2024-09-21T03:04:15.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:15 smithi181 ceph-mon[34096]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 380 MiB/s wr, 102 op/s 2024-09-21T03:04:16.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:15 smithi081 ceph-mon[30991]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 380 MiB/s wr, 102 op/s 2024-09-21T03:04:16.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:15 smithi164 ceph-mon[34236]: pgmap v475: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 380 MiB/s wr, 102 op/s 2024-09-21T03:04:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.157+0000 7f3f54f8b640 1 -- 172.21.15.81:0/206147483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 msgr2=0x7f3f5010b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.157+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/206147483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5010b8e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009c90 tx=0x7f3f4802a860 comp rx=0 tx=0).stop 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.157+0000 7f3f54f8b640 1 -- 172.21.15.81:0/206147483 shutdown_connections 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.157+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/206147483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5010b8e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.157+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/206147483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f501068c0 0x7f3f50108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.157+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/206147483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5006b670 0x7f3f50106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.157+0000 7f3f54f8b640 1 -- 172.21.15.81:0/206147483 >> 172.21.15.81:0/206147483 conn(0x7f3f500fdee0 msgr2=0x7f3f50100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.158+0000 7f3f54f8b640 1 -- 172.21.15.81:0/206147483 shutdown_connections 2024-09-21T03:04:17.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.158+0000 7f3f54f8b640 1 -- 172.21.15.81:0/206147483 wait complete. 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.159+0000 7f3f54f8b640 1 Processor -- start 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.159+0000 7f3f54f8b640 1 -- start start 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f54f8b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f5006b670 0x7f3f5019c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f54f8b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f501068c0 0x7f3f5019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f54f8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5019d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f54f8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5010f190 con 0x7f3f501093d0 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f54f8b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5010f010 con 0x7f3f5006b670 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f4ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5019d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f4ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5019d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45434/0 (socket says 172.21.15.81:45434) 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f54f8b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5010f310 con 0x7f3f501068c0 2024-09-21T03:04:17.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f4ed9d640 1 -- 172.21.15.81:0/1050207437 learned_addr learned my addr 172.21.15.81:0/1050207437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.160+0000 7f3f47fff640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f501068c0 0x7f3f5019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.161+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f5006b670 0x7f3f5019c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.161+0000 7f3f4ed9d640 1 -- 172.21.15.81:0/1050207437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f501068c0 msgr2=0x7f3f5019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.161+0000 7f3f4ed9d640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f501068c0 0x7f3f5019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.161+0000 7f3f4ed9d640 1 -- 172.21.15.81:0/1050207437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f5006b670 msgr2=0x7f3f5019c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.161+0000 7f3f4ed9d640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f5006b670 0x7f3f5019c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.161+0000 7f3f4ed9d640 1 -- 172.21.15.81:0/1050207437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5019dad0 con 0x7f3f501093d0 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.161+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f5006b670 0x7f3f5019c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:17.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.162+0000 7f3f4ed9d640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5019d2b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3f480011e0 tx=0x7f3f48032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.163+0000 7f3f477fe640 1 -- 172.21.15.81:0/1050207437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48003dd0 con 0x7f3f501093d0 2024-09-21T03:04:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.164+0000 7f3f477fe640 1 -- 172.21.15.81:0/1050207437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f48040070 con 0x7f3f501093d0 2024-09-21T03:04:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.164+0000 7f3f477fe640 1 -- 172.21.15.81:0/1050207437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f480307c0 con 0x7f3f501093d0 2024-09-21T03:04:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.164+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5019dd60 con 0x7f3f501093d0 2024-09-21T03:04:17.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.164+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f50194870 con 0x7f3f501093d0 2024-09-21T03:04:17.170 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.168+0000 7f3f5bfd4740 1 Processor -- start 2024-09-21T03:04:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.169+0000 7f3f477fe640 1 -- 172.21.15.81:0/1050207437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3f48030960 con 0x7f3f501093d0 2024-09-21T03:04:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.170+0000 7f3f5bfd4740 1 -- start start 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.170+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786b191b0 0x557786ec0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.170+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af02f0 0x557786ec14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.170+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af84d0 0x557786ec1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.170+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557786e336f0 con 0x557786af02f0 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.170+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557786e22b20 con 0x557786b191b0 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.170+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557786e26930 con 0x557786af84d0 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.171+0000 7f3f477fe640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3f300bee70 0x7f3f300c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.171+0000 7f3f477fe640 1 -- 172.21.15.81:0/1050207437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f3f48108530 con 0x7f3f501093d0 2024-09-21T03:04:17.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.171+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786b191b0 0x557786ec0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.171+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786b191b0 0x557786ec0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:39998/0 (socket says 172.21.15.81:39998) 2024-09-21T03:04:17.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.171+0000 7f3f47fff640 1 -- 172.21.15.81:0/782727000 learned_addr learned my addr 172.21.15.81:0/782727000 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:17.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.171+0000 7f3f47fff640 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af84d0 0x557786ec1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.173 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.171+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af02f0 0x557786ec14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f4ed9d640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3f300bee70 0x7f3f300c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f4e59c640 1 -- 172.21.15.81:0/782727000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af84d0 msgr2=0x557786ec1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af84d0 0x557786ec1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f4e59c640 1 -- 172.21.15.81:0/782727000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786b191b0 msgr2=0x557786ec0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786b191b0 0x557786ec0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f4e59c640 1 -- 172.21.15.81:0/782727000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557786de8530 con 0x557786af02f0 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f47fff640 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786b191b0 0x557786ec0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:04:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.172+0000 7f3f4ed9d640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3f300bee70 0x7f3f300c1380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009250 tx=0x7f3f48032eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.173+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af02f0 0x557786ec14a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000bc80 tx=0x7f3f4000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377e8df74d3b6c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.173+0000 7f3f44ff9640 1 -- 172.21.15.81:0/782727000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40015070 con 0x557786af02f0 2024-09-21T03:04:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.173+0000 7f3f44ff9640 1 -- 172.21.15.81:0/782727000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f400118d0 con 0x557786af02f0 2024-09-21T03:04:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.173+0000 7f3f44ff9640 1 -- 172.21.15.81:0/782727000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400106c0 con 0x557786af02f0 2024-09-21T03:04:17.176 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.174+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/782727000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af02f0 msgr2=0x557786ec14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.176 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.174+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af02f0 0x557786ec14a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000bc80 tx=0x7f3f4000f730 comp rx=0 tx=0).stop 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.175+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/782727000 shutdown_connections 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.175+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af84d0 0x557786ec1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.175+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af02f0 0x557786ec14a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.175+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/782727000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786b191b0 0x557786ec0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.175+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/782727000 >> 172.21.15.81:0/782727000 conn(0x557786b0d300 msgr2=0x557786ebc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.175+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/782727000 shutdown_connections 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.175+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/782727000 wait complete. 2024-09-21T03:04:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 -- start start 2024-09-21T03:04:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 Processor -- start 2024-09-21T03:04:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786eca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786ecad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b191b0 0x557786ecb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557786d5aab0 con 0x557786b191b0 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557786dc8730 con 0x557786af84d0 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557786ec2b10 con 0x557786af02f0 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.176+0000 7f3f5bfd4740 10 client.0 _ll_register_callbacks cb 0x557786e1c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f4e59c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786ecad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b191b0 0x557786ecb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b191b0 0x557786ecb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45442/0 (socket says 172.21.15.81:45442) 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 -- 172.21.15.81:0/3729136540 learned_addr learned my addr 172.21.15.81:0/3729136540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 -- 172.21.15.81:0/3729136540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 msgr2=0x557786eca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786eca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 -- 172.21.15.81:0/3729136540 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 msgr2=0x557786ecad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786ecad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.177+0000 7f3f47fff640 1 -- 172.21.15.81:0/3729136540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557786b84790 con 0x557786b191b0 2024-09-21T03:04:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.178+0000 7f3f47fff640 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b191b0 0x557786ecb870 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009f60 tx=0x7f3f38010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5287015ef11b47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.178+0000 7f3f3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.178+0000 7f3f3dffb640 1 -- 172.21.15.81:0/3729136540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38004250 con 0x557786b191b0 2024-09-21T03:04:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.178+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f400118d0 con 0x557786b191b0 2024-09-21T03:04:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.178+0000 7f3f3dffb640 1 -- 172.21.15.81:0/3729136540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f3f380043f0 con 0x557786b191b0 2024-09-21T03:04:17.183 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.179+0000 7f3f3dffb640 1 -- 172.21.15.81:0/3729136540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3f38028050 con 0x557786b191b0 2024-09-21T03:04:17.183 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.179+0000 7f3f5bfd4740 10 client.16011 fetch_fsmap learned FSMap version 26 2024-09-21T03:04:17.183 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.179+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557786bfd620 con 0x557786b191b0 2024-09-21T03:04:17.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.181+0000 7f3f3dffb640 1 -- 172.21.15.81:0/3729136540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f400118d0 con 0x557786b191b0 2024-09-21T03:04:17.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.182+0000 7f3f3dffb640 1 -- 172.21.15.81:0/3729136540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f3f380224f0 con 0x557786b191b0 2024-09-21T03:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.184+0000 7f3f5bfd4740 10 client.16011 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.184+0000 7f3f5bfd4740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.184+0000 7f3f5bfd4740 20 client.16011 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.184+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786ad7d80 0x557786ed7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.184+0000 7f3f5bfd4740 4 client.16011 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:04:17.188 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.184+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557786e35640 con 0x557786ad7d80 2024-09-21T03:04:17.188 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.185+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786ad7d80 0x557786ed7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.187+0000 7f3f3dffb640 10 client.16011 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:17.189 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.187+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786ad7d80 0x557786ed7dc0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edbe2ef40b043488 server_cookie=19cdc91b43659092 in_seq=0 out_seq=0 2024-09-21T03:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.188+0000 7f3f3dffb640 1 -- 172.21.15.81:0/3729136540 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557786e35640 con 0x557786ad7d80 2024-09-21T03:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.188+0000 7f3f3dffb640 10 client.16011 handle_command_reply: tid=0 2024-09-21T03:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.188+0000 7f3f5bfd4740 1 client.16011 shutdown 2024-09-21T03:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.188+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b191b0 msgr2=0x557786ecb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.188+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b191b0 0x557786ecb870 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009f60 tx=0x7f3f38010800 comp rx=0 tx=0).stop 2024-09-21T03:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.188+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 shutdown_connections 2024-09-21T03:04:17.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.188+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786ad7d80 0x557786ed7dc0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b191b0 0x557786ecb870 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786ecad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/3729136540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786eca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 >> 172.21.15.81:0/3729136540 conn(0x557786b0d300 msgr2=0x557786ebaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f3dffb640 0 client.16011 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 shutdown_connections 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/3729136540 wait complete. 2024-09-21T03:04:17.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.190+0000 7f3f5bfd4740 20 client.16011 trim_cache size 0 max 16384 2024-09-21T03:04:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.220+0000 7f3f5bfd4740 1 Processor -- start 2024-09-21T03:04:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.222+0000 7f3f5bfd4740 1 -- start start 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b0d300 0x557786ebc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786ec1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786eb75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f501acba0 con 0x557786b0d300 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3f501aa470 con 0x557786af84d0 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3f501a8300 con 0x557786af02f0 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786eb75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.223+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786eb75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:40002/0 (socket says 172.21.15.81:40002) 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f47fff640 1 -- 172.21.15.81:0/1083003654 learned_addr learned my addr 172.21.15.81:0/1083003654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f47fff640 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b0d300 0x557786ebc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786ec1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f4e59c640 1 -- 172.21.15.81:0/1083003654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 msgr2=0x557786eb75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786eb75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f4e59c640 1 -- 172.21.15.81:0/1083003654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b0d300 msgr2=0x557786ebc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b0d300 0x557786ebc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.224+0000 7f3f4e59c640 1 -- 172.21.15.81:0/1083003654 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557786ec87c0 con 0x557786af02f0 2024-09-21T03:04:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.225+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786ec1cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000ba40 tx=0x7f3f4000bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c87c7f7229378b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.225+0000 7f3f3ffff640 1 -- 172.21.15.81:0/1083003654 <== mon.1 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40032070 con 0x557786af02f0 2024-09-21T03:04:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.226+0000 7f3f3ffff640 1 -- 172.21.15.81:0/1083003654 <== mon.1 v2:172.21.15.181:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f400054a0 con 0x557786af02f0 2024-09-21T03:04:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.226+0000 7f3f3ffff640 1 -- 172.21.15.81:0/1083003654 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40015040 con 0x557786af02f0 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/1083003654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 msgr2=0x557786ec1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786ec1cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000ba40 tx=0x7f3f4000bef0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/1083003654 shutdown_connections 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786af02f0 0x557786ec1cc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af84d0 0x557786eb75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/1083003654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786b0d300 0x557786ebc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/1083003654 >> 172.21.15.81:0/1083003654 conn(0x557786ed80f0 msgr2=0x557786ec8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/1083003654 shutdown_connections 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.227+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/1083003654 wait complete. 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 -- start start 2024-09-21T03:04:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 Processor -- start 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af02f0 0x557786ed2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af84d0 0x557786ed0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786b0d300 0x557786ed1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f501a8950 con 0x557786af84d0 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3f501a9da0 con 0x557786af02f0 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3f501a9000 con 0x557786b0d300 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.228+0000 7f3f5bfd4740 10 client.0 _ll_register_callbacks cb 0x7f3f38009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.229+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af02f0 0x557786ed2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.229+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af02f0 0x557786ed2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:40018/0 (socket says 172.21.15.81:40018) 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.229+0000 7f3f4e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af84d0 0x557786ed0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.229+0000 7f3f47fff640 1 -- 172.21.15.81:0/2354069650 learned_addr learned my addr 172.21.15.81:0/2354069650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.229+0000 7f3f47fff640 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786b0d300 0x557786ed1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.229+0000 7f3f47fff640 1 -- 172.21.15.81:0/2354069650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786b0d300 msgr2=0x557786ed1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.229+0000 7f3f47fff640 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786b0d300 0x557786ed1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.230+0000 7f3f47fff640 1 -- 172.21.15.81:0/2354069650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af84d0 msgr2=0x557786ed0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.230+0000 7f3f47fff640 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af84d0 0x557786ed0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.230+0000 7f3f47fff640 1 -- 172.21.15.81:0/2354069650 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557786ed1850 con 0x557786af02f0 2024-09-21T03:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.230+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af84d0 0x557786ed0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.230+0000 7f3f47fff640 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af02f0 0x557786ed2110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009c90 tx=0x7f3f38005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973bff976b275f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.230+0000 7f3f3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.231+0000 7f3f3dffb640 1 -- 172.21.15.81:0/2354069650 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38022420 con 0x557786af02f0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.231+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f400054a0 con 0x557786af02f0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.231+0000 7f3f3dffb640 1 -- 172.21.15.81:0/2354069650 <== mon.2 v2:172.21.15.164:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f3f380225c0 con 0x557786af02f0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.231+0000 7f3f3dffb640 1 -- 172.21.15.81:0/2354069650 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3f38040050 con 0x557786af02f0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.231+0000 7f3f5bfd4740 10 client.25502 fetch_fsmap learned FSMap version 26 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.231+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557786ed0610 con 0x557786af02f0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f3dffb640 1 -- 172.21.15.81:0/2354069650 <== mon.2 v2:172.21.15.164:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f400054a0 con 0x557786af02f0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f3dffb640 1 -- 172.21.15.81:0/2354069650 <== mon.2 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f3f38003840 con 0x557786af02f0 2024-09-21T03:04:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f5bfd4740 10 client.25502 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T03:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f5bfd4740 10 client.25502 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f5bfd4740 20 client.25502 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786b191b0 0x557786f44d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f5bfd4740 4 client.25502 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.232+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557786e310f0 con 0x557786b191b0 2024-09-21T03:04:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.233+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786b191b0 0x557786f44d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.235+0000 7f3f3dffb640 10 client.25502 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.235+0000 7f3f4e59c640 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786b191b0 0x557786f44d80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cba1031a412b3fc server_cookie=3911a69d875d7fdd in_seq=0 out_seq=0 2024-09-21T03:04:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.248+0000 7f3f3dffb640 1 -- 172.21.15.81:0/2354069650 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557786e310f0 con 0x557786b191b0 2024-09-21T03:04:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.248+0000 7f3f3dffb640 10 client.25502 handle_command_reply: tid=0 2024-09-21T03:04:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.248+0000 7f3f5bfd4740 1 client.25502 shutdown 2024-09-21T03:04:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af02f0 msgr2=0x557786ed2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af02f0 0x557786ed2110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009c90 tx=0x7f3f38005040 comp rx=0 tx=0).stop 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 shutdown_connections 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557786b191b0 0x557786f44d80 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557786b0d300 0x557786ed1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557786af84d0 0x557786ed0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 --2- 172.21.15.81:0/2354069650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557786af02f0 0x557786ed2110 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009c90 tx=0x7f3f38005040 comp rx=0 tx=0).stop 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 >> 172.21.15.81:0/2354069650 conn(0x557786ed80f0 msgr2=0x557786eb75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f3dffb640 0 client.25502 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.249+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 shutdown_connections 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.250+0000 7f3f5bfd4740 1 -- 172.21.15.81:0/2354069650 wait complete. 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.250+0000 7f3f5bfd4740 20 client.25502 trim_cache size 0 max 16384 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:04:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:04:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:04:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:04:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.251+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3f300bee70 msgr2=0x7f3f300c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.251+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3f300bee70 0x7f3f300c1380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009250 tx=0x7f3f48032eb0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.251+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 msgr2=0x7f3f5019d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.251+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5019d2b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3f480011e0 tx=0x7f3f48032cc0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 shutdown_connections 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3f300bee70 0x7f3f300c1380 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f501068c0 0x7f3f5019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f501093d0 0x7f3f5019d2b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 --2- 172.21.15.81:0/1050207437 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f5006b670 0x7f3f5019c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 >> 172.21.15.81:0/1050207437 conn(0x7f3f500fdee0 msgr2=0x7f3f50100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 shutdown_connections 2024-09-21T03:04:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:17.252+0000 7f3f54f8b640 1 -- 172.21.15.81:0/1050207437 wait complete. 2024-09-21T03:04:17.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:17 smithi181 ceph-mon[34096]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 488 MiB/s wr, 130 op/s 2024-09-21T03:04:18.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:17 smithi081 ceph-mon[30991]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 488 MiB/s wr, 130 op/s 2024-09-21T03:04:18.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:17 smithi164 ceph-mon[34236]: pgmap v476: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 488 MiB/s wr, 130 op/s 2024-09-21T03:04:19.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:19 smithi181 ceph-mon[34096]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 572 MiB/s wr, 149 op/s 2024-09-21T03:04:20.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:19 smithi081 ceph-mon[30991]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 572 MiB/s wr, 149 op/s 2024-09-21T03:04:20.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:19 smithi164 ceph-mon[34236]: pgmap v477: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 572 MiB/s wr, 149 op/s 2024-09-21T03:04:20.506 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:04:20.506 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 rewriters = 687881.69 kB/sec 2024-09-21T03:04:20.506 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 rewriters = 687870.12 kB/sec 2024-09-21T03:04:20.506 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 687881.69 kB/sec 2024-09-21T03:04:20.506 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 687881.69 kB/sec 2024-09-21T03:04:20.506 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 687881.69 kB/sec 2024-09-21T03:04:20.506 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 10485760.00 kB 2024-09-21T03:04:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:04:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:04:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:04:20.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:04:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:04:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:04:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:04:21.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:04:21.082 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:04:21.082 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:04:21.082 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:04:21.083 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:04:21.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:21 smithi181 ceph-mon[34096]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 647 MiB/s wr, 167 op/s 2024-09-21T03:04:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:21 smithi081 ceph-mon[30991]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 647 MiB/s wr, 167 op/s 2024-09-21T03:04:22.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:21 smithi164 ceph-mon[34236]: pgmap v478: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 647 MiB/s wr, 167 op/s 2024-09-21T03:04:23.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:23 smithi181 ceph-mon[34096]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 703 MiB/s wr, 183 op/s 2024-09-21T03:04:24.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:23 smithi081 ceph-mon[30991]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 703 MiB/s wr, 183 op/s 2024-09-21T03:04:24.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:23 smithi164 ceph-mon[34236]: pgmap v479: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 703 MiB/s wr, 183 op/s 2024-09-21T03:04:25.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:25 smithi181 ceph-mon[34096]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 550 MiB/s wr, 143 op/s 2024-09-21T03:04:26.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:25 smithi081 ceph-mon[30991]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 550 MiB/s wr, 143 op/s 2024-09-21T03:04:26.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:25 smithi164 ceph-mon[34236]: pgmap v480: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 550 MiB/s wr, 143 op/s 2024-09-21T03:04:26.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:26 smithi181 ceph-mon[34096]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:04:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:26 smithi081 ceph-mon[30991]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:04:27.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:26 smithi164 ceph-mon[34236]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:04:27.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:27 smithi181 ceph-mon[34096]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 530 MiB/s wr, 139 op/s 2024-09-21T03:04:28.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:27 smithi081 ceph-mon[30991]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 530 MiB/s wr, 139 op/s 2024-09-21T03:04:28.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:27 smithi164 ceph-mon[34236]: pgmap v481: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 530 MiB/s wr, 139 op/s 2024-09-21T03:04:29.998 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:29 smithi181 ceph-mon[34096]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 401 MiB/s wr, 106 op/s 2024-09-21T03:04:30.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:29 smithi081 ceph-mon[30991]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 401 MiB/s wr, 106 op/s 2024-09-21T03:04:30.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:29 smithi164 ceph-mon[34236]: pgmap v482: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 401 MiB/s wr, 106 op/s 2024-09-21T03:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 -- 172.21.15.81:0/2540152545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914108300 msgr2=0x7ff91410a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 --2- 172.21.15.81:0/2540152545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914108300 0x7ff91410a810 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009ca0 tx=0x7ff90c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 -- 172.21.15.81:0/2540152545 shutdown_connections 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 --2- 172.21.15.81:0/2540152545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914108300 0x7ff91410a810 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 --2- 172.21.15.81:0/2540152545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff9141056e0 0x7ff914107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 --2- 172.21.15.81:0/2540152545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff914102c80 0x7ff9141050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 -- 172.21.15.81:0/2540152545 >> 172.21.15.81:0/2540152545 conn(0x7ff9140fd6d0 msgr2=0x7ff9140ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 -- 172.21.15.81:0/2540152545 shutdown_connections 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.368+0000 7ff91a739640 1 -- 172.21.15.81:0/2540152545 wait complete. 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.369+0000 7ff91a739640 1 Processor -- start 2024-09-21T03:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.369+0000 7ff91a739640 1 -- start start 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff91a739640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914102c80 0x7ff914199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff91a739640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9141056e0 0x7ff91419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff91a739640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff914108300 0x7ff91419b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff91a739640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff91410f240 con 0x7ff914102c80 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff91a739640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff91410f0c0 con 0x7ff914108300 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff91a739640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff91410f3c0 con 0x7ff9141056e0 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914102c80 0x7ff914199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914102c80 0x7ff914199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41918/0 (socket says 172.21.15.81:41918) 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 -- 172.21.15.81:0/1980930567 learned_addr learned my addr 172.21.15.81:0/1980930567 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff9137fe640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9141056e0 0x7ff91419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff918cd6640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff914108300 0x7ff91419b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 -- 172.21.15.81:0/1980930567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9141056e0 msgr2=0x7ff91419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9141056e0 0x7ff91419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 -- 172.21.15.81:0/1980930567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff914108300 msgr2=0x7ff91419b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff914108300 0x7ff91419b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 -- 172.21.15.81:0/1980930567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91419b890 con 0x7ff914102c80 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff913fff640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914102c80 0x7ff914199e50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d770 tx=0x7ff90400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff9117fa640 1 -- 172.21.15.81:0/1980930567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904017070 con 0x7ff914102c80 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff9117fa640 1 -- 172.21.15.81:0/1980930567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9040054b0 con 0x7ff914102c80 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91419bb80 con 0x7ff914102c80 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.370+0000 7ff9117fa640 1 -- 172.21.15.81:0/1980930567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904004c60 con 0x7ff914102c80 2024-09-21T03:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.371+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9141a2270 con 0x7ff914102c80 2024-09-21T03:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.373+0000 7ff9216ab740 1 Processor -- start 2024-09-21T03:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.373+0000 7ff9216ab740 1 -- start start 2024-09-21T03:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b26e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b274c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b28010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9216ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562e08a996f0 con 0x562e0875e4d0 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9216ab740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x562e08a88b20 con 0x562e0877f1b0 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9216ab740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562e08a8c930 con 0x562e087562f0 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b28010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b28010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41928/0 (socket says 172.21.15.81:41928) 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 -- 172.21.15.81:0/2403602949 learned_addr learned my addr 172.21.15.81:0/2403602949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9117fa640 1 -- 172.21.15.81:0/1980930567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff904004e00 con 0x7ff914102c80 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff918cd6640 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b26e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 -- 172.21.15.81:0/2403602949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 msgr2=0x562e08b274c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b274c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 -- 172.21.15.81:0/2403602949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 msgr2=0x562e08b26e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b26e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 -- 172.21.15.81:0/2403602949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e08a4e530 con 0x562e0875e4d0 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.374+0000 7ff9137fe640 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b28010 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff90800bd10 tx=0x7ff9080107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe69e6dfbbcdaa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff8fa7fc640 1 -- 172.21.15.81:0/2403602949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908004030 con 0x562e0875e4d0 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff8fa7fc640 1 -- 172.21.15.81:0/2403602949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9080035f0 con 0x562e0875e4d0 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff8fa7fc640 1 -- 172.21.15.81:0/2403602949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908011660 con 0x562e0875e4d0 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff9117fa640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff8fc0b6510 0x7ff8fc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff918cd6640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff8fc0b6510 0x7ff8fc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff9117fa640 1 -- 172.21.15.81:0/1980930567 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ff9040e6fe0 con 0x7ff914102c80 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff9216ab740 1 -- 172.21.15.81:0/2403602949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 msgr2=0x562e08b28010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b28010 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff90800bd10 tx=0x7ff9080107a0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.375+0000 7ff918cd6640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff8fc0b6510 0x7ff8fc0b8a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0094e0 tx=0x7ff90c031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 -- 172.21.15.81:0/2403602949 shutdown_connections 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b274c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b28010 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2403602949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b26e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 -- 172.21.15.81:0/2403602949 >> 172.21.15.81:0/2403602949 conn(0x562e08773300 msgr2=0x562e08b228e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 -- 172.21.15.81:0/2403602949 shutdown_connections 2024-09-21T03:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 -- 172.21.15.81:0/2403602949 wait complete. 2024-09-21T03:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 -- start start 2024-09-21T03:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.376+0000 7ff9216ab740 1 Processor -- start 2024-09-21T03:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b30610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b30cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0877f1b0 0x562e08b31840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562e089c0ab0 con 0x562e0875e4d0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x562e08a2e730 con 0x562e087562f0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x562e08b28b30 con 0x562e0877f1b0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 10 client.0 _ll_register_callbacks cb 0x562e08a826b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b30cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b30cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41942/0 (socket says 172.21.15.81:41942) 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 -- 172.21.15.81:0/2473952273 learned_addr learned my addr 172.21.15.81:0/2473952273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff913fff640 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b30610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff918cd6640 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0877f1b0 0x562e08b31840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 -- 172.21.15.81:0/2473952273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0877f1b0 msgr2=0x562e08b31840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0877f1b0 0x562e08b31840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 -- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 msgr2=0x562e08b30610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b30610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 -- 172.21.15.81:0/2473952273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e087ea790 con 0x562e0875e4d0 2024-09-21T03:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9137fe640 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b30cd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff90800bce0 tx=0x7ff9080039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310f63280e30d72f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff8f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff8f37fe640 1 -- 172.21.15.81:0/2473952273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908029060 con 0x562e0875e4d0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff8f37fe640 1 -- 172.21.15.81:0/2473952273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ff908004410 con 0x562e0875e4d0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.377+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9080035f0 con 0x562e0875e4d0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff8f37fe640 1 -- 172.21.15.81:0/2473952273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff908030050 con 0x562e0875e4d0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 10 client.16029 fetch_fsmap learned FSMap version 27 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e08863620 con 0x562e0875e4d0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff8f37fe640 1 -- 172.21.15.81:0/2473952273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9080035f0 con 0x562e0875e4d0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff8f37fe640 1 -- 172.21.15.81:0/2473952273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff908023030 con 0x562e0875e4d0 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 10 client.16029 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 20 client.16029 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e0873dd80 0x562e08b3da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 4 client.16029 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e08a9b640 con 0x562e0873dd80 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.378+0000 7ff913fff640 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e0873dd80 0x562e08b3da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.379+0000 7ff8f37fe640 10 client.16029 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.379+0000 7ff913fff640 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e0873dd80 0x562e08b3da30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe8988c174c063a9 server_cookie=f2555b96ba8e895c in_seq=0 out_seq=0 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff8f37fe640 1 -- 172.21.15.81:0/2473952273 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e08a9b640 con 0x562e0873dd80 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff8f37fe640 10 client.16029 handle_command_reply: tid=0 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 client.16029 shutdown 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 msgr2=0x562e08b30cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b30cd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff90800bce0 tx=0x7ff9080039d0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 shutdown_connections 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e0873dd80 0x562e08b3da30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0877f1b0 0x562e08b31840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b30cd0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff8f37fe640 0 client.16029 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 --2- 172.21.15.81:0/2473952273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b30610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 >> 172.21.15.81:0/2473952273 conn(0x562e08773300 msgr2=0x562e08b20ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 shutdown_connections 2024-09-21T03:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 1 -- 172.21.15.81:0/2473952273 wait complete. 2024-09-21T03:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.380+0000 7ff9216ab740 20 client.16029 trim_cache size 0 max 16384 2024-09-21T03:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 Processor -- start 2024-09-21T03:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 -- start start 2024-09-21T03:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b27c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0875e4d0 0x562e08b38720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0877f1b0 0x562e08b2eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141aee10 con 0x562e0877f1b0 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ac6e0 con 0x562e087562f0 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9216ab740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141aa530 con 0x562e0875e4d0 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0877f1b0 0x562e08b2eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0877f1b0 0x562e08b2eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41958/0 (socket says 172.21.15.81:41958) 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 -- 172.21.15.81:0/3820902950 learned_addr learned my addr 172.21.15.81:0/3820902950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff913fff640 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b27c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff9137fe640 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0875e4d0 0x562e08b38720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 -- 172.21.15.81:0/3820902950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0875e4d0 msgr2=0x562e08b38720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0875e4d0 0x562e08b38720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 -- 172.21.15.81:0/3820902950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 msgr2=0x562e08b27c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b27c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 -- 172.21.15.81:0/3820902950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e08b31bb0 con 0x562e0877f1b0 2024-09-21T03:04:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff913fff640 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b27c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.395+0000 7ff918cd6640 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0877f1b0 0x562e08b2eb20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff90c035000 tx=0x7ff90c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0057bc790191a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff8f9ffb640 1 -- 172.21.15.81:0/3820902950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0305c0 con 0x562e0877f1b0 2024-09-21T03:04:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff8f9ffb640 1 -- 172.21.15.81:0/3820902950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff90c036050 con 0x562e0877f1b0 2024-09-21T03:04:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff8f9ffb640 1 -- 172.21.15.81:0/3820902950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0498c0 con 0x562e0877f1b0 2024-09-21T03:04:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff9216ab740 1 -- 172.21.15.81:0/3820902950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0877f1b0 msgr2=0x562e08b2eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff9216ab740 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0877f1b0 0x562e08b2eb20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff90c035000 tx=0x7ff90c041000 comp rx=0 tx=0).stop 2024-09-21T03:04:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff9216ab740 1 -- 172.21.15.81:0/3820902950 shutdown_connections 2024-09-21T03:04:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff9216ab740 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e0875e4d0 0x562e08b38720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff9216ab740 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0877f1b0 0x562e08b2eb20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff9216ab740 1 --2- 172.21.15.81:0/3820902950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e087562f0 0x562e08b27c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.396+0000 7ff9216ab740 1 -- 172.21.15.81:0/3820902950 >> 172.21.15.81:0/3820902950 conn(0x562e08773300 msgr2=0x562e08b2f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 -- 172.21.15.81:0/3820902950 shutdown_connections 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 -- 172.21.15.81:0/3820902950 wait complete. 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 -- start start 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 Processor -- start 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b38000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b36e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141aaba0 con 0x562e0875e4d0 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ac010 con 0x562e0877f1b0 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ab270 con 0x562e087562f0 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9216ab740 10 client.0 _ll_register_callbacks cb 0x7ff90800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.397+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b386c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41962/0 (socket says 172.21.15.81:41962) 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 -- 172.21.15.81:0/1118877160 learned_addr learned my addr 172.21.15.81:0/1118877160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff918cd6640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b36e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff913fff640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b38000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 -- 172.21.15.81:0/1118877160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 msgr2=0x562e08b38000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b38000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 -- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 msgr2=0x562e08b36e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b36e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 -- 172.21.15.81:0/1118877160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e08b37590 con 0x562e0875e4d0 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff913fff640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b38000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff918cd6640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b36e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9137fe640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b386c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff90800bc30 tx=0x7ff908010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882a60480b870407 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff8f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff8f37fe640 1 -- 172.21.15.81:0/1118877160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908029040 con 0x562e0875e4d0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff8f37fe640 1 -- 172.21.15.81:0/1118877160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7ff908004410 con 0x562e0875e4d0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff90c036050 con 0x562e0875e4d0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff8f37fe640 1 -- 172.21.15.81:0/1118877160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff908041050 con 0x562e0875e4d0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9216ab740 10 client.16035 fetch_fsmap learned FSMap version 27 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562e08b36400 con 0x562e0875e4d0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.398+0000 7ff8f37fe640 1 -- 172.21.15.81:0/1118877160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff90c036050 con 0x562e0875e4d0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff8f37fe640 1 -- 172.21.15.81:0/1118877160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff90803c030 con 0x562e0875e4d0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff9216ab740 10 client.16035 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff9216ab740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff9216ab740 20 client.16035 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff9216ab740 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e087131c0 0x562e08baa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff9216ab740 4 client.16035 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e08a970f0 con 0x562e087131c0 2024-09-21T03:04:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff913fff640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e087131c0 0x562e08baa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff8f37fe640 10 client.16035 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.399+0000 7ff913fff640 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e087131c0 0x562e08baa8e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1100b9924960c29 server_cookie=efe55db73745841b in_seq=0 out_seq=0 2024-09-21T03:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff8f37fe640 1 -- 172.21.15.81:0/1118877160 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e08a970f0 con 0x562e087131c0 2024-09-21T03:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff8f37fe640 10 client.16035 handle_command_reply: tid=0 2024-09-21T03:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 client.16035 shutdown 2024-09-21T03:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 msgr2=0x562e08b386c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b386c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff90800bc30 tx=0x7ff908010ca0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 shutdown_connections 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x562e087131c0 0x562e08baa8e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562e0877f1b0 0x562e08b36e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff8f37fe640 0 client.16035 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562e0875e4d0 0x562e08b386c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 --2- 172.21.15.81:0/1118877160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562e087562f0 0x562e08b38000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 >> 172.21.15.81:0/1118877160 conn(0x562e08773300 msgr2=0x562e08b30610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 shutdown_connections 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.407+0000 7ff9216ab740 1 -- 172.21.15.81:0/1118877160 wait complete. 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff9216ab740 20 client.16035 trim_cache size 0 max 16384 2024-09-21T03:04:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:04:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:04:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:04:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:04:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff8fc0b6510 msgr2=0x7ff8fc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff8fc0b6510 0x7ff8fc0b8a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0094e0 tx=0x7ff90c031000 comp rx=0 tx=0).stop 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914102c80 msgr2=0x7ff914199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914102c80 0x7ff914199e50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d770 tx=0x7ff90400dc30 comp rx=0 tx=0).stop 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 shutdown_connections 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7ff8fc0b6510 0x7ff8fc0b8a20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff9141056e0 0x7ff91419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff914108300 0x7ff91419b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 --2- 172.21.15.81:0/1980930567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff914102c80 0x7ff914199e50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 >> 172.21.15.81:0/1980930567 conn(0x7ff9140fd6d0 msgr2=0x7ff914103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 shutdown_connections 2024-09-21T03:04:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:30.408+0000 7ff91a739640 1 -- 172.21.15.81:0/1980930567 wait complete. 2024-09-21T03:04:31.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:31 smithi181 ceph-mon[34096]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 277 MiB/s wr, 75 op/s 2024-09-21T03:04:32.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:31 smithi081 ceph-mon[30991]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 277 MiB/s wr, 75 op/s 2024-09-21T03:04:32.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:31 smithi164 ceph-mon[34236]: pgmap v483: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 277 MiB/s wr, 75 op/s 2024-09-21T03:04:33.218 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:04:33.218 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 readers = 7955510.50 kB/sec 2024-09-21T03:04:33.218 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 readers = 7953440.61 kB/sec 2024-09-21T03:04:33.218 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 7955510.50 kB/sec 2024-09-21T03:04:33.218 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 7955510.50 kB/sec 2024-09-21T03:04:33.218 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 7955510.50 kB/sec 2024-09-21T03:04:33.218 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 10485760.00 kB 2024-09-21T03:04:33.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:33 smithi181 ceph-mon[34096]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 173 MiB/s wr, 52 op/s 2024-09-21T03:04:34.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:33 smithi081 ceph-mon[30991]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 173 MiB/s wr, 52 op/s 2024-09-21T03:04:34.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:33 smithi164 ceph-mon[34236]: pgmap v484: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 173 MiB/s wr, 52 op/s 2024-09-21T03:04:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:34 smithi081 ceph-mon[30991]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 32 MiB/s wr, 15 op/s 2024-09-21T03:04:35.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:34 smithi164 ceph-mon[34236]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 32 MiB/s wr, 15 op/s 2024-09-21T03:04:35.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:34 smithi181 ceph-mon[34096]: pgmap v485: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 32 MiB/s wr, 15 op/s 2024-09-21T03:04:36.644 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:04:36.644 INFO:tasks.workunit.client.0.smithi081.stdout: Children see throughput for 1 re-readers = 7931572.50 kB/sec 2024-09-21T03:04:36.644 INFO:tasks.workunit.client.0.smithi081.stdout: Parent sees throughput for 1 re-readers = 7929724.89 kB/sec 2024-09-21T03:04:36.644 INFO:tasks.workunit.client.0.smithi081.stdout: Min throughput per process = 7931572.50 kB/sec 2024-09-21T03:04:36.644 INFO:tasks.workunit.client.0.smithi081.stdout: Max throughput per process = 7931572.50 kB/sec 2024-09-21T03:04:36.644 INFO:tasks.workunit.client.0.smithi081.stdout: Avg throughput per process = 7931572.50 kB/sec 2024-09-21T03:04:36.645 INFO:tasks.workunit.client.0.smithi081.stdout: Min xfer = 10485760.00 kB 2024-09-21T03:04:37.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:36 smithi164 ceph-mon[34236]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T03:04:37.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:36 smithi181 ceph-mon[34096]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T03:04:37.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:36 smithi081 ceph-mon[30991]: pgmap v486: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 17 MiB/s wr, 13 op/s 2024-09-21T03:04:39.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:38 smithi164 ceph-mon[34236]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T03:04:39.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:38 smithi181 ceph-mon[34096]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T03:04:39.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:38 smithi081 ceph-mon[30991]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T03:04:41.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:40 smithi164 ceph-mon[34236]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T03:04:41.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:40 smithi181 ceph-mon[34096]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T03:04:41.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:40 smithi081 ceph-mon[30991]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T03:04:43.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:42 smithi164 ceph-mon[34236]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-21T03:04:43.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:42 smithi181 ceph-mon[34096]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-21T03:04:43.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:42 smithi081 ceph-mon[30991]: pgmap v489: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-21T03:04:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 -- 172.21.15.81:0/4141217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7941025c0 msgr2=0x7fb794102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 --2- 172.21.15.81:0/4141217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7941025c0 0x7fb794102a30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb784009ca0 tx=0x7fb78402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 -- 172.21.15.81:0/4141217351 shutdown_connections 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 --2- 172.21.15.81:0/4141217351 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb794103640 0x7fb794103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 --2- 172.21.15.81:0/4141217351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb794103fe0 0x7fb79410a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 --2- 172.21.15.81:0/4141217351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7941025c0 0x7fb794102a30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 -- 172.21.15.81:0/4141217351 >> 172.21.15.81:0/4141217351 conn(0x7fb7940fdf00 msgr2=0x7fb7941003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 -- 172.21.15.81:0/4141217351 shutdown_connections 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.517+0000 7fb79c07e640 1 -- 172.21.15.81:0/4141217351 wait complete. 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 Processor -- start 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 -- start start 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7941025c0 0x7fb79406c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb794103640 0x7fb79419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb794103fe0 0x7fb7941a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410e050 con 0x7fb794103640 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410ded0 con 0x7fb794103fe0 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79c07e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410e1d0 con 0x7fb7941025c0 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb794103640 0x7fb79419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb794103640 0x7fb79419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59264/0 (socket says 172.21.15.81:59264) 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 -- 172.21.15.81:0/3778703036 learned_addr learned my addr 172.21.15.81:0/3778703036 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79a61b640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb794103fe0 0x7fb7941a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799e1a640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7941025c0 0x7fb79406c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 -- 172.21.15.81:0/3778703036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7941025c0 msgr2=0x7fb79406c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7941025c0 0x7fb79406c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 -- 172.21.15.81:0/3778703036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb794103fe0 msgr2=0x7fb7941a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb794103fe0 0x7fb7941a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 -- 172.21.15.81:0/3778703036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7941a18a0 con 0x7fb794103640 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799e1a640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7941025c0 0x7fb79406c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb79a61b640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb794103fe0 0x7fb7941a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.518+0000 7fb799619640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb794103640 0x7fb79419ebe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb78800c920 tx=0x7fb78800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.519+0000 7fb792ffd640 1 -- 172.21.15.81:0/3778703036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788007c70 con 0x7fb794103640 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.519+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7941a1b90 con 0x7fb794103640 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.519+0000 7fb792ffd640 1 -- 172.21.15.81:0/3778703036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb788007e10 con 0x7fb794103640 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.519+0000 7fb792ffd640 1 -- 172.21.15.81:0/3778703036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788018710 con 0x7fb794103640 2024-09-21T03:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.519+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7941a20e0 con 0x7fb794103640 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.521+0000 7fb7a2fe6740 1 Processor -- start 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.521+0000 7fb792ffd640 1 -- 172.21.15.81:0/3778703036 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb78800f450 con 0x7fb794103640 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb7a2fe6740 1 -- start start 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd70191b0 0x557bd73c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd6ff02f0 0x557bd73c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff84d0 0x557bd73c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557bd73336f0 con 0x557bd6ff84d0 2024-09-21T03:04:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557bd7322b20 con 0x557bd6ff02f0 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557bd7326930 con 0x557bd70191b0 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb799619640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff84d0 0x557bd73c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb799619640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff84d0 0x557bd73c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59266/0 (socket says 172.21.15.81:59266) 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb799619640 1 -- 172.21.15.81:0/578119039 learned_addr learned my addr 172.21.15.81:0/578119039 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb799e1a640 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd6ff02f0 0x557bd73c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb79a61b640 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd70191b0 0x557bd73c0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb799619640 1 -- 172.21.15.81:0/578119039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd70191b0 msgr2=0x557bd73c0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.522+0000 7fb799619640 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd70191b0 0x557bd73c0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb799619640 1 -- 172.21.15.81:0/578119039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd6ff02f0 msgr2=0x557bd73c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb799619640 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd6ff02f0 0x557bd73c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb799619640 1 -- 172.21.15.81:0/578119039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd72e8530 con 0x557bd6ff84d0 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb792ffd640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb77c0b6590 0x7fb77c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb79a61b640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb77c0b6590 0x7fb77c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb799619640 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff84d0 0x557bd73c2010 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb7880edc20 tx=0x7fb7880edd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93aca15a867a56ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb792ffd640 1 -- 172.21.15.81:0/3778703036 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb7880e7940 con 0x7fb794103640 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb77bfff640 1 -- 172.21.15.81:0/578119039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880a95d0 con 0x557bd6ff84d0 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb77bfff640 1 -- 172.21.15.81:0/578119039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7880ede40 con 0x557bd6ff84d0 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb79a61b640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb77c0b6590 0x7fb77c0b8aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009c80 tx=0x7fb78c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.523+0000 7fb77bfff640 1 -- 172.21.15.81:0/578119039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880acea0 con 0x557bd6ff84d0 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/578119039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff84d0 msgr2=0x557bd73c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff84d0 0x557bd73c2010 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb7880edc20 tx=0x7fb7880edd10 comp rx=0 tx=0).stop 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/578119039 shutdown_connections 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff84d0 0x557bd73c2010 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd6ff02f0 0x557bd73c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/578119039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd70191b0 0x557bd73c0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/578119039 >> 172.21.15.81:0/578119039 conn(0x557bd700d300 msgr2=0x557bd73bc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/578119039 shutdown_connections 2024-09-21T03:04:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.524+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/578119039 wait complete. 2024-09-21T03:04:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 -- start start 2024-09-21T03:04:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 Processor -- start 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557bd725aab0 con 0x557bd6ff02f0 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557bd72c8730 con 0x557bd70191b0 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557bd73c2b30 con 0x557bd6ff84d0 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb7a2fe6740 10 client.0 _ll_register_callbacks cb 0x557bd731c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb799e1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb799e1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59278/0 (socket says 172.21.15.81:59278) 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb799e1a640 1 -- 172.21.15.81:0/2045803246 learned_addr learned my addr 172.21.15.81:0/2045803246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb799619640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.525+0000 7fb79a61b640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb799e1a640 1 -- 172.21.15.81:0/2045803246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 msgr2=0x557bd73cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb799e1a640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb799e1a640 1 -- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 msgr2=0x557bd73cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb799e1a640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb799e1a640 1 -- 172.21.15.81:0/2045803246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd7084790 con 0x557bd6ff02f0 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb79a61b640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb799e1a640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73ca630 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb784035000 tx=0x7fb784031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c9e78bc9da4ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7797fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7797fa640 1 -- 172.21.15.81:0/2045803246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784049060 con 0x557bd6ff02f0 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7797fa640 1 -- 172.21.15.81:0/2045803246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb784003970 con 0x557bd6ff02f0 2024-09-21T03:04:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557bd7335640 con 0x557bd6ff02f0 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7797fa640 1 -- 172.21.15.81:0/2045803246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb784050050 con 0x557bd6ff02f0 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7a2fe6740 10 client.16047 fetch_fsmap learned FSMap version 27 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557bd70fd620 con 0x557bd6ff02f0 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.526+0000 7fb7797fa640 1 -- 172.21.15.81:0/2045803246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557bd7335640 con 0x557bd6ff02f0 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7797fa640 1 -- 172.21.15.81:0/2045803246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb7840305c0 con 0x557bd6ff02f0 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7a2fe6740 10 client.16047 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7a2fe6740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7a2fe6740 20 client.16047 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fd7d80 0x557bd73d7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7a2fe6740 4 client.16047 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bd73310f0 con 0x557bd6fd7d80 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb799619640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fd7d80 0x557bd73d7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb7797fa640 10 client.16047 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.527+0000 7fb799619640 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fd7d80 0x557bd73d7e70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=305ff44115ba92b5 server_cookie=5b6adef31cfc7142 in_seq=0 out_seq=0 2024-09-21T03:04:43.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7797fa640 1 -- 172.21.15.81:0/2045803246 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557bd73310f0 con 0x557bd6fd7d80 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7797fa640 10 client.16047 handle_command_reply: tid=0 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 client.16047 shutdown 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 msgr2=0x557bd73ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73ca630 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb784035000 tx=0x7fb784031cb0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 shutdown_connections 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fd7d80 0x557bd73d7e70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/2045803246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73ca630 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7797fa640 0 client.16047 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 >> 172.21.15.81:0/2045803246 conn(0x557bd700d300 msgr2=0x557bd73baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 shutdown_connections 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/2045803246 wait complete. 2024-09-21T03:04:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.529+0000 7fb7a2fe6740 20 client.16047 trim_cache size 0 max 16384 2024-09-21T03:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.543+0000 7fb7a2fe6740 1 Processor -- start 2024-09-21T03:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.543+0000 7fb7a2fe6740 1 -- start start 2024-09-21T03:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73bc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941aec60 con 0x557bd6ff02f0 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941ac530 con 0x557bd70191b0 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941aa380 con 0x557bd6ff84d0 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73c1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59286/0 (socket says 172.21.15.81:59286) 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 -- 172.21.15.81:0/612938222 learned_addr learned my addr 172.21.15.81:0/612938222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb79a61b640 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 -- 172.21.15.81:0/612938222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 msgr2=0x557bd73d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799619640 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 -- 172.21.15.81:0/612938222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 msgr2=0x557bd73bc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73bc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 -- 172.21.15.81:0/612938222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd73cbbd0 con 0x557bd6ff02f0 2024-09-21T03:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb79a61b640 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73bc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:04:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb799e1a640 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73c1500 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb784033ff0 tx=0x7fb7840318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fe8c9e7b8f3da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb77b7fe640 1 -- 172.21.15.81:0/612938222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784049040 con 0x557bd6ff02f0 2024-09-21T03:04:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb77b7fe640 1 -- 172.21.15.81:0/612938222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb784036050 con 0x557bd6ff02f0 2024-09-21T03:04:43.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.544+0000 7fb77b7fe640 1 -- 172.21.15.81:0/612938222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784054b20 con 0x557bd6ff02f0 2024-09-21T03:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/612938222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 msgr2=0x557bd73c1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73c1500 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb784033ff0 tx=0x7fb7840318e0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/612938222 shutdown_connections 2024-09-21T03:04:43.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73bc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/612938222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73c1500 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/612938222 >> 172.21.15.81:0/612938222 conn(0x557bd700d300 msgr2=0x557bd73c0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/612938222 shutdown_connections 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/612938222 wait complete. 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.545+0000 7fb7a2fe6740 1 -- start start 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 1 Processor -- start 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941aa9f0 con 0x557bd6ff02f0 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941abe60 con 0x557bd70191b0 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941ab0c0 con 0x557bd6ff84d0 2024-09-21T03:04:43.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb7a2fe6740 10 client.0 _ll_register_callbacks cb 0x7fb784009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59298/0 (socket says 172.21.15.81:59298) 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 -- 172.21.15.81:0/4170271933 learned_addr learned my addr 172.21.15.81:0/4170271933 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb79a61b640 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 -- 172.21.15.81:0/4170271933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 msgr2=0x557bd73d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 -- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 msgr2=0x557bd73d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73d1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb799e1a640 1 -- 172.21.15.81:0/4170271933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd73d0090 con 0x557bd6ff02f0 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.546+0000 7fb79a61b640 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73d1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb799e1a640 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73d1450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb784009620 tx=0x7fb784030eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61814d3459e3994a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7797fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7797fa640 1 -- 172.21.15.81:0/4170271933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784004d50 con 0x557bd6ff02f0 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7797fa640 1 -- 172.21.15.81:0/4170271933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb784005030 con 0x557bd6ff02f0 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb784036050 con 0x557bd6ff02f0 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7797fa640 1 -- 172.21.15.81:0/4170271933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb784065050 con 0x557bd6ff02f0 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 10 client.16053 fetch_fsmap learned FSMap version 27 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557bd7442b50 con 0x557bd6ff02f0 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7797fa640 1 -- 172.21.15.81:0/4170271933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb784036050 con 0x557bd6ff02f0 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7797fa640 1 -- 172.21.15.81:0/4170271933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb7840545c0 con 0x557bd6ff02f0 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 10 client.16053 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 20 client.16053 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fad1c0 0x557bd7445490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 4 client.16053 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:04:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.547+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557bd732e520 con 0x557bd6fad1c0 2024-09-21T03:04:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.548+0000 7fb799619640 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fad1c0 0x557bd7445490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.548+0000 7fb7797fa640 10 client.16053 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.548+0000 7fb799619640 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fad1c0 0x557bd7445490 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b92dc5a0735f0d08 server_cookie=1f5c58f55238bff in_seq=0 out_seq=0 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7797fa640 1 -- 172.21.15.81:0/4170271933 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557bd732e520 con 0x557bd6fad1c0 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7797fa640 10 client.16053 handle_command_reply: tid=0 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 client.16053 shutdown 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 msgr2=0x557bd73d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73d1450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb784009620 tx=0x7fb784030eb0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 shutdown_connections 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557bd6fad1c0 0x557bd7445490 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557bd6ff84d0 0x557bd73d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557bd70191b0 0x557bd73d1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7797fa640 0 client.16053 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 --2- 172.21.15.81:0/4170271933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bd6ff02f0 0x557bd73d1450 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 >> 172.21.15.81:0/4170271933 conn(0x557bd700d300 msgr2=0x557bd73c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 shutdown_connections 2024-09-21T03:04:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 1 -- 172.21.15.81:0/4170271933 wait complete. 2024-09-21T03:04:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb7a2fe6740 20 client.16053 trim_cache size 0 max 16384 2024-09-21T03:04:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-21T03:04:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-21T03:04:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-21T03:04:43.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb77c0b6590 msgr2=0x7fb77c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb79c07e640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb77c0b6590 0x7fb77c0b8aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009c80 tx=0x7fb78c005f90 comp rx=0 tx=0).stop 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb794103640 msgr2=0x7fb79419ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.560+0000 7fb79c07e640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb794103640 0x7fb79419ebe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb78800c920 tx=0x7fb78800cde0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 shutdown_connections 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb77c0b6590 0x7fb77c0b8aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb794103fe0 0x7fb7941a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb794103640 0x7fb79419ebe0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 --2- 172.21.15.81:0/3778703036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7941025c0 0x7fb79406c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 >> 172.21.15.81:0/3778703036 conn(0x7fb7940fdf00 msgr2=0x7fb794106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 shutdown_connections 2024-09-21T03:04:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-21T03:04:43.561+0000 7fb79c07e640 1 -- 172.21.15.81:0/3778703036 wait complete. 2024-09-21T03:04:43.613 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:04:43.613 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:04:43.613 INFO:tasks.workunit.client.0.smithi081.stdout: 2024-09-21T03:04:43.613 INFO:tasks.workunit.client.0.smithi081.stdout:iozone test complete. 2024-09-21T03:04:43.614 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:04:43.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:04:43.691 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-21T03:04:43.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T03:04:44.007 DEBUG:teuthology.parallel:result is None 2024-09-21T03:04:44.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:04:44.043 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:04:44.043 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T03:04:44.054 INFO:tasks.quiescer:joining Quiescers 2024-09-21T03:04:44.054 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T03:04:44.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:04:44.326 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:04:44.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 -- 172.21.15.81:0/655994904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108d20 msgr2=0x7f35d810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:44.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 --2- 172.21.15.81:0/655994904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108d20 0x7f35d810f550 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009ca0 tx=0x7f35d002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 -- 172.21.15.81:0/655994904 shutdown_connections 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 --2- 172.21.15.81:0/655994904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108d20 0x7f35d810f550 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 --2- 172.21.15.81:0/655994904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35d81083d0 0x7f35d81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 --2- 172.21.15.81:0/655994904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35d8102ae0 0x7f35d8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 -- 172.21.15.81:0/655994904 >> 172.21.15.81:0/655994904 conn(0x7f35d8079760 msgr2=0x7f35d8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 -- 172.21.15.81:0/655994904 shutdown_connections 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.862+0000 7f35df913640 1 -- 172.21.15.81:0/655994904 wait complete. 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 Processor -- start 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 -- start start 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8102ae0 0x7f35d819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35d81083d0 0x7f35d819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35d8108d20 0x7f35d819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8112890 con 0x7f35d8102ae0 2024-09-21T03:04:44.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8112710 con 0x7f35d8108d20 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35df913640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8112a10 con 0x7f35d81083d0 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8102ae0 0x7f35d819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8102ae0 0x7f35d819b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59322/0 (socket says 172.21.15.81:59322) 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 -- 172.21.15.81:0/4235590895 learned_addr learned my addr 172.21.15.81:0/4235590895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dceae640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35d81083d0 0x7f35d819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 -- 172.21.15.81:0/4235590895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35d81083d0 msgr2=0x7f35d819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35d81083d0 0x7f35d819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 -- 172.21.15.81:0/4235590895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35d8108d20 msgr2=0x7f35d819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35ddeb0640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35d8108d20 0x7f35d819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35d8108d20 0x7f35d819bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.863+0000 7f35dd6af640 1 -- 172.21.15.81:0/4235590895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d81a63f0 con 0x7f35d8102ae0 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.864+0000 7f35dd6af640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8102ae0 0x7f35d819b0e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f35d400e9f0 tx=0x7f35d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.864+0000 7f35ce7fc640 1 -- 172.21.15.81:0/4235590895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d400cd80 con 0x7f35d8102ae0 2024-09-21T03:04:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.864+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d81a66e0 con 0x7f35d8102ae0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.864+0000 7f35ce7fc640 1 -- 172.21.15.81:0/4235590895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35d40054b0 con 0x7f35d8102ae0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.864+0000 7f35ce7fc640 1 -- 172.21.15.81:0/4235590895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4010430 con 0x7f35d8102ae0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.864+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d81a6bd0 con 0x7f35d8102ae0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.865+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d8102ef0 con 0x7f35d8102ae0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.867+0000 7f35ce7fc640 1 -- 172.21.15.81:0/4235590895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f35d40046c0 con 0x7f35d8102ae0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.868+0000 7f35ce7fc640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f35c40b6510 0x7f35c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.868+0000 7f35dceae640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f35c40b6510 0x7f35c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.868+0000 7f35ce7fc640 1 -- 172.21.15.81:0/4235590895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f35d40e7ce0 con 0x7f35d8102ae0 2024-09-21T03:04:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.868+0000 7f35dceae640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f35c40b6510 0x7f35c40b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f35d8105f00 tx=0x7f35c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:44.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:44.871+0000 7f35ce7fc640 1 -- 172.21.15.81:0/4235590895 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35d4056710 con 0x7f35d8102ae0 2024-09-21T03:04:45.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:44 smithi081 ceph-mon[30991]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.090+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35d806bf50 con 0x7f35d8102ae0 2024-09-21T03:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.091+0000 7f35ce7fc640 1 -- 172.21.15.81:0/4235590895 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11924 (secure 0 0 0) 0x7f35d40ae230 con 0x7f35d8102ae0 2024-09-21T03:04:45.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:04:45.094 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T03:04:25:705271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:04:25.245917+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T03:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.093+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f35c40b6510 msgr2=0x7f35c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.093+0000 7f35df913640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f35c40b6510 0x7f35c40b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f35d8105f00 tx=0x7f35c8005f90 comp rx=0 tx=0).stop 2024-09-21T03:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.093+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8102ae0 msgr2=0x7f35d819b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.093+0000 7f35df913640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8102ae0 0x7f35d819b0e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f35d400e9f0 tx=0x7f35d400edf0 comp rx=0 tx=0).stop 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 shutdown_connections 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f35c40b6510 0x7f35c40b8a20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35d81083d0 0x7f35d819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f35d8108d20 0x7f35d819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 --2- 172.21.15.81:0/4235590895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8102ae0 0x7f35d819b0e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 >> 172.21.15.81:0/4235590895 conn(0x7f35d8079760 msgr2=0x7f35d81043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 shutdown_connections 2024-09-21T03:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:45.094+0000 7f35df913640 1 -- 172.21.15.81:0/4235590895 wait complete. 2024-09-21T03:04:45.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:44 smithi164 ceph-mon[34236]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:04:45.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:44 smithi181 ceph-mon[34096]: pgmap v490: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T03:04:45.915 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24599 quiesce db --cancel --all' 2024-09-21T03:04:45.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24599 quiesce db --cancel --all 2024-09-21T03:04:46.170 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:04:46.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:45 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4235590895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:04:46.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:45 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4235590895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:04:46.291 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:45 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4235590895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.758+0000 7f1ce11c9640 1 -- 172.21.15.81:0/2319428050 <== mon.1 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8040770 con 0x7f1cdc1028d0 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2319428050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc1028d0 msgr2=0x7f1cdc102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2319428050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc102ce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1cd801a910 tx=0x7f1cd803b430 comp rx=0 tx=0).stop 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2319428050 shutdown_connections 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2319428050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc108b60 0x7f1cdc10f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2319428050 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1cdc108210 0x7f1cdc108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2319428050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc102ce0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2319428050 >> 172.21.15.81:0/2319428050 conn(0x7f1cdc0fe380 msgr2=0x7f1cdc1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:46.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2319428050 shutdown_connections 2024-09-21T03:04:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.759+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2319428050 wait complete. 2024-09-21T03:04:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.760+0000 7f1ce31cd640 1 Processor -- start 2024-09-21T03:04:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.760+0000 7f1ce31cd640 1 -- start start 2024-09-21T03:04:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce31cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce31cd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1cdc108210 0x7f1cdc10a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce31cd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc108b60 0x7f1cdc10a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce31cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc06be90 con 0x7f1cdc1028d0 2024-09-21T03:04:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce31cd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc06bd10 con 0x7f1cdc108210 2024-09-21T03:04:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce31cd640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc06c010 con 0x7f1cdc108b60 2024-09-21T03:04:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce21cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce21cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc10ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59342/0 (socket says 172.21.15.81:59342) 2024-09-21T03:04:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.761+0000 7f1ce21cb640 1 -- 172.21.15.81:0/2396706389 learned_addr learned my addr 172.21.15.81:0/2396706389 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.762+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc108b60 0x7f1cdc10a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.762+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1cdc108210 0x7f1cdc10a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.762+0000 7f1ce21cb640 1 -- 172.21.15.81:0/2396706389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc108b60 msgr2=0x7f1cdc10a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.762+0000 7f1ce21cb640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc108b60 0x7f1cdc10a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.762+0000 7f1ce21cb640 1 -- 172.21.15.81:0/2396706389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1cdc108210 msgr2=0x7f1cdc10a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.762+0000 7f1ce21cb640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1cdc108210 0x7f1cdc10a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.762+0000 7f1ce21cb640 1 -- 172.21.15.81:0/2396706389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc10add0 con 0x7f1cdc1028d0 2024-09-21T03:04:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.763+0000 7f1ce21cb640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc10ef50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1cd803ba20 tx=0x7f1cd8004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.763+0000 7f1cd37fe640 1 -- 172.21.15.81:0/2396706389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd804f020 con 0x7f1cdc1028d0 2024-09-21T03:04:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.763+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc10b060 con 0x7f1cdc1028d0 2024-09-21T03:04:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.763+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc19c040 con 0x7f1cdc1028d0 2024-09-21T03:04:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.763+0000 7f1cd37fe640 1 -- 172.21.15.81:0/2396706389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cd8005100 con 0x7f1cdc1028d0 2024-09-21T03:04:46.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.763+0000 7f1cd37fe640 1 -- 172.21.15.81:0/2396706389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8046070 con 0x7f1cdc1028d0 2024-09-21T03:04:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.770+0000 7f1cea9a3740 1 Processor -- start 2024-09-21T03:04:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.770+0000 7f1cea9a3740 1 -- start start 2024-09-21T03:04:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.770+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6633d2d0 0x557f666e4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.770+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.770+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6631c5f0 0x557f666e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.770+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557f6665add0 con 0x557f6633d2d0 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1ce29cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6633d2d0 0x557f666e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.770+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557f6664a200 con 0x557f66314410 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1ce29cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6633d2d0 0x557f666e4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59358/0 (socket says 172.21.15.81:59358) 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1ce29cc640 1 -- 172.21.15.81:0/824570816 learned_addr learned my addr 172.21.15.81:0/824570816 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1cea9a3740 1 -- 172.21.15.81:0/824570816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557f6664e010 con 0x557f6631c5f0 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6631c5f0 0x557f666e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1ce29cc640 1 -- 172.21.15.81:0/824570816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6631c5f0 msgr2=0x557f666e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6631c5f0 0x557f666e4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.771+0000 7f1ce29cc640 1 -- 172.21.15.81:0/824570816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 msgr2=0x557f666e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.772+0000 7f1ce21cb640 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.772+0000 7f1cd37fe640 1 -- 172.21.15.81:0/2396706389 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1cd8052020 con 0x7f1cdc1028d0 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.772+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.772+0000 7f1ce29cc640 1 -- 172.21.15.81:0/824570816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f663a88b0 con 0x557f6633d2d0 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.772+0000 7f1ce21cb640 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.773+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6633d2d0 0x557f666e4510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4032380 tx=0x7f1cd4032840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4109b6b0454c282f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.773+0000 7f1cd37fe640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1cc80b66e0 0x7f1cc80b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.774+0000 7f1cd0d9a640 1 -- 172.21.15.81:0/824570816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4004d20 con 0x557f6633d2d0 2024-09-21T03:04:46.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.774+0000 7f1cd0d9a640 1 -- 172.21.15.81:0/824570816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cd40054b0 con 0x557f6633d2d0 2024-09-21T03:04:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.774+0000 7f1cd37fe640 1 -- 172.21.15.81:0/2396706389 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1cd81184f0 con 0x7f1cdc1028d0 2024-09-21T03:04:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.775+0000 7f1cea9a3740 1 -- 172.21.15.81:0/824570816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6633d2d0 msgr2=0x557f666e4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.775+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6633d2d0 0x557f666e4510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4032380 tx=0x7f1cd4032840 comp rx=0 tx=0).stop 2024-09-21T03:04:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.775+0000 7f1cea9a3740 1 -- 172.21.15.81:0/824570816 shutdown_connections 2024-09-21T03:04:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.775+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6631c5f0 0x557f666e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.775+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.775+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/824570816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6633d2d0 0x557f666e4510 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.775+0000 7f1cea9a3740 1 -- 172.21.15.81:0/824570816 >> 172.21.15.81:0/824570816 conn(0x557f663316c0 msgr2=0x557f666e2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.778+0000 7f1ce21cb640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1cc80b66e0 0x7f1cc80b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.779+0000 7f1ce21cb640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1cc80b66e0 0x7f1cc80b8bf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8006010 tx=0x7f1cd801a270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.780+0000 7f1cea9a3740 1 -- 172.21.15.81:0/824570816 shutdown_connections 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.780+0000 7f1cea9a3740 1 -- 172.21.15.81:0/824570816 wait complete. 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.780+0000 7f1cea9a3740 1 -- start start 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.780+0000 7f1cea9a3740 1 Processor -- start 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557f664ab810 con 0x557f6631c5f0 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x557f665e5080 con 0x557f66314410 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x557f666f2d40 con 0x557f6633d2d0 2024-09-21T03:04:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1cea9a3740 10 client.0 _ll_register_callbacks cb 0x557f665f5960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1ce29cc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1ce29cc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:40792/0 (socket says 172.21.15.81:40792) 2024-09-21T03:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1ce29cc640 1 -- 172.21.15.81:0/3259508567 learned_addr learned my addr 172.21.15.81:0/3259508567 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:46.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.782+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1ce19ca640 1 -- 172.21.15.81:0/3259508567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 msgr2=0x557f666fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666fc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1ce19ca640 1 -- 172.21.15.81:0/3259508567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 msgr2=0x557f666f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1ce19ca640 1 -- 172.21.15.81:0/3259508567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f665ef460 con 0x557f6631c5f0 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f0610 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc005fd0 tx=0x7f1ccc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e2ef31c002d23a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:46.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1cc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T03:04:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/3259508567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc01b470 con 0x557f6631c5f0 2024-09-21T03:04:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/3259508567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1ccc01b610 con 0x557f6631c5f0 2024-09-21T03:04:46.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.784+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd40054b0 con 0x557f6631c5f0 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.785+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/3259508567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ccc024050 con 0x557f6631c5f0 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.785+0000 7f1cea9a3740 10 client.16071 fetch_fsmap learned FSMap version 27 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.785+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f666fee00 con 0x557f6631c5f0 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.785+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/3259508567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ccc016070 con 0x557f6631c5f0 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/3259508567 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1ccc012870 con 0x557f6631c5f0 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1cea9a3740 10 client.16071 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1cea9a3740 10 client.16071 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1cea9a3740 20 client.16071 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662fbc50 0x557f667022f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1cea9a3740 4 client.16071 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1cd40054b0 con 0x557f662fbc50 2024-09-21T03:04:46.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.786+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662fbc50 0x557f667022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.789+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662fbc50 0x557f667022f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a393eaa079d4a8e0 server_cookie=952084d03f5f7a48 in_seq=0 out_seq=0 2024-09-21T03:04:46.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.789+0000 7f1cc5ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.791+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/3259508567 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1cd40054b0 con 0x557f662fbc50 2024-09-21T03:04:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.791+0000 7f1cc5ffb640 10 client.16071 handle_command_reply: tid=0 2024-09-21T03:04:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.791+0000 7f1cea9a3740 1 client.16071 shutdown 2024-09-21T03:04:46.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.791+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 msgr2=0x557f666f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f0610 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc005fd0 tx=0x7f1ccc00bda0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 shutdown_connections 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662fbc50 0x557f667022f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f0610 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/3259508567 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 >> 172.21.15.81:0/3259508567 conn(0x557f663316c0 msgr2=0x557f666e76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cc5ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:46.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 shutdown_connections 2024-09-21T03:04:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.792+0000 7f1cea9a3740 1 -- 172.21.15.81:0/3259508567 wait complete. 2024-09-21T03:04:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.793+0000 7f1cea9a3740 20 client.16071 trim_cache size 0 max 16384 2024-09-21T03:04:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.829+0000 7f1cea9a3740 1 Processor -- start 2024-09-21T03:04:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.829+0000 7f1cea9a3740 1 -- start start 2024-09-21T03:04:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.829+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f66314410 0x557f666e9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f6631c5f0 0x557f666e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0012420 con 0x557f66314410 2024-09-21T03:04:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc000fcf0 con 0x557f6631c5f0 2024-09-21T03:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1cea9a3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc000db40 con 0x557f6633d2d0 2024-09-21T03:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1ce19ca640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f6631c5f0 0x557f666e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1ce19ca640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f6631c5f0 0x557f666e9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:40808/0 (socket says 172.21.15.81:40808) 2024-09-21T03:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1ce19ca640 1 -- 172.21.15.81:0/2228256289 learned_addr learned my addr 172.21.15.81:0/2228256289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.830+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.831+0000 7f1ce19ca640 1 -- 172.21.15.81:0/2228256289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 msgr2=0x557f666e1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.831+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666e1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.831+0000 7f1ce19ca640 1 -- 172.21.15.81:0/2228256289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f66314410 msgr2=0x557f666e9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.831+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f66314410 0x557f666e9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.831+0000 7f1ce19ca640 1 -- 172.21.15.81:0/2228256289 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f666eb760 con 0x557f6631c5f0 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.832+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f6631c5f0 0x557f666e9b60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc000c00 tx=0x7f1ccc003a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=852a6d57b439b5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.832+0000 7f1cc7fff640 1 -- 172.21.15.81:0/2228256289 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc02c020 con 0x557f6631c5f0 2024-09-21T03:04:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.832+0000 7f1cc7fff640 1 -- 172.21.15.81:0/2228256289 <== mon.2 v2:172.21.15.164:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ccc016070 con 0x557f6631c5f0 2024-09-21T03:04:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.833+0000 7f1cc7fff640 1 -- 172.21.15.81:0/2228256289 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc021040 con 0x557f6631c5f0 2024-09-21T03:04:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.834+0000 7f1cea9a3740 1 -- 172.21.15.81:0/2228256289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f6631c5f0 msgr2=0x557f666e9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.834+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f6631c5f0 0x557f666e9b60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc000c00 tx=0x7f1ccc003a40 comp rx=0 tx=0).stop 2024-09-21T03:04:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.836+0000 7f1cea9a3740 1 -- 172.21.15.81:0/2228256289 shutdown_connections 2024-09-21T03:04:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.836+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.836+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f6631c5f0 0x557f666e9b60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.836+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/2228256289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f66314410 0x557f666e9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.836+0000 7f1cea9a3740 1 -- 172.21.15.81:0/2228256289 >> 172.21.15.81:0/2228256289 conn(0x557f663316c0 msgr2=0x557f666ee750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.836+0000 7f1cea9a3740 1 -- 172.21.15.81:0/2228256289 shutdown_connections 2024-09-21T03:04:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.836+0000 7f1cea9a3740 1 -- 172.21.15.81:0/2228256289 wait complete. 2024-09-21T03:04:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.837+0000 7f1cea9a3740 1 -- start start 2024-09-21T03:04:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.837+0000 7f1cea9a3740 1 Processor -- start 2024-09-21T03:04:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.837+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1cea9a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1ce29cc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1ce29cc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.81:40824/0 (socket says 172.21.15.81:40824) 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1ce29cc640 1 -- 172.21.15.81:0/1885664228 learned_addr learned my addr 172.21.15.81:0/1885664228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc000e1b0 con 0x557f6631c5f0 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc000f620 con 0x557f66314410 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc000e880 con 0x557f6633d2d0 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.838+0000 7f1cea9a3740 10 client.0 _ll_register_callbacks cb 0x7f1ccc004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce29cc640 1 -- 172.21.15.81:0/1885664228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 msgr2=0x557f666f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce29cc640 1 -- 172.21.15.81:0/1885664228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 msgr2=0x557f666f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce29cc640 1 -- 172.21.15.81:0/1885664228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f666f3ab0 con 0x557f66314410 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1ce29cc640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f8550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4032880 tx=0x7f1cd4035040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=640e456739a573a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.839+0000 7f1cc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.840+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/1885664228 <== mon.2 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4047040 con 0x557f66314410 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.840+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ccc016070 con 0x557f66314410 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.840+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/1885664228 <== mon.2 v2:172.21.15.164:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f1cd4034cf0 con 0x557f66314410 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.840+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/1885664228 <== mon.2 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1cd405e050 con 0x557f66314410 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.840+0000 7f1cea9a3740 10 client.25550 fetch_fsmap learned FSMap version 27 2024-09-21T03:04:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.840+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f6676d9a0 con 0x557f66314410 2024-09-21T03:04:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/1885664228 <== mon.2 v2:172.21.15.164:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ccc016070 con 0x557f66314410 2024-09-21T03:04:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/1885664228 <== mon.2 v2:172.21.15.164:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1cd4055070 con 0x557f66314410 2024-09-21T03:04:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cea9a3740 10 client.25550 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:04:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cea9a3740 10 client.25550 resolve_mds: validated gid 24599 aka daemon mds.b 2024-09-21T03:04:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cea9a3740 20 client.25550 populate_metadata read hostname 'smithi081' 2024-09-21T03:04:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662d1000 0x557f6676fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cea9a3740 4 client.25550 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T03:04:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.841+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 --> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x557f6665cd20 con 0x557f662d1000 2024-09-21T03:04:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.842+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662d1000 0x557f6676fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.843+0000 7f1ce19ca640 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662d1000 0x557f6676fe90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931bbe9e389297c2 server_cookie=a609692d4f8d2582 in_seq=0 out_seq=0 2024-09-21T03:04:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.843+0000 7f1cc5ffb640 10 client.25550 ms_handle_connect on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cc5ffb640 1 -- 172.21.15.81:0/1885664228 <== mds.0 v2:172.21.15.164:6838/399869191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x557f6665cd20 con 0x557f662d1000 2024-09-21T03:04:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cc5ffb640 10 client.25550 handle_command_reply: tid=0 2024-09-21T03:04:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 client.25550 shutdown 2024-09-21T03:04:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 msgr2=0x557f666f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f8550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4032880 tx=0x7f1cd4035040 comp rx=0 tx=0).stop 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 shutdown_connections 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:6838/399869191,v1:172.21.15.164:6839/399869191] conn(0x557f662d1000 0x557f6676fe90 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557f6633d2d0 0x557f666f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557f6631c5f0 0x557f666f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 --2- 172.21.15.81:0/1885664228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x557f66314410 0x557f666f8550 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 >> 172.21.15.81:0/1885664228 conn(0x557f663316c0 msgr2=0x557f666e9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.844+0000 7f1cc5ffb640 0 client.25550 ms_handle_reset on v2:172.21.15.164:6838/399869191 2024-09-21T03:04:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.845+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 shutdown_connections 2024-09-21T03:04:46.848 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:04:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 27, 2024-09-21T03:04:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24599, 2024-09-21T03:04:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 16, 2024-09-21T03:04:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": {} 2024-09-21T03:04:46.849 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:04:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.847+0000 7f1cea9a3740 1 -- 172.21.15.81:0/1885664228 wait complete. 2024-09-21T03:04:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.847+0000 7f1cea9a3740 20 client.25550 trim_cache size 0 max 16384 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1cc80b66e0 msgr2=0x7f1cc80b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1cc80b66e0 0x7f1cc80b8bf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8006010 tx=0x7f1cd801a270 comp rx=0 tx=0).stop 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc1028d0 msgr2=0x7f1cdc10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc10ef50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1cd803ba20 tx=0x7f1cd8004cc0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 shutdown_connections 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1cc80b66e0 0x7f1cc80b8bf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1cdc108b60 0x7f1cdc10a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1cdc108210 0x7f1cdc10a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 --2- 172.21.15.81:0/2396706389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc1028d0 0x7f1cdc10ef50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.848+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 >> 172.21.15.81:0/2396706389 conn(0x7f1cdc0fe380 msgr2=0x7f1cdc1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.849+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 shutdown_connections 2024-09-21T03:04:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:46.849+0000 7f1ce31cd640 1 -- 172.21.15.81:0/2396706389 wait complete. 2024-09-21T03:04:47.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:46 smithi164 ceph-mon[34236]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T03:04:47.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:46 smithi181 ceph-mon[34096]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T03:04:47.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:46 smithi081 ceph-mon[30991]: pgmap v491: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T03:04:47.689 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T03:04:47.690 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T03:04:47.699 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T03:04:47.707 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T03:04:47.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:04:47.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 -- 172.21.15.81:0/1908321443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 msgr2=0x7f750810a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 --2- 172.21.15.81:0/1908321443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f750810a0e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7500009ca0 tx=0x7f750002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:04:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 -- 172.21.15.81:0/1908321443 shutdown_connections 2024-09-21T03:04:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 --2- 172.21.15.81:0/1908321443 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7508102da0 0x7f75081031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 --2- 172.21.15.81:0/1908321443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f750810a0e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 --2- 172.21.15.81:0/1908321443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7508101d20 0x7f7508102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 -- 172.21.15.81:0/1908321443 >> 172.21.15.81:0/1908321443 conn(0x7f75080fd680 msgr2=0x7f75080ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 -- 172.21.15.81:0/1908321443 shutdown_connections 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 -- 172.21.15.81:0/1908321443 wait complete. 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 Processor -- start 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.858+0000 7f751014a640 1 -- start start 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f751014a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7508101d20 0x7f75081048e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f751014a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7508102da0 0x7f750819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f751014a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f75081a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f751014a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f750810d7b0 con 0x7f7508103740 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f751014a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f750810d630 con 0x7f7508102da0 2024-09-21T03:04:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f751014a640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f750810d930 con 0x7f7508101d20 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f75081a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f75081a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59404/0 (socket says 172.21.15.81:59404) 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 -- 172.21.15.81:0/1467187975 learned_addr learned my addr 172.21.15.81:0/1467187975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750d6e5640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7508102da0 0x7f750819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750dee6640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7508101d20 0x7f75081048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 -- 172.21.15.81:0/1467187975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7508101d20 msgr2=0x7f75081048e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7508101d20 0x7f75081048e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 -- 172.21.15.81:0/1467187975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7508102da0 msgr2=0x7f750819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7508102da0 0x7f750819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 -- 172.21.15.81:0/1467187975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75081a1880 con 0x7f7508103740 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f750e6e7640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f75081a1080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7500009dc0 tx=0x7f7500003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.859+0000 7f74feffd640 1 -- 172.21.15.81:0/1467187975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500004240 con 0x7f7508103740 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.860+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75081a1b10 con 0x7f7508103740 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.860+0000 7f74feffd640 1 -- 172.21.15.81:0/1467187975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7500040030 con 0x7f7508103740 2024-09-21T03:04:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.860+0000 7f74feffd640 1 -- 172.21.15.81:0/1467187975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750003b430 con 0x7f7508103740 2024-09-21T03:04:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.860+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75081a20b0 con 0x7f7508103740 2024-09-21T03:04:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.860+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75081098d0 con 0x7f7508103740 2024-09-21T03:04:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.862+0000 7f74feffd640 1 -- 172.21.15.81:0/1467187975 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f75000305c0 con 0x7f7508103740 2024-09-21T03:04:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.863+0000 7f74feffd640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f74f40b6510 0x7f74f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.863+0000 7f750dee6640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f74f40b6510 0x7f74f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.863+0000 7f74feffd640 1 -- 172.21.15.81:0/1467187975 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f75001084d0 con 0x7f7508103740 2024-09-21T03:04:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.863+0000 7f750dee6640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f74f40b6510 0x7f74f40b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7504009bd0 tx=0x7f7504005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:47.866+0000 7f74feffd640 1 -- 172.21.15.81:0/1467187975 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75000d2e00 con 0x7f7508103740 2024-09-21T03:04:48.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.049+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f750802e810 con 0x7f7508103740 2024-09-21T03:04:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.050+0000 7f74feffd640 1 -- 172.21.15.81:0/1467187975 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7f75000d7d40 con 0x7f7508103740 2024-09-21T03:04:48.052 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:04:48.052 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:04:48.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.052+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f74f40b6510 msgr2=0x7f74f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.052+0000 7f751014a640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f74f40b6510 0x7f74f40b8a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7504009bd0 tx=0x7f7504005f90 comp rx=0 tx=0).stop 2024-09-21T03:04:48.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.052+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 msgr2=0x7f75081a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.052+0000 7f751014a640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f75081a1080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7500009dc0 tx=0x7f7500003ba0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 shutdown_connections 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f74f40b6510 0x7f74f40b8a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7508103740 0x7f75081a1080 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7508102da0 0x7f750819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 --2- 172.21.15.81:0/1467187975 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7508101d20 0x7f75081048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 >> 172.21.15.81:0/1467187975 conn(0x7f75080fd680 msgr2=0x7f75080fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 shutdown_connections 2024-09-21T03:04:48.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.053+0000 7f751014a640 1 -- 172.21.15.81:0/1467187975 wait complete. 2024-09-21T03:04:48.066 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T02:53:35.934095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T02:58:11.341827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T02:58:13.659116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T02:58:20.067521+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T03:04:48.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:04:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 -- 172.21.15.81:0/343277024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 msgr2=0x7f3d6010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 --2- 172.21.15.81:0/343277024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6010b8c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009ca0 tx=0x7f3d5802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 -- 172.21.15.81:0/343277024 shutdown_connections 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 --2- 172.21.15.81:0/343277024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d601068a0 0x7f3d60108cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 --2- 172.21.15.81:0/343277024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6010b8c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 --2- 172.21.15.81:0/343277024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d6006b1b0 0x7f3d60106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 -- 172.21.15.81:0/343277024 >> 172.21.15.81:0/343277024 conn(0x7f3d600fdee0 msgr2=0x7f3d60100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 -- 172.21.15.81:0/343277024 shutdown_connections 2024-09-21T03:04:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.177+0000 7f3d64c27640 1 -- 172.21.15.81:0/343277024 wait complete. 2024-09-21T03:04:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 Processor -- start 2024-09-21T03:04:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 -- start start 2024-09-21T03:04:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d6006b1b0 0x7f3d60199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d601068a0 0x7f3d6019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6019b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6010f1c0 con 0x7f3d601093b0 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6010f040 con 0x7f3d601068a0 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d64c27640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6010f340 con 0x7f3d6006b1b0 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6019b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6019b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59432/0 (socket says 172.21.15.81:59432) 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 -- 172.21.15.81:0/3314953564 learned_addr learned my addr 172.21.15.81:0/3314953564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5e59c640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d6006b1b0 0x7f3d60199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5dd9b640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d601068a0 0x7f3d6019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 -- 172.21.15.81:0/3314953564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d6006b1b0 msgr2=0x7f3d60199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d6006b1b0 0x7f3d60199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 -- 172.21.15.81:0/3314953564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d601068a0 msgr2=0x7f3d6019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d601068a0 0x7f3d6019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 -- 172.21.15.81:0/3314953564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6019b820 con 0x7f3d601093b0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.178+0000 7f3d5ed9d640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6019b000 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3d58005e30 tx=0x7f3d58003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.179+0000 7f3d4f7fe640 1 -- 172.21.15.81:0/3314953564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58032e90 con 0x7f3d601093b0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.179+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6019bab0 con 0x7f3d601093b0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.179+0000 7f3d4f7fe640 1 -- 172.21.15.81:0/3314953564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d580044d0 con 0x7f3d601093b0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.179+0000 7f3d4f7fe640 1 -- 172.21.15.81:0/3314953564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58030ce0 con 0x7f3d601093b0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.179+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d601a2200 con 0x7f3d601093b0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.180+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d60106cb0 con 0x7f3d601093b0 2024-09-21T03:04:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.182+0000 7f3d4f7fe640 1 -- 172.21.15.81:0/3314953564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3d58004040 con 0x7f3d601093b0 2024-09-21T03:04:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.183+0000 7f3d4f7fe640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3d480b6510 0x7f3d480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.183+0000 7f3d5e59c640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3d480b6510 0x7f3d480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.183+0000 7f3d4f7fe640 1 -- 172.21.15.81:0/3314953564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f3d58108ae0 con 0x7f3d601093b0 2024-09-21T03:04:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.183+0000 7f3d5e59c640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3d480b6510 0x7f3d480b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009b60 tx=0x7f3d50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.186+0000 7f3d4f7fe640 1 -- 172.21.15.81:0/3314953564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d580cf030 con 0x7f3d601093b0 2024-09-21T03:04:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.375+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3d6002e640 con 0x7f3d601093b0 2024-09-21T03:04:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.375+0000 7f3d4f7fe640 1 -- 172.21.15.81:0/3314953564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f3d580d3410 con 0x7f3d601093b0 2024-09-21T03:04:48.377 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3d480b6510 msgr2=0x7f3d480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3d480b6510 0x7f3d480b8a20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009b60 tx=0x7f3d50005f90 comp rx=0 tx=0).stop 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 msgr2=0x7f3d6019b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6019b000 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3d58005e30 tx=0x7f3d58003ba0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 shutdown_connections 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f3d480b6510 0x7f3d480b8a20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d601093b0 0x7f3d6019b000 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d601068a0 0x7f3d6019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 --2- 172.21.15.81:0/3314953564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d6006b1b0 0x7f3d60199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 >> 172.21.15.81:0/3314953564 conn(0x7f3d600fdee0 msgr2=0x7f3d60104d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 shutdown_connections 2024-09-21T03:04:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.377+0000 7f3d64c27640 1 -- 172.21.15.81:0/3314953564 wait complete. 2024-09-21T03:04:48.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T03:04:48.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.501+0000 7f4b98539640 1 -- 172.21.15.81:0/1555246172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 msgr2=0x7f4b90103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 --2- 172.21.15.81:0/1555246172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90103a30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009900 tx=0x7f4b8002a410 comp rx=0 tx=0).stop 2024-09-21T03:04:48.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- 172.21.15.81:0/1555246172 shutdown_connections 2024-09-21T03:04:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 --2- 172.21.15.81:0/1555246172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b90103fc0 0x7f4b9010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 --2- 172.21.15.81:0/1555246172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90103a30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 --2- 172.21.15.81:0/1555246172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b901025a0 0x7f4b90102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- 172.21.15.81:0/1555246172 >> 172.21.15.81:0/1555246172 conn(0x7f4b900fdee0 msgr2=0x7f4b90100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- 172.21.15.81:0/1555246172 shutdown_connections 2024-09-21T03:04:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- 172.21.15.81:0/1555246172 wait complete. 2024-09-21T03:04:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 Processor -- start 2024-09-21T03:04:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- start start 2024-09-21T03:04:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b901025a0 0x7f4b90198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b90103fc0 0x7f4b90199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010e090 con 0x7f4b90103620 2024-09-21T03:04:48.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010df10 con 0x7f4b901025a0 2024-09-21T03:04:48.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.502+0000 7f4b98539640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010e210 con 0x7f4b90103fc0 2024-09-21T03:04:48.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59450/0 (socket says 172.21.15.81:59450) 2024-09-21T03:04:48.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 -- 172.21.15.81:0/2857439256 learned_addr learned my addr 172.21.15.81:0/2857439256 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:48.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b962d5640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b901025a0 0x7f4b90198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b96ad6640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b90103fc0 0x7f4b90199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 -- 172.21.15.81:0/2857439256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b90103fc0 msgr2=0x7f4b90199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b90103fc0 0x7f4b90199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 -- 172.21.15.81:0/2857439256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b901025a0 msgr2=0x7f4b90198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b901025a0 0x7f4b90198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 -- 172.21.15.81:0/2857439256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9019a780 con 0x7f4b90103620 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b95ad4640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90199440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009a20 tx=0x7f4b80004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b877fe640 1 -- 172.21.15.81:0/2857439256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8003f030 con 0x7f4b90103620 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b877fe640 1 -- 172.21.15.81:0/2857439256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b80003a80 con 0x7f4b90103620 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9019aa10 con 0x7f4b90103620 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b877fe640 1 -- 172.21.15.81:0/2857439256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80035070 con 0x7f4b90103620 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.503+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b901a1010 con 0x7f4b90103620 2024-09-21T03:04:48.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.504+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90109770 con 0x7f4b90103620 2024-09-21T03:04:48.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.506+0000 7f4b877fe640 1 -- 172.21.15.81:0/2857439256 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4b80042030 con 0x7f4b90103620 2024-09-21T03:04:48.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.507+0000 7f4b877fe640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4b7c0b6510 0x7f4b7c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.507+0000 7f4b962d5640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4b7c0b6510 0x7f4b7c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.507+0000 7f4b877fe640 1 -- 172.21.15.81:0/2857439256 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f4b80108190 con 0x7f4b90103620 2024-09-21T03:04:48.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.507+0000 7f4b962d5640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4b7c0b6510 0x7f4b7c0b8a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c007ec0 tx=0x7f4b8c0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:48.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.510+0000 7f4b877fe640 1 -- 172.21.15.81:0/2857439256 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b800d2ac0 con 0x7f4b90103620 2024-09-21T03:04:48.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.688+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4b90063fc0 con 0x7f4b90103620 2024-09-21T03:04:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.688+0000 7f4b877fe640 1 -- 172.21.15.81:0/2857439256 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f4b800d7a00 con 0x7f4b90103620 2024-09-21T03:04:48.690 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-21T03:04:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4b7c0b6510 msgr2=0x7f4b7c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4b7c0b6510 0x7f4b7c0b8a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c007ec0 tx=0x7f4b8c0075b0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 msgr2=0x7f4b90199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90199440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009a20 tx=0x7f4b80004270 comp rx=0 tx=0).stop 2024-09-21T03:04:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 shutdown_connections 2024-09-21T03:04:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f4b7c0b6510 0x7f4b7c0b8a20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4b90103fc0 0x7f4b90199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b90103620 0x7f4b90199440 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 --2- 172.21.15.81:0/2857439256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4b901025a0 0x7f4b90198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 >> 172.21.15.81:0/2857439256 conn(0x7f4b900fdee0 msgr2=0x7f4b90106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 shutdown_connections 2024-09-21T03:04:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.690+0000 7f4b98539640 1 -- 172.21.15.81:0/2857439256 wait complete. 2024-09-21T03:04:48.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T03:04:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.813+0000 7fb475207640 1 -- 172.21.15.81:0/167687135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103600 msgr2=0x7fb470103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.813+0000 7fb475207640 1 --2- 172.21.15.81:0/167687135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103600 0x7fb470103a10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb458009900 tx=0x7fb45802a410 comp rx=0 tx=0).stop 2024-09-21T03:04:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.813+0000 7fb475207640 1 -- 172.21.15.81:0/167687135 shutdown_connections 2024-09-21T03:04:48.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.813+0000 7fb475207640 1 --2- 172.21.15.81:0/167687135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb470103fa0 0x7fb47010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.813+0000 7fb475207640 1 --2- 172.21.15.81:0/167687135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103600 0x7fb470103a10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.813+0000 7fb475207640 1 --2- 172.21.15.81:0/167687135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb470102580 0x7fb4701029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.813+0000 7fb475207640 1 -- 172.21.15.81:0/167687135 >> 172.21.15.81:0/167687135 conn(0x7fb4700fdee0 msgr2=0x7fb470100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:48.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.814+0000 7fb475207640 1 -- 172.21.15.81:0/167687135 shutdown_connections 2024-09-21T03:04:48.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.814+0000 7fb475207640 1 -- 172.21.15.81:0/167687135 wait complete. 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.814+0000 7fb475207640 1 Processor -- start 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.814+0000 7fb475207640 1 -- start start 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb475207640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb470102580 0x7fb470199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb475207640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb470103600 0x7fb47019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb475207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103fa0 0x7fb47019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb475207640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb47010f1e0 con 0x7fb470103fa0 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb475207640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb47010f060 con 0x7fb470102580 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb475207640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fb47010f360 con 0x7fb470103600 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103fa0 0x7fb47019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103fa0 0x7fb47019b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59464/0 (socket says 172.21.15.81:59464) 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 -- 172.21.15.81:0/1962868163 learned_addr learned my addr 172.21.15.81:0/1962868163 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46ed9d640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb470102580 0x7fb470199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46659c640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb470103600 0x7fb47019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 -- 172.21.15.81:0/1962868163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb470103600 msgr2=0x7fb47019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb470103600 0x7fb47019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 -- 172.21.15.81:0/1962868163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb470102580 msgr2=0x7fb470199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb470102580 0x7fb470199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 -- 172.21.15.81:0/1962868163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47019b900 con 0x7fb470103fa0 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46f59e640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103fa0 0x7fb47019b0e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb46800cad0 tx=0x7fb46800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.815+0000 7fb46cd99640 1 -- 172.21.15.81:0/1962868163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46800ae20 con 0x7fb470103fa0 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.816+0000 7fb46cd99640 1 -- 172.21.15.81:0/1962868163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb468005020 con 0x7fb470103fa0 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.816+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb47019bbf0 con 0x7fb470103fa0 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.816+0000 7fb46cd99640 1 -- 172.21.15.81:0/1962868163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46800f6b0 con 0x7fb470103fa0 2024-09-21T03:04:48.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.816+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4701a22e0 con 0x7fb470103fa0 2024-09-21T03:04:48.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.817+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb470109750 con 0x7fb470103fa0 2024-09-21T03:04:48.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.818+0000 7fb46cd99640 1 -- 172.21.15.81:0/1962868163 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb4680051d0 con 0x7fb470103fa0 2024-09-21T03:04:48.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.819+0000 7fb46cd99640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb45c0b6510 0x7fb45c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:48.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.819+0000 7fb46ed9d640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb45c0b6510 0x7fb45c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:48.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.819+0000 7fb46cd99640 1 -- 172.21.15.81:0/1962868163 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fb4680e7ad0 con 0x7fb470103fa0 2024-09-21T03:04:48.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.819+0000 7fb46ed9d640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb45c0b6510 0x7fb45c0b8a20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb460009890 tx=0x7fb460008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:48.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:48.822+0000 7fb46cd99640 1 -- 172.21.15.81:0/1962868163 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb468014030 con 0x7fb470103fa0 2024-09-21T03:04:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.003+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb47002e640 con 0x7fb470103fa0 2024-09-21T03:04:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.003+0000 7fb46cd99640 1 -- 172.21.15.81:0/1962868163 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7fb4680ae020 con 0x7fb470103fa0 2024-09-21T03:04:49.005 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-21T03:04:49.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb45c0b6510 msgr2=0x7fb45c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb45c0b6510 0x7fb45c0b8a20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb460009890 tx=0x7fb460008040 comp rx=0 tx=0).stop 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103fa0 msgr2=0x7fb47019b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103fa0 0x7fb47019b0e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb46800cad0 tx=0x7fb46800cf90 comp rx=0 tx=0).stop 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 shutdown_connections 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fb45c0b6510 0x7fb45c0b8a20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb470103600 0x7fb47019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb470103fa0 0x7fb47019b0e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 --2- 172.21.15.81:0/1962868163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb470102580 0x7fb470199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 >> 172.21.15.81:0/1962868163 conn(0x7fb4700fdee0 msgr2=0x7fb470106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 shutdown_connections 2024-09-21T03:04:49.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.006+0000 7fb475207640 1 -- 172.21.15.81:0/1962868163 wait complete. 2024-09-21T03:04:49.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:48 smithi081 ceph-mon[30991]: pgmap v492: 129 pgs: 129 active+clean; 8.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.6 KiB/s wr, 38 op/s 2024-09-21T03:04:49.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:48 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1467187975' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:04:49.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:48 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3314953564' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:04:49.018 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:48 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2857439256' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:04:49.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 -- 172.21.15.81:0/11805297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 msgr2=0x7fd8f41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/11805297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f41031c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009900 tx=0x7fd8e402a410 comp rx=0 tx=0).stop 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 -- 172.21.15.81:0/11805297 shutdown_connections 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/11805297 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8f4103750 0x7fd8f410a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/11805297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f41031c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/11805297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f4101d30 0x7fd8f41021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 -- 172.21.15.81:0/11805297 >> 172.21.15.81:0/11805297 conn(0x7fd8f40fd690 msgr2=0x7fd8f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 -- 172.21.15.81:0/11805297 shutdown_connections 2024-09-21T03:04:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.129+0000 7fd8fad5e640 1 -- 172.21.15.81:0/11805297 wait complete. 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 Processor -- start 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 -- start start 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8f4101d30 0x7fd8f4198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f4199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f4103750 0x7fd8f4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f410e0b0 con 0x7fd8f4102db0 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f410df30 con 0x7fd8f4103750 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8fad5e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f410e230 con 0x7fd8f4101d30 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f4199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f4199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59480/0 (socket says 172.21.15.81:59480) 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8ebfff640 1 -- 172.21.15.81:0/902853401 learned_addr learned my addr 172.21.15.81:0/902853401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8f8afa640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8f4101d30 0x7fd8f4198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8f92fb640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f4103750 0x7fd8f4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8ebfff640 1 -- 172.21.15.81:0/902853401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8f4101d30 msgr2=0x7fd8f4198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8ebfff640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8f4101d30 0x7fd8f4198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8ebfff640 1 -- 172.21.15.81:0/902853401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f4103750 msgr2=0x7fd8f4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.130+0000 7fd8ebfff640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f4103750 0x7fd8f4199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8ebfff640 1 -- 172.21.15.81:0/902853401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f419a7d0 con 0x7fd8f4102db0 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8f8afa640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8f4101d30 0x7fd8f4198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8ebfff640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f4199400 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009230 tx=0x7fd8e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8e9ffb640 1 -- 172.21.15.81:0/902853401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4046070 con 0x7fd8f4102db0 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8e9ffb640 1 -- 172.21.15.81:0/902853401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8e4003a80 con 0x7fd8f4102db0 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f419aa60 con 0x7fd8f4102db0 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8e9ffb640 1 -- 172.21.15.81:0/902853401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4035050 con 0x7fd8f4102db0 2024-09-21T03:04:49.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.131+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f419ad70 con 0x7fd8f4102db0 2024-09-21T03:04:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.132+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f410b730 con 0x7fd8f4102db0 2024-09-21T03:04:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.134+0000 7fd8e9ffb640 1 -- 172.21.15.81:0/902853401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd8e4049070 con 0x7fd8f4102db0 2024-09-21T03:04:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.134+0000 7fd8e9ffb640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd8dc0b6510 0x7fd8dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.135+0000 7fd8f8afa640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd8dc0b6510 0x7fd8dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.135+0000 7fd8e9ffb640 1 -- 172.21.15.81:0/902853401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fd8e41097c0 con 0x7fd8f4102db0 2024-09-21T03:04:49.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.135+0000 7fd8f8afa640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd8dc0b6510 0x7fd8dc0b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009b40 tx=0x7fd8f0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.138+0000 7fd8e9ffb640 1 -- 172.21.15.81:0/902853401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8e4050020 con 0x7fd8f4102db0 2024-09-21T03:04:49.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:48 smithi164 ceph-mon[34236]: pgmap v492: 129 pgs: 129 active+clean; 8.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.6 KiB/s wr, 38 op/s 2024-09-21T03:04:49.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:48 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1467187975' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:04:49.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:48 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3314953564' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:04:49.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:48 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2857439256' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:04:49.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:48 smithi181 ceph-mon[34096]: pgmap v492: 129 pgs: 129 active+clean; 8.7 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.6 KiB/s wr, 38 op/s 2024-09-21T03:04:49.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:48 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1467187975' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:04:49.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:48 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3314953564' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:04:49.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:48 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2857439256' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:04:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.315+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd8f41089f0 con 0x7fd8f4102db0 2024-09-21T03:04:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.316+0000 7fd8e9ffb640 1 -- 172.21.15.81:0/902853401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v82) ==== 103+0+11 (secure 0 0 0) 0x7fd8e40cfcb0 con 0x7fd8f4102db0 2024-09-21T03:04:49.317 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd8dc0b6510 msgr2=0x7fd8dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd8dc0b6510 0x7fd8dc0b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009b40 tx=0x7fd8f0005e50 comp rx=0 tx=0).stop 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 msgr2=0x7fd8f4199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f4199400 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009230 tx=0x7fd8e4004270 comp rx=0 tx=0).stop 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 shutdown_connections 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fd8dc0b6510 0x7fd8dc0b8a20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8f4103750 0x7fd8f4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f4102db0 0x7fd8f4199400 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 --2- 172.21.15.81:0/902853401 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd8f4101d30 0x7fd8f4198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 >> 172.21.15.81:0/902853401 conn(0x7fd8f40fd690 msgr2=0x7fd8f41060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 shutdown_connections 2024-09-21T03:04:49.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.318+0000 7fd8fad5e640 1 -- 172.21.15.81:0/902853401 wait complete. 2024-09-21T03:04:49.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.437+0000 7f260f333640 1 -- 172.21.15.81:0/3396894474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 msgr2=0x7f2608105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.437+0000 7f260f333640 1 --2- 172.21.15.81:0/3396894474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608105070 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2604009900 tx=0x7f260402a410 comp rx=0 tx=0).stop 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.437+0000 7f260f333640 1 -- 172.21.15.81:0/3396894474 shutdown_connections 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.437+0000 7f260f333640 1 --2- 172.21.15.81:0/3396894474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26081082d0 0x7f260810a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.437+0000 7f260f333640 1 --2- 172.21.15.81:0/3396894474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26081056b0 0x7f2608107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.437+0000 7f260f333640 1 --2- 172.21.15.81:0/3396894474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608105070 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.437+0000 7f260f333640 1 -- 172.21.15.81:0/3396894474 >> 172.21.15.81:0/3396894474 conn(0x7f26080fd660 msgr2=0x7f26080ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 -- 172.21.15.81:0/3396894474 shutdown_connections 2024-09-21T03:04:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 -- 172.21.15.81:0/3396894474 wait complete. 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 Processor -- start 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 -- start start 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608102030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26081056b0 0x7f26081a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26081082d0 0x7f26081a3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f260810e070 con 0x7f2608102c30 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f260810def0 con 0x7f26081082d0 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260f333640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f260810e1f0 con 0x7f26081056b0 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260d0cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608102030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260d0cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608102030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59486/0 (socket says 172.21.15.81:59486) 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.438+0000 7f260d0cf640 1 -- 172.21.15.81:0/906311234 learned_addr learned my addr 172.21.15.81:0/906311234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260d8d0640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26081082d0 0x7f26081a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260d0cf640 1 -- 172.21.15.81:0/906311234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26081056b0 msgr2=0x7f26081a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260c8ce640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26081056b0 0x7f26081a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260d0cf640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26081056b0 0x7f26081a0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260d0cf640 1 -- 172.21.15.81:0/906311234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26081082d0 msgr2=0x7f26081a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260d0cf640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26081082d0 0x7f26081a3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260d0cf640 1 -- 172.21.15.81:0/906311234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26081a3aa0 con 0x7f2608102c30 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260d0cf640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608102030 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2604009a20 tx=0x7f26040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f25fe7fc640 1 -- 172.21.15.81:0/906311234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260403f030 con 0x7f2608102c30 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26081a3d30 con 0x7f2608102c30 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f25fe7fc640 1 -- 172.21.15.81:0/906311234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26040044c0 con 0x7f2608102c30 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f25fe7fc640 1 -- 172.21.15.81:0/906311234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604035070 con 0x7f2608102c30 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.439+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26081a41c0 con 0x7f2608102c30 2024-09-21T03:04:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.440+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26080ff180 con 0x7f2608102c30 2024-09-21T03:04:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.443+0000 7f25fe7fc640 1 -- 172.21.15.81:0/906311234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2604042030 con 0x7f2608102c30 2024-09-21T03:04:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.443+0000 7f25fe7fc640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25f40b6510 0x7f25f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:04:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.444+0000 7f260c8ce640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25f40b6510 0x7f25f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:04:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.444+0000 7f25fe7fc640 1 -- 172.21.15.81:0/906311234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f2604108130 con 0x7f2608102c30 2024-09-21T03:04:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.444+0000 7f260c8ce640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25f40b6510 0x7f25f40b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009aa0 tx=0x7f25f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:04:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.447+0000 7f25fe7fc640 1 -- 172.21.15.81:0/906311234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26040ce680 con 0x7f2608102c30 2024-09-21T03:04:49.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.672+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f260802e810 con 0x7f2608102c30 2024-09-21T03:04:49.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.681+0000 7f25fe7fc640 1 -- 172.21.15.81:0/906311234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+833522 (secure 0 0 0) 0x7f26040d2a60 con 0x7f2608102c30 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 18, 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "active_gid": 14150, 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "active_name": "x", 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addrs": { 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-21T03:04:49.692 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3007447899 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3007447899 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addr": "172.21.15.81:6801/3007447899", 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "active_change": "2024-09-21T02:50:47.609687+0000", 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "available": true, 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "standbys": [ 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.693 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24109, 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "z", 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540719139924082687, 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.695 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.697 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.702 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-21T03:04:49.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-21T03:04:49.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-21T03:04:49.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-21T03:04:49.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.707 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-21T03:04:49.711 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:49.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.713 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:04:49.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:04:49.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.717 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.718 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.719 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.720 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.721 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:49.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-21T03:04:49.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-21T03:04:49.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-21T03:04:49.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.733 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.735 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.736 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.737 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:04:49.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:04:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.747 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nginx": { 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nginx", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.748 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nginx container image", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:49.749 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-21T03:04:49.750 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:04:49.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:49.752 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba_metrics": { 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.755 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-21T03:04:49.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.759 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.760 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.761 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.762 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.764 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.766 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.768 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.769 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.770 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.771 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.773 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.777 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-21T03:04:49.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.780 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:04:49.782 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.783 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-21T03:04:49.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-21T03:04:49.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_interval": { 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-21T03:04:49.788 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.790 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.791 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.797 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.798 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.799 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.800 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.802 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.803 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:04:49.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.811 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.812 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.813 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.817 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.820 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "[]", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "{}", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:04:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:04:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "sso_oauth2": { 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sso_oauth2", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-21T03:04:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-21T03:04:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:04:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-21T03:04:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.910 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.911 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.912 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.914 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.915 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.916 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.918 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.919 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.920 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.921 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.923 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.924 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.927 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.928 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.929 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.930 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.931 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.933 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.934 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.935 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.936 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-21T03:04:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.939 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.941 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.942 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.943 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.945 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.946 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.947 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.949 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.950 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.955 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.959 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.962 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-21T03:04:49.964 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.965 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.969 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.970 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.971 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.973 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.974 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.975 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.976 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.977 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.981 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.982 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.983 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.986 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.987 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.988 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.991 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.993 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.994 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.995 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:49.996 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-21T03:04:49.997 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:49.998 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:49.999 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.000 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.001 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.002 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.004 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.008 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.009 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.010 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.011 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-21T03:04:50.012 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.013 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.017 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.018 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.020 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.021 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.025 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.026 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.028 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max_requests": { 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_requests", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.030 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.031 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.032 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.034 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.035 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.036 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.038 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.039 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-21T03:04:50.040 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.041 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.046 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.047 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.048 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.049 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-21T03:04:50.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.053 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.054 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.055 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.057 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.059 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.060 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.066 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smb", 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "internal_store_backend": { 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "internal_store_backend", 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.073 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.074 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "update_orchestration": { 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "update_orchestration", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.075 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.078 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.080 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:04:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:04:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-21T03:04:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-21T03:04:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-21T03:04:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-21T03:04:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24119, 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "y", 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540719139924082687, 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-21T03:04:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-21T03:04:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-21T03:04:50.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:04:50.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.190 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:04:50.191 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.192 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:04:50.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.196 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:04:50.197 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.199 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.201 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:04:50.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-21T03:04:50.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-21T03:04:50.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:04:50.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:04:50.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:04:50.208 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.209 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nginx": { 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nginx", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nginx container image", 2024-09-21T03:04:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-21T03:04:50.213 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-21T03:04:50.214 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-21T03:04:50.215 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba_metrics": { 2024-09-21T03:04:50.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-21T03:04:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-21T03:04:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-21T03:04:50.236 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.237 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.238 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.239 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-21T03:04:50.240 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-21T03:04:50.241 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.242 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.243 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.247 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.248 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.249 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:04:50.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_interval": { 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.251 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.254 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.255 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.256 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.258 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.259 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.260 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-21T03:04:50.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-21T03:04:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.266 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.268 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.269 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.273 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.274 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.275 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.278 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.279 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:04:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.283 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.284 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.285 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.286 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "[]", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "{}", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.288 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.291 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.293 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.300 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.302 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.304 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:04:50.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:04:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:04:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:04:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-21T03:04:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-21T03:04:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-21T03:04:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:04:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-21T03:04:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "sso_oauth2": { 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sso_oauth2", 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-21T03:04:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.342 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.343 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:04:50.344 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.345 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.346 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.347 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.348 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.349 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.350 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-21T03:04:50.357 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.358 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.361 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.364 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-21T03:04:50.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-21T03:04:50.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.370 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.371 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.372 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.373 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.374 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.376 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.378 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.379 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.380 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.381 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.382 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.386 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.387 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.388 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.390 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.393 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-21T03:04:50.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-21T03:04:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-21T03:04:50.398 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.399 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.401 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.404 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.405 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.407 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-21T03:04:50.408 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.409 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.410 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.411 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.417 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.418 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.419 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.421 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.423 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.424 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.425 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.426 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.427 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-21T03:04:50.429 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.430 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.435 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.436 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.439 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.440 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.441 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.443 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.444 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.445 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.448 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-21T03:04:50.449 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.450 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.453 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.454 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.459 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.461 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.465 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.466 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.469 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.471 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:04:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-21T03:04:50.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.478 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.479 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.480 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.482 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.483 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.485 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.486 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.487 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.488 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.489 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.490 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.491 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.494 INFO:teuthology.orchestra.run.smithi081.stdout: "max_requests": { 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_requests", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-21T03:04:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.500 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:04:50.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.505 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.508 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-21T03:04:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.513 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.516 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.517 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.518 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.522 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.523 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.524 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.525 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.526 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.527 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-21T03:04:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-21T03:04:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smb", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "internal_store_backend": { 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "internal_store_backend", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.531 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.536 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "update_orchestration": { 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "update_orchestration", 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:04:50.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.543 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.544 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.547 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.548 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.549 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.551 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.554 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.557 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.558 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.565 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.567 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.568 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:04:50.569 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:04:50.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-21T03:04:50.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-21T03:04:50.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-21T03:04:50.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-21T03:04:50.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.596 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:04:50.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-21T03:04:50.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-21T03:04:50.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:04:50.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "modules": [ 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard", 2024-09-21T03:04:50.615 INFO:teuthology.orchestra.run.smithi081.stdout: "iostat", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "nfs", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "restful" 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.616 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.617 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-21T03:04:50.625 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.626 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.627 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.628 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.629 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.630 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.631 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.634 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-21T03:04:50.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.636 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-21T03:04:50.637 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.638 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.640 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.644 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-21T03:04:50.647 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:04:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.650 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:04:50.651 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:04:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.658 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.659 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-21T03:04:50.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.662 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.664 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.665 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.667 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nginx": { 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nginx", 2024-09-21T03:04:50.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nginx container image", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.669 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.671 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:04:50.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:04:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.677 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba_metrics": { 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.679 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.681 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-21T03:04:50.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.685 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.690 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.691 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:04:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.693 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.694 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.697 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.699 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.700 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:04:50.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.702 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.706 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.708 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_interval": { 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.712 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.713 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-21T03:04:50.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.717 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.720 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.721 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:04:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.723 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.732 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.735 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.736 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.737 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:04:50.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.740 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.741 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.742 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:04:50.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.745 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.746 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.747 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.748 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.749 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "[]", 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.750 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "{}", 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:04:50.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.755 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.756 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.757 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:04:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-21T03:04:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:04:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:04:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:04:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-21T03:04:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "sso_oauth2": { 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sso_oauth2", 2024-09-21T03:04:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-21T03:04:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-21T03:04:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-21T03:04:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:04:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:04:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:04:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-21T03:04:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-21T03:04:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.854 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.856 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.857 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.860 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.862 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.863 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.865 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:04:50.867 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.868 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.871 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.872 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.873 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.874 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-21T03:04:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-21T03:04:50.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.879 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.881 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.883 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.888 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.890 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.894 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.896 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.897 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.898 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.900 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.901 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.902 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.903 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.904 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-21T03:04:50.908 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-21T03:04:50.910 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.911 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.914 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.916 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.918 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.921 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.923 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.924 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.925 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.926 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.929 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.930 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.933 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:04:50.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-21T03:04:50.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.936 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.937 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.938 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.939 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.941 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.944 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.945 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.947 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.949 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.951 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.952 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.953 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.956 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.957 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.958 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.960 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.961 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.963 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-21T03:04:50.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.966 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.968 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.969 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-21T03:04:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:04:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "max_requests": { 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_requests", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-21T03:04:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smb", 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "internal_store_backend": { 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "internal_store_backend", 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "update_orchestration": { 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "update_orchestration", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.055 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.059 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.060 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.061 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.062 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.064 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.065 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:51.068 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.069 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.070 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-21T03:04:51.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.074 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.075 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.076 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-21T03:04:51.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.081 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.082 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.086 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.087 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-21T03:04:51.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-21T03:04:51.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.090 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.092 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.094 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.095 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.096 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.098 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.101 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-21T03:04:51.107 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.108 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.109 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.110 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-21T03:04:51.111 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.112 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.114 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.117 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-21T03:04:51.118 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.121 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-21T03:04:51.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-21T03:04:51.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "services": { 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard": "https://172.21.15.81:8443/" 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "always_on_modules": { 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus": [ 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-21T03:04:51.125 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific": [ 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-21T03:04:51.126 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy": [ 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-21T03:04:51.127 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "reef": [ 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-21T03:04:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "squid": [ 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-21T03:04:51.129 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "last_failure_osd_epoch": 3, 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "active_clients": [ 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-21T03:04:51.130 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1881792293 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "libcephsqlite", 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1032110273 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:51.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 361619384 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.132 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1851444584 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T03:04:51.133 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:04:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.686+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25f40b6510 msgr2=0x7f25f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25f40b6510 0x7f25f40b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009aa0 tx=0x7f25f8005f90 comp rx=0 tx=0).stop 2024-09-21T03:04:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 msgr2=0x7f2608102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:04:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608102030 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2604009a20 tx=0x7f26040040c0 comp rx=0 tx=0).stop 2024-09-21T03:04:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 shutdown_connections 2024-09-21T03:04:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f25f40b6510 0x7f25f40b8a20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f26081056b0 0x7f26081a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26081082d0 0x7f26081a3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 --2- 172.21.15.81:0/906311234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2608102c30 0x7f2608102030 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:04:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 >> 172.21.15.81:0/906311234 conn(0x7f26080fd660 msgr2=0x7f2608103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:04:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 shutdown_connections 2024-09-21T03:04:51.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:04:49.687+0000 7f260f333640 1 -- 172.21.15.81:0/906311234 wait complete. 2024-09-21T03:04:51.177 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T03:04:51.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T03:04:51.178 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1962868163' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:04:51.178 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/902853401' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T03:04:51.178 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:49 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/906311234' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:04:51.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1962868163' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:04:51.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/902853401' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T03:04:51.179 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:49 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/906311234' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:04:51.179 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1962868163' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:04:51.180 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/902853401' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T03:04:51.180 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:49 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/906311234' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:04:51.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:50 smithi164 ceph-mon[34236]: pgmap v493: 129 pgs: 129 active+clean; 4.9 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.9 KiB/s wr, 118 op/s 2024-09-21T03:04:51.205 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:50 smithi081 ceph-mon[30991]: pgmap v493: 129 pgs: 129 active+clean; 4.9 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.9 KiB/s wr, 118 op/s 2024-09-21T03:04:51.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:50 smithi181 ceph-mon[34096]: pgmap v493: 129 pgs: 129 active+clean; 4.9 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.9 KiB/s wr, 118 op/s 2024-09-21T03:04:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:04:51.930 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:04:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:04:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-09-21T03:04:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-09-21T03:04:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001268325, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000262585, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 5, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 87, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3104, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 95600, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 3, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.011174265, 2024-09-21T03:04:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.007188045, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.003228482, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 86, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.008080549, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000093959 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 95600 2024-09-21T03:04:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 115, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 112, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 498400, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 68368, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.020444485, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009658807, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.015256851, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 111, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.005917862, 2024-09-21T03:04:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000053314 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 498400, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 68368 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T03:04:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:04:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T03:04:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148863, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 28, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:04:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 968, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T03:04:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 116, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 482202, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 116, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 116, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 482202, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:51.941 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:04:52.795 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T03:04:52.795 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T03:04:52.795 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-21T03:04:52.795 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-21T03:04:52.795 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T03:04:52.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T03:04:53.083 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:04:53.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:52 smithi164 ceph-mon[34236]: pgmap v494: 129 pgs: 129 active+clean; 89 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.8 KiB/s wr, 224 op/s 2024-09-21T03:04:53.203 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:52 smithi081 ceph-mon[30991]: pgmap v494: 129 pgs: 129 active+clean; 89 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.8 KiB/s wr, 224 op/s 2024-09-21T03:04:53.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:52 smithi181 ceph-mon[34096]: pgmap v494: 129 pgs: 129 active+clean; 89 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.8 KiB/s wr, 224 op/s 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-21T03:04:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001097489, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000159621, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 89, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 95856, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 3, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.008799377, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.006706159, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001213426, 2024-09-21T03:04:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 87, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.004531019, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000052080 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 95856 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 125, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 120, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 503040, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 72176, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.023070508, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.010377081, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.016970070, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 120, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010184285, 2024-09-21T03:04:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000084869 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 503040, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 72176 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T03:04:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:04:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:04:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148823, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 27, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:04:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 968, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T03:04:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 122, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 483046, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 122, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 122, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 483046, 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T03:04:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:53.627 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:04:54.549 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T03:04:54.549 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T03:04:54.549 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T03:04:54.549 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T03:04:54.549 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T03:04:54.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T03:04:54.798 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:04:55.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:54 smithi164 ceph-mon[34236]: pgmap v495: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.8 KiB/s wr, 224 op/s 2024-09-21T03:04:55.213 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:54 smithi081 ceph-mon[30991]: pgmap v495: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.8 KiB/s wr, 224 op/s 2024-09-21T03:04:55.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:54 smithi181 ceph-mon[34096]: pgmap v495: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.8 KiB/s wr, 224 op/s 2024-09-21T03:04:55.333 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:04:55.333 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:04:55.333 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-09-21T03:04:55.333 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-09-21T03:04:55.333 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001030816, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000132240, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:55.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 5, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 89, 2024-09-21T03:04:55.335 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3104, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 95952, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 3, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.010875787, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.006869466, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.003233946, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 88, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.007790419, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000088527 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.336 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 95952 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 117, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 114, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 498944, 2024-09-21T03:04:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 69648, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.021245054, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.010256301, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.015613816, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 113, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.006115382, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000054118 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.338 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 498944, 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 69648 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T03:04:55.339 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:04:55.340 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:04:55.341 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148823, 2024-09-21T03:04:55.342 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 27, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:04:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 968, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T03:04:55.344 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 118, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 482462, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 118, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 118, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 482462, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:55.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:55.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:55.346 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:04:56.157 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T03:04:56.157 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T03:04:56.157 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T03:04:56.157 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T03:04:56.157 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T03:04:56.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T03:04:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:04:56.926 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T03:04:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:04:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4, 2024-09-21T03:04:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 4, 2024-09-21T03:04:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 2944, 2024-09-21T03:04:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 448, 2024-09-21T03:04:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.002916080, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000041934, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.002045883, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.003801101, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001267033 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 91, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 96208, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 3, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.009408727, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.007132419, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001397882, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 89, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.004841950, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000054403 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 96208 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 123, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 120, 2024-09-21T03:04:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 500640, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 73008, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.021361129, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.010234501, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.015389182, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 119, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.006188677, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000052005 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 500640, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 73008 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:04:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:04:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:04:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148823, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 27, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:04:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 968, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 124, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 483306, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 124, 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 124, 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 483306, 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T03:04:56.936 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T03:04:57.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:56 smithi164 ceph-mon[34236]: pgmap v496: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.8 KiB/s wr, 225 op/s 2024-09-21T03:04:57.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:56 smithi181 ceph-mon[34096]: pgmap v496: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.8 KiB/s wr, 225 op/s 2024-09-21T03:04:57.294 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:56 smithi081 ceph-mon[30991]: pgmap v496: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.8 KiB/s wr, 225 op/s 2024-09-21T03:04:57.794 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T03:04:57.794 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T03:04:57.795 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T03:04:57.795 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T03:04:57.795 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T03:04:57.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T03:04:58.056 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:04:58.604 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 1647, 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 1633, 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 970153, 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 1293689, 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 67, 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 4, 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.185089066, 2024-09-21T03:04:58.605 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.068339600, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.086779915, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.031729716, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 1633, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.461638854, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000282693 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 704, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000160499, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000227 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.606 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 558656, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 77472 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 1551, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 1375, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 471694, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 750545, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 12, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 6, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.168761075, 2024-09-21T03:04:58.607 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.060572815, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.051119063, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.052570637, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 1373, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.211165138, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000153798 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 743, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000172053, 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000231 2024-09-21T03:04:58.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 55616, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 270352 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 2245, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 2240, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 599294, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 1249290, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 13, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 6, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.215233529, 2024-09-21T03:04:58.609 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.090835775, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.061712860, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.059461616, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2238, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.200939293, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000089785 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 700, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000158226, 2024-09-21T03:04:58.610 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000226 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 1, 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "finisher-MDSRank": { 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "queue_len": 0, 2024-09-21T03:04:58.611 INFO:teuthology.orchestra.run.smithi164.stdout: "complete_latency": { 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 538, 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.103558820, 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000192488 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "finisher-PurgeQueue": { 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "queue_len": 0, 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "complete_latency": { 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2863, 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.094257011, 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000032922 2024-09-21T03:04:58.612 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "mds": { 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "request": 75, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "reply": 75, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "reply_latency": { 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 75, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 19.771760660, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.263623475 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "slow_reply": 0, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "forward": 0, 2024-09-21T03:04:58.613 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_fetch_complete": 0, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_fetch_keys": 0, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_commit": 117, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_split": 0, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_merge": 0, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes": 24, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_top": 4, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_bottom": 20, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_pin_tail": 0, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_pinned": 17, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_expired": 0, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_with_caps": 2, 2024-09-21T03:04:58.614 INFO:teuthology.orchestra.run.smithi164.stdout: "caps": 2, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "subtrees": 2, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse": 130, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_hit": 103, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_forward": 0, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_discover": 0, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_remote_ino": 0, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_lock": 0, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "load_cent": 653, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "q": 0, 2024-09-21T03:04:58.615 INFO:teuthology.orchestra.run.smithi164.stdout: "exported": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "exported_inodes": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "imported": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "imported_inodes": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_dir_fetch": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_peer_discover": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rfiles": 4, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rbytes": 234, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rsnaps": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_set_tag": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:04:58.616 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_file_inodes": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_revoke": 27, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_grant": 72, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_caps": 87, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_caps_dirty": 57, 2024-09-21T03:04:58.617 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_cap_release": 4, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "process_request_cap_release": 32 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_cache": { 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_update": 9, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_update_receipt": 0, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_try_discover": 0, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_send_discover": 0, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_handle_discover": 20, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays": 0, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays_delayed": 0, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:04:58.618 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_created": 5, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_enqueued": 5, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_reintegrated": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_migrated": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_processing": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "recovery_started": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "recovery_completed": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_quiesce_path": 4, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_quiesce_inode": 54, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:04:58.619 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_exportdir": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_flush": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_fragstats": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_inodestats": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_started": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_succeeded": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_write_failed": 0 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_log": { 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "evlrg": 0, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "evadd": 146, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "evex": 137, 2024-09-21T03:04:58.620 INFO:teuthology.orchestra.run.smithi164.stdout: "evtrm": 137, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "ev": 9, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "evexg": 0, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "evexd": 3, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "segadd": 21, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "segex": 20, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "segtrm": 20, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "seg": 1, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "segmjr": 1, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "segexg": 0, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "segexd": 1, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "expos": 4594452, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "wrpos": 4619523, 2024-09-21T03:04:58.621 INFO:teuthology.orchestra.run.smithi164.stdout: "rdpos": 0, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "jlat": { 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 122, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.278816591, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.002285381 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "replayed": 0 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_mem": { 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 23, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "ino+": 28, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "ino-": 5, 2024-09-21T03:04:58.622 INFO:teuthology.orchestra.run.smithi164.stdout: "dir": 18, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "dir+": 20, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "dir-": 2, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "dn": 24, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "dn+": 34, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "dn-": 10, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "cap": 2, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "cap+": 19, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "cap-": 17, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "rss": 123504, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "heap": 335298560 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_server": { 2024-09-21T03:04:58.623 INFO:teuthology.orchestra.run.smithi164.stdout: "dispatch_client_request": 107, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "dispatch_server_request": 1, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_request": 75, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_session": 15, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_peer_request": 2, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "req_create_latency": { 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 7, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.008566252, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.001223750 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getattr_latency": { 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 27, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.008064095, 2024-09-21T03:04:58.624 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000298670 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getfilelock_latency": { 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "req_link_latency": { 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.625 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookup_latency": { 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 13, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.008041815, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000618601 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookuphash_latency": { 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupino_latency": { 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.626 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupname_latency": { 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupparent_latency": { 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupsnap_latency": { 2024-09-21T03:04:58.627 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.628 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.628 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.628 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lssnap_latency": { 2024-09-21T03:04:58.628 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.628 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mkdir_latency": { 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 8, 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.013731765, 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.001716470 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mknod_latency": { 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mksnap_latency": { 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "req_open_latency": { 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 1, 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000446982, 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000446982 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "req_readdir_latency": { 2024-09-21T03:04:58.630 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rename_latency": { 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.002138287, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.001069143 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "req_renamesnap_latency": { 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.631 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "req_snapdiff_latency": { 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmdir_latency": { 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.013122394, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.006561197 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmsnap_latency": { 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.632 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmxattr_latency": { 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setattr_latency": { 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2, 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.001365020, 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000682510 2024-09-21T03:04:58.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setdirlayout_latency": { 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setfilelock_latency": { 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setlayout_latency": { 2024-09-21T03:04:58.634 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setxattr_latency": { 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 10, 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.025058968, 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.002505896 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "req_symlink_latency": { 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "req_unlink_latency": { 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 19.691225082, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 6.563741694 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getvxattr_latency": { 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_sessions": { 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "session_count": 1, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "session_add": 3, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "session_remove": 2, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions_open": 1, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions_stale": 0, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "total_load": 15, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "average_load": 15, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "avg_session_uptime": 264, 2024-09-21T03:04:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: "mdthresh_evicted": 0 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:04:58.638 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:04:58.639 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:04:58.640 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 302441, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 99, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-09-21T03:04:58.641 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 8568, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 160, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-09-21T03:04:58.642 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 96418, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 715, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "objecter": { 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "op_active": 0, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "op_laggy": 0, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "op_send": 3997, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "op_send_bytes": 552659, 2024-09-21T03:04:58.643 INFO:teuthology.orchestra.run.smithi164.stdout: "op_resend": 37, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "op_reply": 3997, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "op_latency": { 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3997, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 38.921370870, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.009737645 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "op_inflight": 0, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "oplen_avg": { 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3997, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 4307 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.644 INFO:teuthology.orchestra.run.smithi164.stdout: "op": 3997, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "op_r": 5, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "op_w": 3992, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "op_rmw": 0, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "op_pg": 0, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_stat": 97, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_create": 39, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_read": 5, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_write": 127, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_writefull": 58, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_writesame": 0, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_append": 0, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_zero": 0, 2024-09-21T03:04:58.645 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_truncate": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_delete": 3589, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_mapext": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_sparse_read": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_clonerange": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_getxattr": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_setxattr": 71, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_rmxattr": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_call": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_watch": 0, 2024-09-21T03:04:58.646 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_notify": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_pgls": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_other": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_active": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_send": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_resend": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_ping": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_active": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_send": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_resend": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_active": 0, 2024-09-21T03:04:58.647 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_send": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_resend": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_active": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_send": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_resend": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "command_active": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "command_send": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "command_resend": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "map_epoch": 82, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "map_full": 0, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "map_inc": 8, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_sessions": 12, 2024-09-21T03:04:58.648 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_session_open": 12, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_session_close": 0, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_laggy": 0, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_wr": 298, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_rd": 0, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_del": 23 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "oft": { 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_objs": 1, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_updates": 0, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_removes": 0 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.649 INFO:teuthology.orchestra.run.smithi164.stdout: "purge_queue": { 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_ops": 0, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_ops_high_water": 2562, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing": 0, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_high_water": 2, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executed_ops": 3077, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executed": 5, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_item_in_journal": 0 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-09-21T03:04:58.650 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 5439, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 1533828, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 5439, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 5439, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 1533828, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.651 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-objecter_bytes": { 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 3997, 2024-09-21T03:04:58.652 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 553188, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 3997, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 553188, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-objecter_ops": { 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 1024, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:04:58.653 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 3997, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 3997, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 3997, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 3997, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.654 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 3758096384, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 5, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 529, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 5, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:04:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 5, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 529, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-write_buf_throttle-0x55881035d1e0": { 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 3758096384, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 146, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 425219, 2024-09-21T03:04:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 146, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 122, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 425219, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "trackedop": { 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: "slow_ops_count": 59 2024-09-21T03:04:58.657 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:04:58.658 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-21T03:04:59.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:04:58 smithi164 ceph-mon[34236]: pgmap v497: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 221 op/s 2024-09-21T03:04:59.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:04:58 smithi181 ceph-mon[34096]: pgmap v497: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 221 op/s 2024-09-21T03:04:59.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:04:58 smithi081 ceph-mon[30991]: pgmap v497: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 221 op/s 2024-09-21T03:04:59.600 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T03:04:59.600 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T03:04:59.600 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=9 2024-09-21T03:04:59.600 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-21T03:04:59.600 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T03:04:59.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T03:04:59.849 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:05:00.372 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-21T03:05:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:05:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 499, 2024-09-21T03:05:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 492, 2024-09-21T03:05:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 655456, 2024-09-21T03:05:00.372 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 190224, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 5, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 1, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.075151481, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.036202828, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.027843432, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.011685034, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 491, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.028456099, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000057955 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.373 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 531808, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 73200 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 7, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 94, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 3660, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 227130, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 4, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 3, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.009442623, 2024-09-21T03:05:00.374 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.005236550, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.003296088, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000056275, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 93, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.009352166, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000100560 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.375 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 226432 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 642, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 644, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 165546, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 204163, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 4, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 3, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.052604977, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.019863141, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.012317445, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.017403514, 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:00.376 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 642, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.022667066, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000035306 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 1, 2024-09-21T03:05:00.377 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "finisher-MDSRank": { 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "queue_len": 0, 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "complete_latency": { 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 1744, 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.049944460, 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000028637 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "finisher-PurgeQueue": { 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "queue_len": 0, 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "complete_latency": { 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.378 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "mds": { 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "request": 0, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "reply": 0, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "reply_latency": { 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "slow_reply": 0, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "forward": 0, 2024-09-21T03:05:00.379 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_fetch_complete": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_fetch_keys": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_commit": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_split": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_merge": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_top": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_bottom": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_pin_tail": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_pinned": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_expired": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_with_caps": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "caps": 0, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "subtrees": 1, 2024-09-21T03:05:00.380 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_hit": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_forward": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_discover": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_remote_ino": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_lock": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "load_cent": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "q": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "exported": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "exported_inodes": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "imported": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "imported_inodes": 0, 2024-09-21T03:05:00.381 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_dir_fetch": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_peer_discover": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rfiles": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rbytes": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rsnaps": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_set_tag": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_file_inodes": 0, 2024-09-21T03:05:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_caps": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_cap_release": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "process_request_cap_release": 0 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_cache": { 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_update": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_update_receipt": 0, 2024-09-21T03:05:00.383 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_try_discover": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_send_discover": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_handle_discover": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays_delayed": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_created": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_enqueued": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_reintegrated": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_migrated": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_processing": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:05:00.384 INFO:teuthology.orchestra.run.smithi164.stdout: "recovery_started": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "recovery_completed": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_exportdir": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_flush": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_fragstats": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_inodestats": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_started": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_succeeded": 0, 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_write_failed": 0 2024-09-21T03:05:00.385 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_log": { 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "evlrg": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "evadd": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "evex": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "evtrm": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "ev": 3, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "evexg": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "evexd": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "segadd": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "segex": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "segtrm": 0, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "seg": 2, 2024-09-21T03:05:00.386 INFO:teuthology.orchestra.run.smithi164.stdout: "segmjr": 2, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "segexg": 0, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "segexd": 0, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "expos": 4194304, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "wrpos": 4195385, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "rdpos": 4194892, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "jlat": { 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "replayed": 3 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_mem": { 2024-09-21T03:05:00.387 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 3, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "ino+": 3, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "ino-": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "dir": 1, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "dir+": 1, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "dir-": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "dn": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "dn+": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "dn-": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "cap": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "cap+": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "cap-": 0, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "rss": 116124, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "heap": 315379712 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_server": { 2024-09-21T03:05:00.388 INFO:teuthology.orchestra.run.smithi164.stdout: "dispatch_client_request": 0, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "dispatch_server_request": 0, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_request": 0, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_session": 0, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_peer_request": 0, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "req_create_latency": { 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getattr_latency": { 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getfilelock_latency": { 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "req_link_latency": { 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookup_latency": { 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.390 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookuphash_latency": { 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupino_latency": { 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupname_latency": { 2024-09-21T03:05:00.391 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupparent_latency": { 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupsnap_latency": { 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lssnap_latency": { 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.392 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mkdir_latency": { 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mknod_latency": { 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mksnap_latency": { 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "req_open_latency": { 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.394 INFO:teuthology.orchestra.run.smithi164.stdout: "req_readdir_latency": { 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rename_latency": { 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "req_renamesnap_latency": { 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.395 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "req_snapdiff_latency": { 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmdir_latency": { 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmsnap_latency": { 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmxattr_latency": { 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setattr_latency": { 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setdirlayout_latency": { 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setfilelock_latency": { 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setlayout_latency": { 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setxattr_latency": { 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.398 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "req_symlink_latency": { 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "req_unlink_latency": { 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getvxattr_latency": { 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.399 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_sessions": { 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "session_count": 1, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "session_add": 1, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "session_remove": 0, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions_open": 1, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions_stale": 0, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "total_load": 0, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "average_load": 0, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "avg_session_uptime": 1310, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "mdthresh_evicted": 0 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.400 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:05:00.401 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:05:00.402 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 181176, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 45, 2024-09-21T03:05:00.403 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 8568, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 160, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 8672, 2024-09-21T03:05:00.404 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 13, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "objecter": { 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "op_active": 0, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "op_laggy": 0, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "op_send": 1012, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "op_send_bytes": 21, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "op_resend": 3, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "op_reply": 1012, 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "op_latency": { 2024-09-21T03:05:00.405 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 1012, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.614990076, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000607697 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "op_inflight": 0, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "oplen_avg": { 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 1012, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 1013 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "op": 1012, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "op_r": 1012, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "op_w": 0, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "op_rmw": 0, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "op_pg": 0, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_stat": 637, 2024-09-21T03:05:00.406 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_create": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_read": 373, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_write": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_writefull": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_writesame": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_append": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_zero": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_truncate": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_delete": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_mapext": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_sparse_read": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_clonerange": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_getxattr": 1, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_setxattr": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:05:00.407 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_rmxattr": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_call": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_watch": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_notify": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_pgls": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_other": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_active": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_send": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_resend": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_ping": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_active": 0, 2024-09-21T03:05:00.408 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_send": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_resend": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_active": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_send": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_resend": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_active": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_send": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_resend": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "command_active": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "command_send": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "command_resend": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "map_epoch": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "map_full": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "map_inc": 0, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_sessions": 4, 2024-09-21T03:05:00.409 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_session_open": 4, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_session_close": 0, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_laggy": 0, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_wr": 0, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_rd": 2, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_del": 0 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "oft": { 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_objs": 0, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_updates": 0, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_removes": 0 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "purge_queue": { 2024-09-21T03:05:00.410 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_ops": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_high_water": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executed_ops": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executed": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_item_in_journal": 0 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 1144, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 712070, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 1144, 2024-09-21T03:05:00.411 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 1144, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 712070, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-objecter_bytes": { 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:05:00.412 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 1012, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 1086, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 1012, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 1086, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-objecter_ops": { 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 1024, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:00.413 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 1012, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 1012, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 1012, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 1012, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.414 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 3758096384, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.415 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-write_buf_throttle-0x5617e62575f0": { 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 3758096384, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:00.416 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "trackedop": { 2024-09-21T03:05:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: "slow_ops_count": 0 2024-09-21T03:05:00.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:00.417 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-21T03:05:01.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:00 smithi164 ceph-mon[34236]: pgmap v498: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 191 op/s 2024-09-21T03:05:01.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:00 smithi181 ceph-mon[34096]: pgmap v498: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 191 op/s 2024-09-21T03:05:01.260 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T03:05:01.260 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T03:05:01.260 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T03:05:01.260 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T03:05:01.261 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T03:05:01.261 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T03:05:01.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:00 smithi081 ceph-mon[30991]: pgmap v498: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 191 op/s 2024-09-21T03:05:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:05:02.039 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-21T03:05:02.039 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:05:02.039 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 217, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 206, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 571581, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 156495, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 13, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 4, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.033005952, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.013475310, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.024302798, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000372635, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 205, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.026525336, 2024-09-21T03:05:02.040 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000129391 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 70, 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000013608, 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000194 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 545536, 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 77360 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 343, 2024-09-21T03:05:02.041 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 436, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 105616, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 344746, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 7, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 4, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.051425719, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.028782088, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.020949751, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.001947555, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 436, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.035402635, 2024-09-21T03:05:02.042 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000081198 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 653, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000147507, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000225 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 227456 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 21, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 23, 2024-09-21T03:05:02.043 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 7393, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 37994, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 9, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 5, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.006609833, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.000599154, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.005424061, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000412219, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 20, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.021762007, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.001088100 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.044 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2, 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000203, 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000101 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 1, 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "finisher-MDSRank": { 2024-09-21T03:05:02.045 INFO:teuthology.orchestra.run.smithi164.stdout: "queue_len": 0, 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "complete_latency": { 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 49, 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.001358601, 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000027726 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "finisher-PurgeQueue": { 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "queue_len": 0, 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "complete_latency": { 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2, 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000029013, 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000014506 2024-09-21T03:05:02.046 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "mds": { 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "request": 4, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "reply": 3, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "reply_latency": { 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.002031494, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000677164 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "slow_reply": 0, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "forward": 1, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_fetch_complete": 0, 2024-09-21T03:05:02.047 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_fetch_keys": 0, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_commit": 11, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_split": 0, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_merge": 0, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes": 16, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_top": 0, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_bottom": 16, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_pin_tail": 0, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_pinned": 13, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_expired": 4, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "inodes_with_caps": 3, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "caps": 3, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "subtrees": 3, 2024-09-21T03:05:02.048 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse": 22, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_hit": 17, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_forward": 1, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_discover": 4, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_remote_ino": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "traverse_lock": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "load_cent": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "q": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "exported": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "exported_inodes": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "imported": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "imported_inodes": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_dir_fetch": 0, 2024-09-21T03:05:02.049 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "openino_peer_discover": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rfiles": 4, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rbytes": 234, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "root_rsnaps": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_set_tag": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:05:02.050 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_file_inodes": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_revoke": 3, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_caps": 3, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_cap_release": 0, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "process_request_cap_release": 0 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_cache": { 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_update": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_update_receipt": 14, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_try_discover": 9, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_send_discover": 10, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "dir_handle_discover": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays_delayed": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_created": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_enqueued": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_reintegrated": 0, 2024-09-21T03:05:02.052 INFO:teuthology.orchestra.run.smithi164.stdout: "strays_migrated": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_processing": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "recovery_started": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "recovery_completed": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_quiesce_path": 4, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_quiesce_inode": 27, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_exportdir": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_flush": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:05:02.053 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_fragstats": 0, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "ireq_inodestats": 0, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_started": 0, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_succeeded": 0, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "uninline_write_failed": 0 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_log": { 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "evlrg": 0, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "evadd": 3, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "evex": 0, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "evtrm": 0, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "ev": 3, 2024-09-21T03:05:02.054 INFO:teuthology.orchestra.run.smithi164.stdout: "evexg": 0, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "evexd": 0, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "segadd": 2, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "segex": 0, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "segtrm": 0, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "seg": 2, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "segmjr": 2, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "segexg": 0, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "segexd": 0, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "expos": 4194304, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "wrpos": 4195385, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "rdpos": 0, 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "jlat": { 2024-09-21T03:05:02.055 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 2, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.003542974, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.001771487 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "replayed": 0 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_mem": { 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 20, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "ino+": 22, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "ino-": 2, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "dir": 19, 2024-09-21T03:05:02.056 INFO:teuthology.orchestra.run.smithi164.stdout: "dir+": 23, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "dir-": 4, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "dn": 16, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "dn+": 20, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "dn-": 4, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "cap": 3, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "cap+": 3, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "cap-": 0, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "rss": 118148, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "heap": 324816896 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.057 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_server": { 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "dispatch_client_request": 7, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "dispatch_server_request": 0, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_request": 4, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_client_session": 5, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "handle_peer_request": 1, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "req_create_latency": { 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.058 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getattr_latency": { 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3, 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.002031494, 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000677164 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getfilelock_latency": { 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "req_link_latency": { 2024-09-21T03:05:02.059 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookup_latency": { 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookuphash_latency": { 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.060 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupino_latency": { 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupname_latency": { 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupparent_latency": { 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.061 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lookupsnap_latency": { 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: "req_lssnap_latency": { 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.062 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mkdir_latency": { 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mknod_latency": { 2024-09-21T03:05:02.063 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "req_mksnap_latency": { 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "req_open_latency": { 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "req_readdir_latency": { 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rename_latency": { 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "req_renamesnap_latency": { 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "req_snapdiff_latency": { 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmdir_latency": { 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.066 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmsnap_latency": { 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: "req_rmxattr_latency": { 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setattr_latency": { 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setdirlayout_latency": { 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setfilelock_latency": { 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.068 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setlayout_latency": { 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "req_setxattr_latency": { 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "req_symlink_latency": { 2024-09-21T03:05:02.069 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "req_unlink_latency": { 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "req_getvxattr_latency": { 2024-09-21T03:05:02.070 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_sessions": { 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "session_count": 1, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "session_add": 1, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "session_remove": 0, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions_open": 1, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "sessions_stale": 0, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "total_load": 2, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "average_load": 2, 2024-09-21T03:05:02.071 INFO:teuthology.orchestra.run.smithi164.stdout: "avg_session_uptime": 268, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "mdthresh_evicted": 0 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:05:02.072 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:05:02.073 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:05:02.074 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 237751, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 71, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:05:02.075 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 8568, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 160, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 82657, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 370, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.076 INFO:teuthology.orchestra.run.smithi164.stdout: "objecter": { 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_active": 0, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_laggy": 0, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_send": 38, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_send_bytes": 11452, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_resend": 33, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_reply": 38, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_latency": { 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 38, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.264995662, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.006973570 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "op_inflight": 0, 2024-09-21T03:05:02.077 INFO:teuthology.orchestra.run.smithi164.stdout: "oplen_avg": { 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 38, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 61 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "op": 38, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "op_r": 0, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "op_w": 38, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "op_rmw": 0, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "op_pg": 0, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_stat": 0, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_create": 10, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_read": 0, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_write": 2, 2024-09-21T03:05:02.078 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_writefull": 6, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_writesame": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_append": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_zero": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_truncate": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_delete": 6, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_mapext": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_sparse_read": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_clonerange": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_getxattr": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_setxattr": 20, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:05:02.079 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_rmxattr": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_call": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_watch": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_notify": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_pgls": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "osdop_other": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_active": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_send": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_resend": 0, 2024-09-21T03:05:02.080 INFO:teuthology.orchestra.run.smithi164.stdout: "linger_ping": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_active": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_send": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "poolop_resend": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_active": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_send": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "poolstat_resend": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_active": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_send": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "statfs_resend": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "command_active": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "command_send": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "command_resend": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "map_epoch": 0, 2024-09-21T03:05:02.081 INFO:teuthology.orchestra.run.smithi164.stdout: "map_full": 0, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "map_inc": 0, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_sessions": 9, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_session_open": 9, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_session_close": 0, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_laggy": 0, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_wr": 16, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_rd": 0, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_del": 1 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "oft": { 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_objs": 1, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:05:02.082 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_updates": 0, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "omap_total_removes": 0 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "purge_queue": { 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_ops": 0, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing": 0, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executing_high_water": 0, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executed_ops": 0, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_executed": 0, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "pq_item_in_journal": 0 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.083 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 577, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 621514, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 577, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 577, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 621514, 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:02.084 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-objecter_bytes": { 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:02.085 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 38, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 11452, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 38, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 11452, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-objecter_ops": { 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:02.086 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 1024, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 38, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 38, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 38, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 38, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.087 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 3758096384, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:05:02.088 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 0, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 0, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-write_buf_throttle-0x55c98f045380": { 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 3758096384, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 3, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 1081, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 3, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 2, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 1081, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:02.090 INFO:teuthology.orchestra.run.smithi164.stdout: "trackedop": { 2024-09-21T03:05:02.091 INFO:teuthology.orchestra.run.smithi164.stdout: "slow_ops_count": 31 2024-09-21T03:05:02.091 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:02.091 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-21T03:05:02.736 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T03:05:02.736 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T03:05:02.737 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T03:05:02.737 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=14 2024-09-21T03:05:02.737 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T03:05:02.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T03:05:02.984 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:05:03.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:02 smithi164 ceph-mon[34236]: pgmap v499: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 112 op/s 2024-09-21T03:05:03.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:02 smithi181 ceph-mon[34096]: pgmap v499: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 112 op/s 2024-09-21T03:05:03.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:02 smithi081 ceph-mon[30991]: pgmap v499: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 112 op/s 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 129, 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 124, 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 504128, 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 74736, 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 4, 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 0, 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.027007867, 2024-09-21T03:05:03.517 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.011211678, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.021419822, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 124, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.011559249, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000093219 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:03.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 504128, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 74736 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 1, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 93, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 96560, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 3, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 2, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.007763729, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.005667321, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.001060183, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:03.519 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 91, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.005412699, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000059480 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 96560 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 0, 2024-09-21T03:05:03.520 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 2, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 0, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 2, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 1, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.000342466, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.000271673, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:03.521 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 0, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:05:03.522 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:05:03.523 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:05:03.524 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 148840, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 28, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:05:03.525 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 968, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 2, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-09-21T03:05:03.526 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 126, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 483566, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 126, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 126, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 483566, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-09-21T03:05:03.527 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-09-21T03:05:04.213 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T03:05:04.213 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T03:05:04.213 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-21T03:05:04.213 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-21T03:05:04.214 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T03:05:04.214 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T03:05:04.473 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:05:04.948 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T03:05:04.948 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:05:04.948 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 810, 2024-09-21T03:05:04.948 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 812, 2024-09-21T03:05:04.948 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 664638, 2024-09-21T03:05:04.948 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 257590, 2024-09-21T03:05:04.948 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.092358963, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.038918841, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.021159361, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.024881861, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 810, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.029387835, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000036281 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.949 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 136, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 129, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 533624, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 74698, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.024537522, 2024-09-21T03:05:04.950 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.010894477, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.019318595, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000159217, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 128, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.011268799, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000088037 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 531968, 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 73360 2024-09-21T03:05:04.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 379, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 466, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 95179, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 347013, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.053499862, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.025502672, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.011056827, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.012710508, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 465, 2024-09-21T03:05:04.952 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.022523980, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000048438 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 228080 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T03:05:04.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1962, 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.060419606, 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000030794 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T03:05:04.954 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T03:05:04.955 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 21, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 6, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 15, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 12, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-21T03:05:04.956 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 2, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T03:05:04.957 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 4, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 234, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:05:04.958 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T03:05:04.959 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:05:04.960 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 146, 2024-09-21T03:05:04.961 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 21, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4594452, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4619523, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 4618385, 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T03:05:04.962 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 146 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 16, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 21, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 5, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 11, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 13, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 2, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 21, 2024-09-21T03:05:04.963 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 25, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 4, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 116996, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 316424192 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T03:05:04.964 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.965 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.968 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.969 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.970 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.971 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.972 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.973 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.974 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.975 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 3, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 2, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1328, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:05:04.976 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:05:04.977 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:05:04.978 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 189256, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 49, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8568, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 160, 2024-09-21T03:05:04.979 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 65418, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 359, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 1188, 2024-09-21T03:05:04.980 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 26, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 4, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 1188, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1188, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.592987456, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000499147 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1188, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1189 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 1188, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 1188, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T03:05:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 746, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 439, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 2, 2024-09-21T03:05:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T03:05:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 0, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 5, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 5, 2024-09-21T03:05:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:05:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 1321, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1164873, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 1321, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1321, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1164873, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1188, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 425229, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1188, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 425229, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1188, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 1188, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1188, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1188, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x55a40a87b5f0": { 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T03:05:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T03:05:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:04.992 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T03:05:05.172 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:04 smithi181 ceph-mon[34096]: pgmap v500: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:05:05.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:04 smithi164 ceph-mon[34236]: pgmap v500: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:05:05.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:04 smithi081 ceph-mon[30991]: pgmap v500: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T03:05:05.893 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T03:05:05.893 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T03:05:05.893 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T03:05:05.893 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-21T03:05:05.893 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T03:05:05.894 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T03:05:06.146 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 381, 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 383, 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 101422, 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 121221, 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T03:05:06.669 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.049409010, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.019861344, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.012343837, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.012689644, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 381, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.019101464, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000050135 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:05:06.670 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 138, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 129, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 536126, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 74930, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.027359075, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.011417553, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.021081015, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000051051, 2024-09-21T03:05:06.671 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 129, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.012792251, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000099164 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 535024, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 74288 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 663, 2024-09-21T03:05:06.672 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 753, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 196672, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 439972, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.097979123, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.042084169, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.021132383, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.027124357, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 751, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.034444984, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000045865 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.673 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 229456 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.674 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1788, 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.061367358, 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000034321 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 0, 2024-09-21T03:05:06.676 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-09-21T03:05:06.677 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:05:06.678 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-09-21T03:05:06.679 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:05:06.680 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T03:05:06.681 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 5, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195917, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 4195424, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 5 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 3, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 3, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 1, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 1, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 0, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 0, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-21T03:05:06.683 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 115680, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 315375616 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.685 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.686 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.687 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.688 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.689 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T03:05:06.690 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.691 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T03:05:06.692 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.693 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1331, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:05:06.695 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:05:06.696 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T03:05:06.697 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 197336, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 53, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T03:05:06.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8568, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 160, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 8672, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 13, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 1045, 2024-09-21T03:05:06.699 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 1045, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1045, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.721984764, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000690894 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1045, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1046 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.700 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 1045, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 1045, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 662, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 381, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T03:05:06.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T03:05:06.702 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 0, 2024-09-21T03:05:06.703 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 6, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 6, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T03:05:06.704 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 1178, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 718516, 2024-09-21T03:05:06.705 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 1178, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1178, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 718516, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T03:05:06.706 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1045, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 1618, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1045, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1618, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 1045, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 1045, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 1045, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1045, 2024-09-21T03:05:06.708 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:06.709 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x5644861ff520": { 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:06.710 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T03:05:06.711 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-09-21T03:05:06.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:06.712 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T03:05:07.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:06 smithi181 ceph-mon[34096]: pgmap v501: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T03:05:07.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:06 smithi081 ceph-mon[30991]: pgmap v501: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T03:05:07.398 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T03:05:07.398 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T03:05:07.398 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T03:05:07.398 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T03:05:07.398 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T03:05:07.398 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T03:05:07.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:06 smithi164 ceph-mon[34236]: pgmap v501: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T03:05:07.646 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:05:08.169 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T03:05:08.169 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:05:08.169 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 379, 2024-09-21T03:05:08.169 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 380, 2024-09-21T03:05:08.169 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 128006, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 156213, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 9, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.049113201, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.021529237, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.023992499, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.002906780, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 380, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.039966899, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000105176 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:08.170 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 694, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000153887, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000221 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 31, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 120, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 9494, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 270228, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 11, 2024-09-21T03:05:08.171 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 6, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.014335704, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.006244829, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.006789884, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000368940, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 117, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.022706873, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000194075 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 23, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000004076, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000177 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 4688, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 232800 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 172, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 163, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 543704, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 130595, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 10, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 5, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.029220220, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.011809870, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.023479066, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000192218, 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:08.173 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 162, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.018901023, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000116672 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 4, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000461, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000115 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 541488, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 77840 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-09-21T03:05:08.174 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 44, 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.002121518, 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000048216 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2, 2024-09-21T03:05:08.175 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000017601, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000008800 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 2, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 1, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000224014, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000224014 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 1, 2024-09-21T03:05:08.176 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 11, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 16, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 16, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 13, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 4, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 3, 2024-09-21T03:05:08.177 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 20, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 14, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 5, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 1000, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 1, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-09-21T03:05:08.178 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 4, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 234, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:05:08.179 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 1 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 12, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 8, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 10, 2024-09-21T03:05:08.180 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_path": 4, 2024-09-21T03:05:08.181 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_quiesce_inode": 27, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_started": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_succeeded": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "uninline_write_failed": 0 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 5, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-09-21T03:05:08.182 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 5, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 2, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195917, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 0, 2024-09-21T03:05:08.183 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 4, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.008697588, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.002174397 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 0 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 20, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 22, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 2, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 19, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 22, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 3, 2024-09-21T03:05:08.184 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 16, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 20, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 4, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 1, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 1, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 120560, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 324808704 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 3, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 2, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 9, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-09-21T03:05:08.185 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000224014, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000224014 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.186 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-09-21T03:05:08.187 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.188 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-09-21T03:05:08.189 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-09-21T03:05:08.190 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-09-21T03:05:08.191 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-09-21T03:05:08.192 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.193 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.194 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.195 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 1, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 2, 2024-09-21T03:05:08.196 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 1, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 1, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 276, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:05:08.197 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:05:08.198 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:05:08.199 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 245959, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 77, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8568, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 160, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:05:08.200 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 81649, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 358, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 39, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 11825, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 33, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 39, 2024-09-21T03:05:08.201 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 39, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.232995043, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.005974231 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 39, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 61 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 39, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 0, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 39, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-09-21T03:05:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 10, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 4, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 6, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 6, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 0, 2024-09-21T03:05:08.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 20, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-09-21T03:05:08.204 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-09-21T03:05:08.205 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 0, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 9, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 9, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 14, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 0, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 1 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 1, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-09-21T03:05:08.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 578, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 617867, 2024-09-21T03:05:08.207 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 578, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 578, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 617867, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-09-21T03:05:08.208 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 39, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 11825, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 39, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 11825, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.209 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 39, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 39, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 39, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 39, 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:08.210 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:08.211 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x562c24d5d380": { 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 5, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1613, 2024-09-21T03:05:08.212 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 5, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 4, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1613, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "trackedop": { 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 31 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:08.213 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T03:05:08.907 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T03:05:08.908 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T03:05:08.908 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-21T03:05:08.908 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=12 2024-09-21T03:05:08.908 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T03:05:08.908 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T03:05:09.156 INFO:teuthology.orchestra.run.smithi181.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:05:09.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:08 smithi181 ceph-mon[34096]: pgmap v502: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:05:09.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:08 smithi081 ceph-mon[30991]: pgmap v502: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:05:09.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:08 smithi164 ceph-mon[34236]: pgmap v502: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 4, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 4, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 2944, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 448, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 0, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.002945552, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000039772, 2024-09-21T03:05:09.674 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.002155559, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.003862866, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.001287622 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.675 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 127, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 124, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 501728, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 75568, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 2, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.024056008, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.011180504, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.018921672, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:09.676 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 123, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.007049390, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000057312 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 501728, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 75568 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1, 2024-09-21T03:05:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 95, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 96912, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 3, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.008357542, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.006217275, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000955963, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 93, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.005671441, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000060983 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 96912 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 0, 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-09-21T03:05:09.679 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-09-21T03:05:09.680 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-09-21T03:05:09.681 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 148823, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 27, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 0, 2024-09-21T03:05:09.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 968, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-09-21T03:05:09.683 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 128, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 483826, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 128, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 128, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 483826, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-21T03:05:09.684 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-21T03:05:10.484 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T03:05:10.484 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T03:05:10.484 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-21T03:05:10.484 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-21T03:05:10.484 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T03:05:10.495 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T03:05:10.495 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T03:05:10.495 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:05:10.513 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T03:05:10.513 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:05:10.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T03:05:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:11.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:10 smithi181 ceph-mon[34096]: pgmap v503: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:05:11.251 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:10 smithi081 ceph-mon[30991]: pgmap v503: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:05:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 -- 172.21.15.81:0/2818885185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790104860 msgr2=0x7f5790104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 --2- 172.21.15.81:0/2818885185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790104860 0x7f5790104c70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5780009ca0 tx=0x7f578002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 -- 172.21.15.81:0/2818885185 shutdown_connections 2024-09-21T03:05:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 --2- 172.21.15.81:0/2818885185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f579010de10 0x7f57901102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 --2- 172.21.15.81:0/2818885185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5790105290 0x7f579010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 --2- 172.21.15.81:0/2818885185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5790104860 0x7f5790104c70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 -- 172.21.15.81:0/2818885185 >> 172.21.15.81:0/2818885185 conn(0x7f5790079730 msgr2=0x7f5790079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 -- 172.21.15.81:0/2818885185 shutdown_connections 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 -- 172.21.15.81:0/2818885185 wait complete. 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.341+0000 7f5795714640 1 Processor -- start 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f5795714640 1 -- start start 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f5795714640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5790104860 0x7f5790102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f5795714640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5790105290 0x7f5790102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f5795714640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f579010de10 0x7f57901031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f5795714640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5790113980 con 0x7f579010de10 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f5795714640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5790113800 con 0x7f5790105290 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f5795714640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f5790113b00 con 0x7f5790104860 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f579010de10 0x7f57901031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f579010de10 0x7f57901031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53044/0 (socket says 172.21.15.81:53044) 2024-09-21T03:05:11.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 -- 172.21.15.81:0/4099758697 learned_addr learned my addr 172.21.15.81:0/4099758697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578effd640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5790104860 0x7f5790102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578e7fc640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5790105290 0x7f5790102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 -- 172.21.15.81:0/4099758697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5790104860 msgr2=0x7f5790102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5790104860 0x7f5790102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 -- 172.21.15.81:0/4099758697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5790105290 msgr2=0x7f5790102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5790105290 0x7f5790102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.342+0000 7f578f7fe640 1 -- 172.21.15.81:0/4099758697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57901a8650 con 0x7f579010de10 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.343+0000 7f578f7fe640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f579010de10 0x7f57901031f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f578800d750 tx=0x7f578800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.343+0000 7f5787fff640 1 -- 172.21.15.81:0/4099758697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788017070 con 0x7f579010de10 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.343+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57901a8940 con 0x7f579010de10 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.343+0000 7f5787fff640 1 -- 172.21.15.81:0/4099758697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57880054b0 con 0x7f579010de10 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.343+0000 7f5787fff640 1 -- 172.21.15.81:0/4099758697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788004b90 con 0x7f579010de10 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.343+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57901a8ed0 con 0x7f579010de10 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.344+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5790104c70 con 0x7f579010de10 2024-09-21T03:05:11.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.345+0000 7f5787fff640 1 -- 172.21.15.81:0/4099758697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5788004d30 con 0x7f579010de10 2024-09-21T03:05:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.346+0000 7f5787fff640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f577c0b6510 0x7f577c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.346+0000 7f578effd640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f577c0b6510 0x7f577c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.346+0000 7f5787fff640 1 -- 172.21.15.81:0/4099758697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f57880e74f0 con 0x7f579010de10 2024-09-21T03:05:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.346+0000 7f578effd640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f577c0b6510 0x7f577c0b8a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5780000f80 tx=0x7f57800093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:11.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.349+0000 7f5787fff640 1 -- 172.21.15.81:0/4099758697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57880ada40 con 0x7f579010de10 2024-09-21T03:05:11.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:10 smithi164 ceph-mon[34236]: pgmap v503: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:05:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.538+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f579002e640 con 0x7f579010de10 2024-09-21T03:05:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.539+0000 7f5787fff640 1 -- 172.21.15.81:0/4099758697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+587 (secure 0 0 0) 0x7f57880b1e20 con 0x7f579010de10 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3359413677 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2658968302 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2305526484 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/837683568 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2720123143 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/83784468 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f577c0b6510 msgr2=0x7f577c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f577c0b6510 0x7f577c0b8a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5780000f80 tx=0x7f57800093f0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f579010de10 msgr2=0x7f57901031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f579010de10 0x7f57901031f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f578800d750 tx=0x7f578800dc10 comp rx=0 tx=0).stop 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 shutdown_connections 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f577c0b6510 0x7f577c0b8a20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f579010de10 0x7f57901031f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5790105290 0x7f5790102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 --2- 172.21.15.81:0/4099758697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5790104860 0x7f5790102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 >> 172.21.15.81:0/4099758697 conn(0x7f5790079730 msgr2=0x7f57900ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 shutdown_connections 2024-09-21T03:05:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:11.541+0000 7f5795714640 1 -- 172.21.15.81:0/4099758697 wait complete. 2024-09-21T03:05:12.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:11 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4099758697' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:05:12.304 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:11 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4099758697' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:05:12.353 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T03:05:12.353 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:05:12.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T03:05:12.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:11 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4099758697' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:05:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:13.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:12 smithi081 ceph-mon[30991]: pgmap v504: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 -- 172.21.15.81:0/460412017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78781048a0 msgr2=0x7f7878104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 --2- 172.21.15.81:0/460412017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78781048a0 0x7f7878104cb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7868009900 tx=0x7f786802a410 comp rx=0 tx=0).stop 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 -- 172.21.15.81:0/460412017 shutdown_connections 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 --2- 172.21.15.81:0/460412017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f787810de50 0x7f7878110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 --2- 172.21.15.81:0/460412017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78781052d0 0x7f787810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 --2- 172.21.15.81:0/460412017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78781048a0 0x7f7878104cb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 -- 172.21.15.81:0/460412017 >> 172.21.15.81:0/460412017 conn(0x7f7878079740 msgr2=0x7f7878079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 -- 172.21.15.81:0/460412017 shutdown_connections 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 -- 172.21.15.81:0/460412017 wait complete. 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.164+0000 7f787e07e640 1 Processor -- start 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f787e07e640 1 -- start start 2024-09-21T03:05:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f787e07e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78781048a0 0x7f78781027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f787e07e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78781052d0 0x7f7878102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f787e07e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787810de50 0x7f7878103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f787e07e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7878113940 con 0x7f787810de50 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f787e07e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f78781137c0 con 0x7f78781052d0 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f787e07e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f7878113ac0 con 0x7f78781048a0 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787810de50 0x7f7878103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787810de50 0x7f7878103230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53068/0 (socket says 172.21.15.81:53068) 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 -- 172.21.15.81:0/3585703923 learned_addr learned my addr 172.21.15.81:0/3585703923 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f78777fe640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78781048a0 0x7f78781027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7876ffd640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78781052d0 0x7f7878102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 -- 172.21.15.81:0/3585703923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78781048a0 msgr2=0x7f78781027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78781048a0 0x7f78781027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 -- 172.21.15.81:0/3585703923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78781052d0 msgr2=0x7f7878102cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78781052d0 0x7f7878102cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.165+0000 7f7877fff640 1 -- 172.21.15.81:0/3585703923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78781a8690 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.166+0000 7f7877fff640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787810de50 0x7f7878103230 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f787000eaa0 tx=0x7f787000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.166+0000 7f7874ff9640 1 -- 172.21.15.81:0/3585703923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787000cdb0 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.166+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78781a8980 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.166+0000 7f7874ff9640 1 -- 172.21.15.81:0/3585703923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7870005020 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.166+0000 7f7874ff9640 1 -- 172.21.15.81:0/3585703923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700116d0 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.166+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78781a8e40 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.167+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787806c1a0 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.168+0000 7f7874ff9640 1 -- 172.21.15.81:0/3585703923 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f78700051d0 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.169+0000 7f7874ff9640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f78600b6510 0x7f78600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.169+0000 7f78777fe640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f78600b6510 0x7f78600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.170+0000 7f7874ff9640 1 -- 172.21.15.81:0/3585703923 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f78700e7c00 con 0x7f787810de50 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.170+0000 7f78777fe640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f78600b6510 0x7f78600b8a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7868004770 tx=0x7f78680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.173+0000 7f7874ff9640 1 -- 172.21.15.81:0/3585703923 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7870016030 con 0x7f787810de50 2024-09-21T03:05:13.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:12 smithi181 ceph-mon[34096]: pgmap v504: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:05:13.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.362+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7878104cb0 con 0x7f787810de50 2024-09-21T03:05:13.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.363+0000 7f7874ff9640 1 -- 172.21.15.81:0/3585703923 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+587 (secure 0 0 0) 0x7f7878104cb0 con 0x7f787810de50 2024-09-21T03:05:13.364 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3359413677 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2658968302 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/677187629 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/3217567960 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2305526484 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/837683568 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2720123143 2024-09-22T02:50:47.609507+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/83784468 2024-09-22T02:50:22.009612+0000 2024-09-21T03:05:13.365 INFO:teuthology.orchestra.run.smithi081.stderr:listed 10 entries 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f78600b6510 msgr2=0x7f78600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f78600b6510 0x7f78600b8a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7868004770 tx=0x7f78680058d0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787810de50 msgr2=0x7f7878103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787810de50 0x7f7878103230 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f787000eaa0 tx=0x7f787000ef60 comp rx=0 tx=0).stop 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 shutdown_connections 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f78600b6510 0x7f78600b8a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f787810de50 0x7f7878103230 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78781052d0 0x7f7878102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 --2- 172.21.15.81:0/3585703923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f78781048a0 0x7f78781027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:13.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 >> 172.21.15.81:0/3585703923 conn(0x7f7878079740 msgr2=0x7f78781009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 shutdown_connections 2024-09-21T03:05:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:13.365+0000 7f787e07e640 1 -- 172.21.15.81:0/3585703923 wait complete. 2024-09-21T03:05:13.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:12 smithi164 ceph-mon[34236]: pgmap v504: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:05:14.024 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:13 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3585703923' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:05:14.054 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-21T03:05:14.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:05:14.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T03:05:14.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:05:14.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[84075]: fuse finished with error 0 and tester_r 0 2024-09-21T03:05:14.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:13 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3585703923' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:05:14.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:13 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3585703923' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:05:15.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:14 smithi181 ceph-mon[34096]: pgmap v505: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:05:15.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:14 smithi081 ceph-mon[30991]: pgmap v505: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:05:15.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:14 smithi164 ceph-mon[34236]: pgmap v505: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:05:17.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:16 smithi181 ceph-mon[34096]: pgmap v506: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:05:17.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:16 smithi081 ceph-mon[30991]: pgmap v506: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:05:17.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:16 smithi164 ceph-mon[34236]: pgmap v506: 129 pgs: 129 active+clean; 998 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:05:19.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:18 smithi181 ceph-mon[34096]: pgmap v507: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T03:05:19.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:18 smithi081 ceph-mon[30991]: pgmap v507: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T03:05:19.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:18 smithi164 ceph-mon[34236]: pgmap v507: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T03:05:20.183 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T03:05:20.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:05:20.183 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:05:20.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:05:20.204 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T03:05:20.263 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:05:20.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:05:20.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:05:20.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:05:20.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-21T03:05:20.431 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T03:05:20.447 INFO:tasks.cephadm:Teardown begin 2024-09-21T03:05:20.447 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:05:20.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:05:20.701 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:21.089 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:20 smithi081 ceph-mon[30991]: pgmap v508: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T03:05:21.089 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:20 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:05:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 -- 172.21.15.81:0/2506670832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8105270 msgr2=0x7f55a810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 --2- 172.21.15.81:0/2506670832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8105270 0x7f55a810d8b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f559c009ca0 tx=0x7f559c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 -- 172.21.15.81:0/2506670832 shutdown_connections 2024-09-21T03:05:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 --2- 172.21.15.81:0/2506670832 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55a810ddf0 0x7f55a8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 --2- 172.21.15.81:0/2506670832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8105270 0x7f55a810d8b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 --2- 172.21.15.81:0/2506670832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a8104840 0x7f55a8104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 -- 172.21.15.81:0/2506670832 >> 172.21.15.81:0/2506670832 conn(0x7f55a8079730 msgr2=0x7f55a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 -- 172.21.15.81:0/2506670832 shutdown_connections 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.179+0000 7f55adf45640 1 -- 172.21.15.81:0/2506670832 wait complete. 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 Processor -- start 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 -- start start 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8104840 0x7f55a819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a8105270 0x7f55a819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55a810ddf0 0x7f55a819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8113970 con 0x7f55a8104840 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f55a81137f0 con 0x7f55a8105270 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55adf45640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8113af0 con 0x7f55a810ddf0 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.180+0000 7f55a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8104840 0x7f55a819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8104840 0x7f55a819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53076/0 (socket says 172.21.15.81:53076) 2024-09-21T03:05:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 -- 172.21.15.81:0/202290358 learned_addr learned my addr 172.21.15.81:0/202290358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a6ffd640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a8105270 0x7f55a819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a7fff640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55a810ddf0 0x7f55a819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 -- 172.21.15.81:0/202290358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55a810ddf0 msgr2=0x7f55a819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55a810ddf0 0x7f55a819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 -- 172.21.15.81:0/202290358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a8105270 msgr2=0x7f55a819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a8105270 0x7f55a819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 -- 172.21.15.81:0/202290358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a81a02b0 con 0x7f55a8104840 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a77fe640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8104840 0x7f55a819a400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f559800c970 tx=0x7f559800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a4ff9640 1 -- 172.21.15.81:0/202290358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598007c10 con 0x7f55a8104840 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a4ff9640 1 -- 172.21.15.81:0/202290358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5598007db0 con 0x7f55a8104840 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a81a05a0 con 0x7f55a8104840 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55a4ff9640 1 -- 172.21.15.81:0/202290358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559800f7d0 con 0x7f55a8104840 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.181+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a81a6dc0 con 0x7f55a8104840 2024-09-21T03:05:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.182+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a8104c50 con 0x7f55a8104840 2024-09-21T03:05:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.184+0000 7f55a4ff9640 1 -- 172.21.15.81:0/202290358 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5598018480 con 0x7f55a8104840 2024-09-21T03:05:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.184+0000 7f55a4ff9640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55900b6540 0x7f55900b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.184+0000 7f55a6ffd640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55900b6540 0x7f55900b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.185+0000 7f55a4ff9640 1 -- 172.21.15.81:0/202290358 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f55980e7ba0 con 0x7f55a8104840 2024-09-21T03:05:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.185+0000 7f55a6ffd640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55900b6540 0x7f55900b8a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f559c006010 tx=0x7f559c031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.188+0000 7f55a4ff9640 1 -- 172.21.15.81:0/202290358 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55980ae210 con 0x7f55a8104840 2024-09-21T03:05:21.233 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:20 smithi164 ceph-mon[34236]: pgmap v508: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T03:05:21.234 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:20 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:05:21.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:20 smithi181 ceph-mon[34096]: pgmap v508: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T03:05:21.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:20 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:05:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.406+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55a819b530 con 0x7f55a8104840 2024-09-21T03:05:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.406+0000 7f55a4ff9640 1 -- 172.21.15.81:0/202290358 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11924 (secure 0 0 0) 0x7f55980b25f0 con 0x7f55a8104840 2024-09-21T03:05:21.408 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:05:21.408 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T03:04:25:705271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:04:25.245917+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:05:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T03:05:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55900b6540 msgr2=0x7f55900b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55900b6540 0x7f55900b8a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f559c006010 tx=0x7f559c031000 comp rx=0 tx=0).stop 2024-09-21T03:05:21.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8104840 msgr2=0x7f55a819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8104840 0x7f55a819a400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f559800c970 tx=0x7f559800ce30 comp rx=0 tx=0).stop 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 shutdown_connections 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f55900b6540 0x7f55900b8a50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f55a810ddf0 0x7f55a819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55a8105270 0x7f55a819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 --2- 172.21.15.81:0/202290358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a8104840 0x7f55a819a400 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 >> 172.21.15.81:0/202290358 conn(0x7f55a8079730 msgr2=0x7f55a80ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 shutdown_connections 2024-09-21T03:05:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:21.409+0000 7f55adf45640 1 -- 172.21.15.81:0/202290358 wait complete. 2024-09-21T03:05:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:21 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:05:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:21 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:05:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:21 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:05:22.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:21 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/202290358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:05:22.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:21 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:05:22.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:21 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:05:22.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:21 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:05:22.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:21 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/202290358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:05:22.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:05:22.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:21 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:05:22.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:21 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:05:22.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:21 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' 2024-09-21T03:05:22.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:21 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/202290358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:05:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:22.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 -- 172.21.15.81:0/4043162467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8105ac0 msgr2=0x7fdff810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:22.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 --2- 172.21.15.81:0/4043162467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8105ac0 0x7fdff810f530 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009ca0 tx=0x7fdff002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 -- 172.21.15.81:0/4043162467 shutdown_connections 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 --2- 172.21.15.81:0/4043162467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8105ac0 0x7fdff810f530 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 --2- 172.21.15.81:0/4043162467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff8105170 0x7fdff8105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 --2- 172.21.15.81:0/4043162467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdff8103080 0x7fdff8103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 -- 172.21.15.81:0/4043162467 >> 172.21.15.81:0/4043162467 conn(0x7fdff8077c60 msgr2=0x7fdff80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 -- 172.21.15.81:0/4043162467 shutdown_connections 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.981+0000 7fdffe219640 1 -- 172.21.15.81:0/4043162467 wait complete. 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.982+0000 7fdffe219640 1 Processor -- start 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.982+0000 7fdffe219640 1 -- start start 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdffe219640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8103080 0x7fdff819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdffe219640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff8105170 0x7fdff819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdffe219640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdff8105ac0 0x7fdff819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:23.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdffe219640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdff81128c0 con 0x7fdff8103080 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdffe219640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdff8112740 con 0x7fdff8105170 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdffe219640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fdff8112a40 con 0x7fdff8105ac0 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8103080 0x7fdff819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8103080 0x7fdff819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39612/0 (socket says 172.21.15.81:39612) 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 -- 172.21.15.81:0/1067592582 learned_addr learned my addr 172.21.15.81:0/1067592582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff7fff640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdff8105ac0 0x7fdff819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff6ffd640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff8105170 0x7fdff819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 -- 172.21.15.81:0/1067592582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdff8105ac0 msgr2=0x7fdff819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdff8105ac0 0x7fdff819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 -- 172.21.15.81:0/1067592582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff8105170 msgr2=0x7fdff819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff8105170 0x7fdff819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 -- 172.21.15.81:0/1067592582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff81a6400 con 0x7fdff8103080 2024-09-21T03:05:23.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff77fe640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8103080 0x7fdff819b170 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d950 tx=0x7fdfe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdff4ff9640 1 -- 172.21.15.81:0/1067592582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8017070 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.983+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81a66f0 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.984+0000 7fdff4ff9640 1 -- 172.21.15.81:0/1067592582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfe8009c30 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.984+0000 7fdff4ff9640 1 -- 172.21.15.81:0/1067592582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800f620 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.984+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff81a6c80 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.985+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff8103490 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.986+0000 7fdff4ff9640 1 -- 172.21.15.81:0/1067592582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdfe8005030 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.987+0000 7fdff4ff9640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfe00b6540 0x7fdfe00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.987+0000 7fdff4ff9640 1 -- 172.21.15.81:0/1067592582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7fdfe80e7150 con 0x7fdff8103080 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.987+0000 7fdff6ffd640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfe00b6540 0x7fdfe00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.988+0000 7fdff6ffd640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfe00b6540 0x7fdfe00b8a50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdff8107ef0 tx=0x7fdfec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:23.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:22.990+0000 7fdff4ff9640 1 -- 172.21.15.81:0/1067592582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfe80b1a80 con 0x7fdff8103080 2024-09-21T03:05:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.208+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdff81020f0 con 0x7fdff8103080 2024-09-21T03:05:23.210 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:23 smithi081 ceph-mon[30991]: pgmap v509: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:05:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.209+0000 7fdff4ff9640 1 -- 172.21.15.81:0/1067592582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11924 (secure 0 0 0) 0x7fdfe80b69c0 con 0x7fdff8103080 2024-09-21T03:05:23.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:05:23.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T03:04:25:705271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2295096585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2295096585},{"type":"v1","addr":"172.21.15.81:6835","nonce":2295096585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/982276876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":982276876},{"type":"v1","addr":"172.21.15.81:6837","nonce":982276876}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14781,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/1201929574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":1201929574},{"type":"v1","addr":"172.21.15.81:6839","nonce":1201929574}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14793,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1840355403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1840355403},{"type":"v1","addr":"172.21.15.81:6841","nonce":1840355403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2510878090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2510878090},{"type":"v1","addr":"172.21.15.181:6833","nonce":2510878090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2052229726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2052229726},{"type":"v1","addr":"172.21.15.164:6833","nonce":2052229726}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:58:15.629942+0000","modified":"2024-09-21T03:04:25.245917+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24572,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24547":{"gid":24547,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6835/3990133631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":3990133631},{"type":"v1","addr":"172.21.15.181:6835","nonce":3990133631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.164:6835/1947556688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1947556688},{"type":"v1","addr":"172.21.15.164:6835","nonce":1947556688}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6837/3046788185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6836","nonce":3046788185},{"type":"v1","addr":"172.21.15.181:6837","nonce":3046788185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.181:6839/1458541171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6838","nonce":1458541171},{"type":"v1","addr":"172.21.15.181:6839","nonce":1458541171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.164:6837/3749524162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3749524162},{"type":"v1","addr":"172.21.15.164:6837","nonce":3749524162}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.164:6839/399869191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":399869191},{"type":"v1","addr":"172.21.15.164:6839","nonce":399869191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24599,"qdb_cluster":[24599,24572,24568]},"id":1}]} 2024-09-21T03:05:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfe00b6540 msgr2=0x7fdfe00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfe00b6540 0x7fdfe00b8a50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdff8107ef0 tx=0x7fdfec005f90 comp rx=0 tx=0).stop 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8103080 msgr2=0x7fdff819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8103080 0x7fdff819b170 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d950 tx=0x7fdfe800de10 comp rx=0 tx=0).stop 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 shutdown_connections 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fdfe00b6540 0x7fdfe00b8a50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdff8105ac0 0x7fdff819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdff8105170 0x7fdff819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 --2- 172.21.15.81:0/1067592582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff8103080 0x7fdff819b170 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.211+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 >> 172.21.15.81:0/1067592582 conn(0x7fdff8077c60 msgr2=0x7fdff8106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.212+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 shutdown_connections 2024-09-21T03:05:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:23.212+0000 7fdffe219640 1 -- 172.21.15.81:0/1067592582 wait complete. 2024-09-21T03:05:23.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:23 smithi164 ceph-mon[34236]: pgmap v509: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:05:23.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:23 smithi181 ceph-mon[34096]: pgmap v509: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:05:24.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:05:24.269 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:24.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:24 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1067592582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:05:24.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:24 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1067592582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:05:24.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:24 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1067592582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 -- 172.21.15.81:0/1566787869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 msgr2=0x7f93b8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 --2- 172.21.15.81:0/1566787869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8110620 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f93b0009ca0 tx=0x7f93b002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 -- 172.21.15.81:0/1566787869 shutdown_connections 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 --2- 172.21.15.81:0/1566787869 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93b81094a0 0x7f93b81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 --2- 172.21.15.81:0/1566787869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8110620 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 --2- 172.21.15.81:0/1566787869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93b8103b60 0x7f93b8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 -- 172.21.15.81:0/1566787869 >> 172.21.15.81:0/1566787869 conn(0x7f93b807b850 msgr2=0x7f93b807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 -- 172.21.15.81:0/1566787869 shutdown_connections 2024-09-21T03:05:24.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.747+0000 7f93bd17e640 1 -- 172.21.15.81:0/1566787869 wait complete. 2024-09-21T03:05:24.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.748+0000 7f93bd17e640 1 Processor -- start 2024-09-21T03:05:24.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93bd17e640 1 -- start start 2024-09-21T03:05:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93bd17e640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93b8103b60 0x7f93b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93bd17e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93b81094a0 0x7f93b8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93bd17e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93bd17e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93b81139a0 con 0x7f93b8109df0 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93bd17e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8113820 con 0x7f93b81094a0 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93bd17e640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8113b20 con 0x7f93b8103b60 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39626/0 (socket says 172.21.15.81:39626) 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 -- 172.21.15.81:0/4270357147 learned_addr learned my addr 172.21.15.81:0/4270357147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b6d9d640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93b8103b60 0x7f93b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b659c640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93b81094a0 0x7f93b8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 -- 172.21.15.81:0/4270357147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93b8103b60 msgr2=0x7f93b8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93b8103b60 0x7f93b8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 -- 172.21.15.81:0/4270357147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93b81094a0 msgr2=0x7f93b8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93b81094a0 0x7f93b8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b759e640 1 -- 172.21.15.81:0/4270357147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b81a8670 con 0x7f93b8109df0 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.749+0000 7f93b6d9d640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93b8103b60 0x7f93b8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:05:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.750+0000 7f93b759e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8076190 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f93b0006010 tx=0x7f93b0003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:24.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.750+0000 7f93affff640 1 -- 172.21.15.81:0/4270357147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0004240 con 0x7f93b8109df0 2024-09-21T03:05:24.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.750+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b81a8900 con 0x7f93b8109df0 2024-09-21T03:05:24.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.750+0000 7f93affff640 1 -- 172.21.15.81:0/4270357147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93b00305e0 con 0x7f93b8109df0 2024-09-21T03:05:24.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.750+0000 7f93affff640 1 -- 172.21.15.81:0/4270357147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b003b660 con 0x7f93b8109df0 2024-09-21T03:05:24.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.750+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b81a8ec0 con 0x7f93b8109df0 2024-09-21T03:05:24.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.751+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b8103f70 con 0x7f93b8109df0 2024-09-21T03:05:24.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.752+0000 7f93affff640 1 -- 172.21.15.81:0/4270357147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f93b0030790 con 0x7f93b8109df0 2024-09-21T03:05:24.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.753+0000 7f93affff640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f93a40b6510 0x7f93a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:24.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.753+0000 7f93b6d9d640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f93a40b6510 0x7f93a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:24.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.753+0000 7f93affff640 1 -- 172.21.15.81:0/4270357147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f93b0108c70 con 0x7f93b8109df0 2024-09-21T03:05:24.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.754+0000 7f93b6d9d640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f93a40b6510 0x7f93a40b8a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f93a80058c0 tx=0x7f93a8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:24.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.756+0000 7f93affff640 1 -- 172.21.15.81:0/4270357147 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93b00cf1c0 con 0x7f93b8109df0 2024-09-21T03:05:24.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.936+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93b802e640 con 0x7f93b8109df0 2024-09-21T03:05:24.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.937+0000 7f93affff640 1 -- 172.21.15.81:0/4270357147 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24739 (secure 0 0 0) 0x7f93b00d35a0 con 0x7f93b8109df0 2024-09-21T03:05:24.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T03:05:24.940 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"0bfe3ac0-77c4-11ef-baf5-efdc52797490","created":"2024-09-21T02:49:53.486319+0000","modified":"2024-09-21T02:58:49.219446+0000","last_up_change":"2024-09-21T02:57:24.657880+0000","last_in_change":"2024-09-21T02:57:01.275764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:53:35.934095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:58:11.341827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:58:13.659116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:58:20.067521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28c0fc3a-bcc6-4b8b-8a5c-0d805cafe9d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6803","nonce":2217822752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6805","nonce":2217822752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6809","nonce":2217822752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":2217822752},{"type":"v1","addr":"172.21.15.81:6807","nonce":2217822752}]},"public_addr":"172.21.15.81:6803/2217822752","cluster_addr":"172.21.15.81:6805/2217822752","heartbeat_back_addr":"172.21.15.81:6809/2217822752","heartbeat_front_addr":"172.21.15.81:6807/2217822752","state":["exists","up"]},{"osd":1,"uuid":"0eb4ea10-4d33-4614-b945-babb11aac5d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6801","nonce":2618567246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6803","nonce":2618567246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6807","nonce":2618567246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2618567246},{"type":"v1","addr":"172.21.15.164:6805","nonce":2618567246}]},"public_addr":"172.21.15.164:6801/2618567246","cluster_addr":"172.21.15.164:6803/2618567246","heartbeat_back_addr":"172.21.15.164:6807/2618567246","heartbeat_front_addr":"172.21.15.164:6805/2618567246","state":["exists","up"]},{"osd":2,"uuid":"de365a9b-3533-47fe-8660-2febee4ea04d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6801","nonce":1768571017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6803","nonce":1768571017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6807","nonce":1768571017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1768571017},{"type":"v1","addr":"172.21.15.181:6805","nonce":1768571017}]},"public_addr":"172.21.15.181:6801/1768571017","cluster_addr":"172.21.15.181:6803/1768571017","heartbeat_back_addr":"172.21.15.181:6807/1768571017","heartbeat_front_addr":"172.21.15.181:6805/1768571017","state":["exists","up"]},{"osd":3,"uuid":"1a2e3786-f58f-4cad-b61e-404b2d7da8f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6811","nonce":2282791523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6813","nonce":2282791523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6817","nonce":2282791523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":2282791523},{"type":"v1","addr":"172.21.15.81:6815","nonce":2282791523}]},"public_addr":"172.21.15.81:6811/2282791523","cluster_addr":"172.21.15.81:6813/2282791523","heartbeat_back_addr":"172.21.15.81:6817/2282791523","heartbeat_front_addr":"172.21.15.81:6815/2282791523","state":["exists","up"]},{"osd":4,"uuid":"9e7883d2-d336-454f-b035-5cdaf8cf6d81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6809","nonce":1406616378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6811","nonce":1406616378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6815","nonce":1406616378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1406616378},{"type":"v1","addr":"172.21.15.164:6813","nonce":1406616378}]},"public_addr":"172.21.15.164:6809/1406616378","cluster_addr":"172.21.15.164:6811/1406616378","heartbeat_back_addr":"172.21.15.164:6815/1406616378","heartbeat_front_addr":"172.21.15.164:6813/1406616378","state":["exists","up"]},{"osd":5,"uuid":"510f6ee6-d0cb-4d53-959f-f3fdb5875218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6809","nonce":3082949171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6811","nonce":3082949171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6815","nonce":3082949171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":3082949171},{"type":"v1","addr":"172.21.15.181:6813","nonce":3082949171}]},"public_addr":"172.21.15.181:6809/3082949171","cluster_addr":"172.21.15.181:6811/3082949171","heartbeat_back_addr":"172.21.15.181:6815/3082949171","heartbeat_front_addr":"172.21.15.181:6813/3082949171","state":["exists","up"]},{"osd":6,"uuid":"6070ee30-62b8-4773-9031-357aef41a66b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6819","nonce":3031456716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6821","nonce":3031456716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6825","nonce":3031456716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3031456716},{"type":"v1","addr":"172.21.15.81:6823","nonce":3031456716}]},"public_addr":"172.21.15.81:6819/3031456716","cluster_addr":"172.21.15.81:6821/3031456716","heartbeat_back_addr":"172.21.15.81:6825/3031456716","heartbeat_front_addr":"172.21.15.81:6823/3031456716","state":["exists","up"]},{"osd":7,"uuid":"86891d46-f33c-4a5f-a736-373042a6b9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6817","nonce":2193157365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6819","nonce":2193157365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6823","nonce":2193157365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":2193157365},{"type":"v1","addr":"172.21.15.164:6821","nonce":2193157365}]},"public_addr":"172.21.15.164:6817/2193157365","cluster_addr":"172.21.15.164:6819/2193157365","heartbeat_back_addr":"172.21.15.164:6823/2193157365","heartbeat_front_addr":"172.21.15.164:6821/2193157365","state":["exists","up"]},{"osd":8,"uuid":"ceaa3ef3-df5f-4349-8798-cd94dc9f8610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6817","nonce":3075845600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6819","nonce":3075845600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6823","nonce":3075845600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":3075845600},{"type":"v1","addr":"172.21.15.181:6821","nonce":3075845600}]},"public_addr":"172.21.15.181:6817/3075845600","cluster_addr":"172.21.15.181:6819/3075845600","heartbeat_back_addr":"172.21.15.181:6823/3075845600","heartbeat_front_addr":"172.21.15.181:6821/3075845600","state":["exists","up"]},{"osd":9,"uuid":"9b8dcc89-4e4a-4834-9953-d7dfc14fa192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6827","nonce":3125475074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6829","nonce":3125475074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6833","nonce":3125475074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3125475074},{"type":"v1","addr":"172.21.15.81:6831","nonce":3125475074}]},"public_addr":"172.21.15.81:6827/3125475074","cluster_addr":"172.21.15.81:6829/3125475074","heartbeat_back_addr":"172.21.15.81:6833/3125475074","heartbeat_front_addr":"172.21.15.81:6831/3125475074","state":["exists","up"]},{"osd":10,"uuid":"f305743b-43b9-4558-95da-9c59836d2655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6825","nonce":1437229316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6827","nonce":1437229316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6831","nonce":1437229316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1437229316},{"type":"v1","addr":"172.21.15.164:6829","nonce":1437229316}]},"public_addr":"172.21.15.164:6825/1437229316","cluster_addr":"172.21.15.164:6827/1437229316","heartbeat_back_addr":"172.21.15.164:6831/1437229316","heartbeat_front_addr":"172.21.15.164:6829/1437229316","state":["exists","up"]},{"osd":11,"uuid":"ba023bc4-c42e-4f3a-b7a1-ef7796ca3ee5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6825","nonce":1957538335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6827","nonce":1957538335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6831","nonce":1957538335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1957538335},{"type":"v1","addr":"172.21.15.181:6829","nonce":1957538335}]},"public_addr":"172.21.15.181:6825/1957538335","cluster_addr":"172.21.15.181:6827/1957538335","heartbeat_back_addr":"172.21.15.181:6831/1957538335","heartbeat_front_addr":"172.21.15.181:6829/1957538335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:52:44.591420+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:09.334601+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:33.487207+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:53:59.003606+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:24.533457+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:54:49.492650+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:15.782906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:55:40.997403+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:06.606959+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:32.305792+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:56:58.156201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:57:22.608484+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.10","mappings":[{"from":9,"to":10}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3359413677":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/2658968302":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6800/677187629":"2024-09-22T02:50:47.609507+0000","172.21.15.81:6801/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:6800/3217567960":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2305526484":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/837683568":"2024-09-22T02:50:22.009612+0000","172.21.15.81:0/2720123143":"2024-09-22T02:50:47.609507+0000","172.21.15.81:0/83784468":"2024-09-22T02:50:22.009612+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:05:24.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f93a40b6510 msgr2=0x7f93a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:24.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f93a40b6510 0x7f93a40b8a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f93a80058c0 tx=0x7f93a8005d50 comp rx=0 tx=0).stop 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 msgr2=0x7f93b8076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8076190 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f93b0006010 tx=0x7f93b0003c90 comp rx=0 tx=0).stop 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 shutdown_connections 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f93a40b6510 0x7f93a40b8a20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b8109df0 0x7f93b8076190 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93b81094a0 0x7f93b8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 --2- 172.21.15.81:0/4270357147 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f93b8103b60 0x7f93b8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 >> 172.21.15.81:0/4270357147 conn(0x7f93b807b850 msgr2=0x7f93b8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 shutdown_connections 2024-09-21T03:05:24.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:24.940+0000 7f93bd17e640 1 -- 172.21.15.81:0/4270357147 wait complete. 2024-09-21T03:05:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:25 smithi081 ceph-mon[30991]: pgmap v510: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T03:05:25.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:25 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4270357147' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:05:25.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:25 smithi164 ceph-mon[34236]: pgmap v510: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T03:05:25.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:25 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4270357147' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:05:25.498 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:25 smithi181 ceph-mon[34096]: pgmap v510: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T03:05:25.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:25 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4270357147' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:05:25.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T03:05:26.046 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 -- 172.21.15.81:0/1054249932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 msgr2=0x7f767c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 --2- 172.21.15.81:0/1054249932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c10f560 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7674009ca0 tx=0x7f767402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 -- 172.21.15.81:0/1054249932 shutdown_connections 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 --2- 172.21.15.81:0/1054249932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c10f560 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 --2- 172.21.15.81:0/1054249932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f767c1083e0 0x7f767c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 --2- 172.21.15.81:0/1054249932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f767c102aa0 0x7f767c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 -- 172.21.15.81:0/1054249932 >> 172.21.15.81:0/1054249932 conn(0x7f767c0797e0 msgr2=0x7f767c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 -- 172.21.15.81:0/1054249932 shutdown_connections 2024-09-21T03:05:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.524+0000 7f7682f26640 1 -- 172.21.15.81:0/1054249932 wait complete. 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 Processor -- start 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 -- start start 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f767c102aa0 0x7f767c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f767c1083e0 0x7f767c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f767c1128a0 con 0x7f767c108d30 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f767c112720 con 0x7f767c1083e0 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7682f26640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f767c112a20 con 0x7f767c102aa0 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f76814c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f76814c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c19bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39646/0 (socket says 172.21.15.81:39646) 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f76814c3640 1 -- 172.21.15.81:0/2740480995 learned_addr learned my addr 172.21.15.81:0/2740480995 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7673fff640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f767c1083e0 0x7f767c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.525+0000 7f7680cc2640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f767c102aa0 0x7f767c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:26.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f76814c3640 1 -- 172.21.15.81:0/2740480995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f767c102aa0 msgr2=0x7f767c19b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f76814c3640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f767c102aa0 0x7f767c19b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f76814c3640 1 -- 172.21.15.81:0/2740480995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f767c1083e0 msgr2=0x7f767c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f76814c3640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f767c1083e0 0x7f767c19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f76814c3640 1 -- 172.21.15.81:0/2740480995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c1a64b0 con 0x7f767c108d30 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f7673fff640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f767c1083e0 0x7f767c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f76814c3640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c19bc70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7674005e30 tx=0x7f76740093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f7671ffb640 1 -- 172.21.15.81:0/2740480995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674032d10 con 0x7f767c108d30 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c1a6740 con 0x7f767c108d30 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f7671ffb640 1 -- 172.21.15.81:0/2740480995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7674032eb0 con 0x7f767c108d30 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f7671ffb640 1 -- 172.21.15.81:0/2740480995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674030b20 con 0x7f767c108d30 2024-09-21T03:05:26.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.526+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c1a6cd0 con 0x7f767c108d30 2024-09-21T03:05:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.527+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c102eb0 con 0x7f767c108d30 2024-09-21T03:05:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.529+0000 7f7671ffb640 1 -- 172.21.15.81:0/2740480995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7674030cc0 con 0x7f767c108d30 2024-09-21T03:05:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.529+0000 7f7671ffb640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f76640b6510 0x7f76640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.530+0000 7f7680cc2640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f76640b6510 0x7f76640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:26.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.530+0000 7f7671ffb640 1 -- 172.21.15.81:0/2740480995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9063+0+0 (secure 0 0 0) 0x7f7674108a70 con 0x7f767c108d30 2024-09-21T03:05:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.530+0000 7f7680cc2640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f76640b6510 0x7f76640b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7678005fd0 tx=0x7f7678005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.533+0000 7f7671ffb640 1 -- 172.21.15.81:0/2740480995 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76740cefc0 con 0x7f767c108d30 2024-09-21T03:05:26.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.750+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f767c06bc50 con 0x7f767c108d30 2024-09-21T03:05:26.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.752+0000 7f7671ffb640 1 -- 172.21.15.81:0/2740480995 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f767c06bc50 con 0x7f767c108d30 2024-09-21T03:05:26.754 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f76640b6510 msgr2=0x7f76640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f76640b6510 0x7f76640b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7678005fd0 tx=0x7f7678005e20 comp rx=0 tx=0).stop 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 msgr2=0x7f767c19bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c19bc70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7674005e30 tx=0x7f76740093d0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 shutdown_connections 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f76640b6510 0x7f76640b8a20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f767c108d30 0x7f767c19bc70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f767c1083e0 0x7f767c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 --2- 172.21.15.81:0/2740480995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f767c102aa0 0x7f767c19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 >> 172.21.15.81:0/2740480995 conn(0x7f767c0797e0 msgr2=0x7f767c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:26.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 shutdown_connections 2024-09-21T03:05:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:26.756+0000 7f7682f26640 1 -- 172.21.15.81:0/2740480995 wait complete. 2024-09-21T03:05:27.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:26 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a[30987]: 2024-09-21T03:05:26.751+0000 7fe4da5be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:05:27.106 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h[62473]: ignoring --setuser ceph since I am not root 2024-09-21T03:05:27.106 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h[62473]: ignoring --setgroup ceph since I am not root 2024-09-21T03:05:27.106 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-mds[62477]: -- 172.21.15.164:0/2828827548 <== mon.1 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f312085c20 con 0x55f31622d600 2024-09-21T03:05:27.106 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h[62473]: starting mds.h at 2024-09-21T03:05:27.106 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i[63120]: ignoring --setuser ceph since I am not root 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i[63120]: ignoring --setgroup ceph since I am not root 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-mds[63124]: -- 172.21.15.181:0/1493620040 <== mon.2 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561c7d24f860 con 0x561c813f7180 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i[63120]: starting mds.i at 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b[62742]: ignoring --setuser ceph since I am not root 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b[62742]: ignoring --setgroup ceph since I am not root 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-mds[62746]: -- 172.21.15.164:0/2622115118 <== mon.2 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c382933860 con 0x55c386adb180 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b[62742]: starting mds.b at 2024-09-21T03:05:27.107 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c[62848]: ignoring --setuser ceph since I am not root 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c[62848]: ignoring --setgroup ceph since I am not root 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-mds[62852]: -- 172.21.15.181:0/1626939567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a51b71860 con 0x557a55d19600 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c[62848]: starting mds.c at 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e[62193]: ignoring --setuser ceph since I am not root 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e[62193]: ignoring --setgroup ceph since I am not root 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:05:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e[62193]: starting mds.e at 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f[62581]: ignoring --setuser ceph since I am not root 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f[62581]: ignoring --setgroup ceph since I am not root 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-mds[62585]: -- 172.21.15.181:0/1351646669 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557406801860 con 0x55740a9a9600 2024-09-21T03:05:27.108 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:05:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f[62581]: starting mds.f at 2024-09-21T03:05:27.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:27 smithi164 ceph-mon[34236]: pgmap v511: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:05:27.431 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:27 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2740480995' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:05:27.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:27 smithi164 ceph-mon[34236]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:05:27.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:27 smithi164 ceph-mon[34236]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:05:27.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:27 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/2740480995' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:05:27.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:27 smithi164 ceph-mon[34236]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:05:27.432 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:27 smithi164 ceph-mon[34236]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:05:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:27 smithi181 ceph-mon[34096]: pgmap v511: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:05:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:27 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2740480995' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:05:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:27 smithi181 ceph-mon[34096]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:05:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:27 smithi181 ceph-mon[34096]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:05:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:27 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/2740480995' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:05:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:27 smithi181 ceph-mon[34096]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:05:27.499 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:27 smithi181 ceph-mon[34096]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:05:27.508 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:27 smithi081 ceph-mon[30991]: pgmap v511: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:05:27.508 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:27 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2740480995' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:05:27.508 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:27 smithi081 ceph-mon[30991]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:05:27.509 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:27 smithi081 ceph-mon[30991]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:05:27.509 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:27 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/2740480995' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:05:27.509 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:27 smithi081 ceph-mon[30991]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:05:27.509 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:27 smithi081 ceph-mon[30991]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:05:27.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:05:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 -- 172.21.15.81:0/2779775670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8102a60 msgr2=0x7f6dd8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/2779775670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8102a60 0x7f6dd8102e70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009900 tx=0x7f6dd002a410 comp rx=0 tx=0).stop 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 -- 172.21.15.81:0/2779775670 shutdown_connections 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/2779775670 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd81083a0 0x7f6dd81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/2779775670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dd8108cf0 0x7f6dd810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/2779775670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd8102a60 0x7f6dd8102e70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 -- 172.21.15.81:0/2779775670 >> 172.21.15.81:0/2779775670 conn(0x7f6dd8079730 msgr2=0x7f6dd8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 -- 172.21.15.81:0/2779775670 shutdown_connections 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.294+0000 7f6ddd53b640 1 -- 172.21.15.81:0/2779775670 wait complete. 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 Processor -- start 2024-09-21T03:05:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 -- start start 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dd8102a60 0x7f6dd819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd81083a0 0x7f6dd819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd8108cf0 0x7f6dd819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8112810 con 0x7f6dd81083a0 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8112690 con 0x7f6dd8102a60 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6ddd53b640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8112990 con 0x7f6dd8108cf0 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6dd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd81083a0 0x7f6dd819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6dd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd81083a0 0x7f6dd819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39662/0 (socket says 172.21.15.81:39662) 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6dd67fc640 1 -- 172.21.15.81:0/1488207240 learned_addr learned my addr 172.21.15.81:0/1488207240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6dd6ffd640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dd8102a60 0x7f6dd819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.295+0000 7f6dd77fe640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd8108cf0 0x7f6dd819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dd67fc640 1 -- 172.21.15.81:0/1488207240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd8108cf0 msgr2=0x7f6dd819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dd67fc640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd8108cf0 0x7f6dd819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dd67fc640 1 -- 172.21.15.81:0/1488207240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dd8102a60 msgr2=0x7f6dd819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dd67fc640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dd8102a60 0x7f6dd819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dd67fc640 1 -- 172.21.15.81:0/1488207240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd81a02e0 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dd6ffd640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dd8102a60 0x7f6dd819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dd67fc640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd81083a0 0x7f6dd819a910 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00ea80 tx=0x7f6dcc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dbffff640 1 -- 172.21.15.81:0/1488207240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00ce40 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd81a05d0 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dbffff640 1 -- 172.21.15.81:0/1488207240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6dcc011900 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6dbffff640 1 -- 172.21.15.81:0/1488207240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc01a9c0 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.296+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd81a6d30 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.297+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd8102e70 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.298+0000 7f6dbffff640 1 -- 172.21.15.81:0/1488207240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6dcc011470 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.299+0000 7f6dbffff640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6dc00b6510 0x7f6dc00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.299+0000 7f6dd6ffd640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6dc00b6510 0x7f6dc00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.299+0000 7f6dbffff640 1 -- 172.21.15.81:0/1488207240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9321+0+0 (secure 0 0 0) 0x7f6dcc0e7f20 con 0x7f6dd81083a0 2024-09-21T03:05:28.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.300+0000 7f6dd6ffd640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6dc00b6510 0x7f6dc00b8a20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000c00 tx=0x7f6dd0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.302+0000 7f6dbffff640 1 -- 172.21.15.81:0/1488207240 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6dcc058710 con 0x7f6dd81083a0 2024-09-21T03:05:28.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.516+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6dd81a70c0 con 0x7f6dd81083a0 2024-09-21T03:05:28.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.762+0000 7f6dbffff640 1 -- 172.21.15.81:0/1488207240 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7f6dcc016030 con 0x7f6dd81083a0 2024-09-21T03:05:28.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6dc00b6510 msgr2=0x7f6dc00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:28.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6dc00b6510 0x7f6dc00b8a20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000c00 tx=0x7f6dd0005a20 comp rx=0 tx=0).stop 2024-09-21T03:05:28.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd81083a0 msgr2=0x7f6dd819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:28.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd81083a0 0x7f6dd819a910 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00ea80 tx=0x7f6dcc00ef40 comp rx=0 tx=0).stop 2024-09-21T03:05:28.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 shutdown_connections 2024-09-21T03:05:28.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f6dc00b6510 0x7f6dc00b8a20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd8108cf0 0x7f6dd819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dd81083a0 0x7f6dd819a910 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 --2- 172.21.15.81:0/1488207240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6dd8102a60 0x7f6dd819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:28.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 >> 172.21.15.81:0/1488207240 conn(0x7f6dd8079730 msgr2=0x7f6dd8101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:28.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.764+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 shutdown_connections 2024-09-21T03:05:28.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:28.765+0000 7f6ddd53b640 1 -- 172.21.15.81:0/1488207240 wait complete. 2024-09-21T03:05:28.777 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6834/2651664999,v1:172.21.15.164:6837/2651664999] up:boot 2024-09-21T03:05:28.777 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6835/3909670539,v1:172.21.15.164:6838/3909670539] up:boot 2024-09-21T03:05:28.777 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.164:6836/3331796336,v1:172.21.15.164:6839/3331796336] up:boot 2024-09-21T03:05:28.777 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6834/2673861782,v1:172.21.15.181:6835/2673861782] up:boot 2024-09-21T03:05:28.777 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6836/2584866381,v1:172.21.15.181:6837/2584866381] up:boot 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: mds.? [v2:172.21.15.181:6838/487647559,v1:172.21.15.181:6839/487647559] up:boot 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: pgmap v513: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T03:05:28.778 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:28 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1488207240' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:05:29.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6834/2651664999,v1:172.21.15.164:6837/2651664999] up:boot 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6835/3909670539,v1:172.21.15.164:6838/3909670539] up:boot 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.164:6836/3331796336,v1:172.21.15.164:6839/3331796336] up:boot 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6834/2673861782,v1:172.21.15.181:6835/2673861782] up:boot 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6836/2584866381,v1:172.21.15.181:6837/2584866381] up:boot 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: mds.? [v2:172.21.15.181:6838/487647559,v1:172.21.15.181:6839/487647559] up:boot 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:05:29.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:05:29.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: pgmap v513: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T03:05:29.183 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:28 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1488207240' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6834/2651664999,v1:172.21.15.164:6837/2651664999] up:boot 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6835/3909670539,v1:172.21.15.164:6838/3909670539] up:boot 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.164:6836/3331796336,v1:172.21.15.164:6839/3331796336] up:boot 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6834/2673861782,v1:172.21.15.181:6835/2673861782] up:boot 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6836/2584866381,v1:172.21.15.181:6837/2584866381] up:boot 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: mds.? [v2:172.21.15.181:6838/487647559,v1:172.21.15.181:6839/487647559] up:boot 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:05:29.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:05:29.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:05:29.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:05:29.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:05:29.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: from='mgr.14150 172.21.15.81:0/2602403428' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:05:29.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: pgmap v513: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T03:05:29.250 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:28 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1488207240' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:05:29.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:05:29.853 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:29.974 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:29 smithi081 ceph-mon[30991]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:05:29.974 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:29 smithi081 ceph-mon[30991]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:05:29.975 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:29 smithi081 ceph-mon[30991]: Cluster is now healthy 2024-09-21T03:05:29.975 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:29 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1488207240' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:05:29.975 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:29 smithi081 ceph-mon[30991]: fsmap 12 up:standby 2024-09-21T03:05:30.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:29 smithi164 ceph-mon[34236]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:05:30.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:29 smithi164 ceph-mon[34236]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:05:30.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:29 smithi164 ceph-mon[34236]: Cluster is now healthy 2024-09-21T03:05:30.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:29 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1488207240' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:05:30.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:29 smithi164 ceph-mon[34236]: fsmap 12 up:standby 2024-09-21T03:05:30.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:29 smithi181 ceph-mon[34096]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:05:30.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:29 smithi181 ceph-mon[34096]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:05:30.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:29 smithi181 ceph-mon[34096]: Cluster is now healthy 2024-09-21T03:05:30.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:29 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1488207240' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:05:30.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:29 smithi181 ceph-mon[34096]: fsmap 12 up:standby 2024-09-21T03:05:30.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 -- 172.21.15.81:0/4050955142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c108cf0 msgr2=0x7f1f6c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:30.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4050955142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c108cf0 0x7f1f6c10f520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009ca0 tx=0x7f1f6402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 -- 172.21.15.81:0/4050955142 shutdown_connections 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4050955142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f6c1083a0 0x7f1f6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4050955142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c108cf0 0x7f1f6c10f520 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4050955142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f6c102a60 0x7f1f6c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 -- 172.21.15.81:0/4050955142 >> 172.21.15.81:0/4050955142 conn(0x7f1f6c079760 msgr2=0x7f1f6c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 -- 172.21.15.81:0/4050955142 shutdown_connections 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.348+0000 7f1f711fc640 1 -- 172.21.15.81:0/4050955142 wait complete. 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 Processor -- start 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 -- start start 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c102a60 0x7f1f6c19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f6c1083a0 0x7f1f6c19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f6c108cf0 0x7f1f6c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c1128b0 con 0x7f1f6c102a60 2024-09-21T03:05:30.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c112730 con 0x7f1f6c1083a0 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f711fc640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c112a30 con 0x7f1f6c108cf0 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f6ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c102a60 0x7f1f6c19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f6ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c102a60 0x7f1f6c19b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39670/0 (socket says 172.21.15.81:39670) 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f6ad9d640 1 -- 172.21.15.81:0/4202363581 learned_addr learned my addr 172.21.15.81:0/4202363581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.349+0000 7f1f6a59c640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f6c1083a0 0x7f1f6c19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6b59e640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f6c108cf0 0x7f1f6c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6ad9d640 1 -- 172.21.15.81:0/4202363581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f6c108cf0 msgr2=0x7f1f6c19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6ad9d640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f6c108cf0 0x7f1f6c19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6ad9d640 1 -- 172.21.15.81:0/4202363581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f6c1083a0 msgr2=0x7f1f6c19b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6ad9d640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f6c1083a0 0x7f1f6c19b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6ad9d640 1 -- 172.21.15.81:0/4202363581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c1a63e0 con 0x7f1f6c102a60 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6b59e640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f6c108cf0 0x7f1f6c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f6ad9d640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c102a60 0x7f1f6c19b160 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c920 tx=0x7f1f5c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f63fff640 1 -- 172.21.15.81:0/4202363581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c007c70 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c1a66d0 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f63fff640 1 -- 172.21.15.81:0/4202363581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f5c007e10 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f63fff640 1 -- 172.21.15.81:0/4202363581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0186f0 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.350+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c1a6c60 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.351+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6c103ce0 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.354+0000 7f1f63fff640 1 -- 172.21.15.81:0/4202363581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1f5c00f450 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.354+0000 7f1f63fff640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f580b6510 0x7f1f580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.354+0000 7f1f6a59c640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f580b6510 0x7f1f580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.355+0000 7f1f63fff640 1 -- 172.21.15.81:0/4202363581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9321+0+0 (secure 0 0 0) 0x7f1f5c0e7ba0 con 0x7f1f6c102a60 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.355+0000 7f1f6a59c640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f580b6510 0x7f1f580b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c108100 tx=0x7f1f5400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:30.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.358+0000 7f1f63fff640 1 -- 172.21.15.81:0/4202363581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f5c014030 con 0x7f1f6c102a60 2024-09-21T03:05:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.553+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f6c102e70 con 0x7f1f6c102a60 2024-09-21T03:05:30.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.770+0000 7f1f63fff640 1 -- 172.21.15.81:0/4202363581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f1f6c102e70 con 0x7f1f6c102a60 2024-09-21T03:05:30.772 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:05:30.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f580b6510 msgr2=0x7f1f580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:30.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f580b6510 0x7f1f580b8a20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c108100 tx=0x7f1f5400a250 comp rx=0 tx=0).stop 2024-09-21T03:05:30.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c102a60 msgr2=0x7f1f6c19b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:30.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c102a60 0x7f1f6c19b160 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00c920 tx=0x7f1f5c00cde0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 shutdown_connections 2024-09-21T03:05:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7f1f580b6510 0x7f1f580b8a20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f6c108cf0 0x7f1f6c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f6c1083a0 0x7f1f6c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 --2- 172.21.15.81:0/4202363581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6c102a60 0x7f1f6c19b160 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.773+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 >> 172.21.15.81:0/4202363581 conn(0x7f1f6c079760 msgr2=0x7f1f6c106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.774+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 shutdown_connections 2024-09-21T03:05:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:30.774+0000 7f1f711fc640 1 -- 172.21.15.81:0/4202363581 wait complete. 2024-09-21T03:05:30.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:30 smithi081 ceph-mon[30991]: pgmap v514: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T03:05:30.805 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:30 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4202363581' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:31.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:30 smithi164 ceph-mon[34236]: pgmap v514: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T03:05:31.182 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:30 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4202363581' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:31.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:30 smithi181 ceph-mon[34096]: pgmap v514: 129 pgs: 129 active+clean; 999 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T03:05:31.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:30 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4202363581' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:31.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:05:31.719 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:32.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:31 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/4202363581' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:32.033 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:31 smithi081 ceph-mon[30991]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:05:32.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:31 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/4202363581' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:32.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:31 smithi164 ceph-mon[34236]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:05:32.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:31 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/4202363581' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:32.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:31 smithi181 ceph-mon[34096]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 -- 172.21.15.81:0/2231669166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 msgr2=0x7fefe8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 --2- 172.21.15.81:0/2231669166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe8110620 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009ca0 tx=0x7fefe002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 -- 172.21.15.81:0/2231669166 shutdown_connections 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 --2- 172.21.15.81:0/2231669166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe8110620 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 --2- 172.21.15.81:0/2231669166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefe81094a0 0x7fefe81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 --2- 172.21.15.81:0/2231669166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe8103b60 0x7fefe8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 -- 172.21.15.81:0/2231669166 >> 172.21.15.81:0/2231669166 conn(0x7fefe807b850 msgr2=0x7fefe807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 -- 172.21.15.81:0/2231669166 shutdown_connections 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 -- 172.21.15.81:0/2231669166 wait complete. 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.266+0000 7fefee392640 1 Processor -- start 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefee392640 1 -- start start 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefee392640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefe8103b60 0x7fefe819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefee392640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe81094a0 0x7fefe819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefee392640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefee392640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81139b0 con 0x7fefe8109df0 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefee392640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8113830 con 0x7fefe8103b60 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefee392640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8113b30 con 0x7fefe81094a0 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44362/0 (socket says 172.21.15.81:44362) 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 -- 172.21.15.81:0/3596002512 learned_addr learned my addr 172.21.15.81:0/3596002512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefe7fff640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefe8103b60 0x7fefe819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefdffff640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe81094a0 0x7fefe819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 -- 172.21.15.81:0/3596002512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe81094a0 msgr2=0x7fefe819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe81094a0 0x7fefe819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 -- 172.21.15.81:0/3596002512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefe8103b60 msgr2=0x7fefe819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefe8103b60 0x7fefe819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 -- 172.21.15.81:0/3596002512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe81a02b0 con 0x7fefe8109df0 2024-09-21T03:05:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefdffff640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe81094a0 0x7fefe819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.267+0000 7fefec92f640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe819fc40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005cc0 tx=0x7fefe0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.268+0000 7fefe5ffb640 1 -- 172.21.15.81:0/3596002512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0032e00 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.268+0000 7fefe5ffb640 1 -- 172.21.15.81:0/3596002512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefe00044d0 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.268+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe81a0540 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.268+0000 7fefe5ffb640 1 -- 172.21.15.81:0/3596002512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0030b70 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.268+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81a0a80 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.269+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe8103f70 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.270+0000 7fefe5ffb640 1 -- 172.21.15.81:0/3596002512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fefe0030d10 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.271+0000 7fefe5ffb640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fefd40b6540 0x7fefd40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.271+0000 7fefe7fff640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fefd40b6540 0x7fefd40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.271+0000 7fefe5ffb640 1 -- 172.21.15.81:0/3596002512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8825+0+0 (secure 0 0 0) 0x7fefe01089c0 con 0x7fefe8109df0 2024-09-21T03:05:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.271+0000 7fefe7fff640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fefd40b6540 0x7fefd40b8a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005e10 tx=0x7fefd8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:32.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.274+0000 7fefe5ffb640 1 -- 172.21.15.81:0/3596002512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefe00cf000 con 0x7fefe8109df0 2024-09-21T03:05:32.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.458+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fefe802e640 con 0x7fefe8109df0 2024-09-21T03:05:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.778+0000 7fefe5ffb640 1 -- 172.21.15.81:0/3596002512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7fefe00d33e0 con 0x7fefe8109df0 2024-09-21T03:05:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-21T03:05:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fefd40b6540 msgr2=0x7fefd40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fefd40b6540 0x7fefd40b8a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fefd8005e10 tx=0x7fefd8005da0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 msgr2=0x7fefe819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe819fc40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fefe0005cc0 tx=0x7fefe0032a10 comp rx=0 tx=0).stop 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 shutdown_connections 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7fefd40b6540 0x7fefd40b8a50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fefe81094a0 0x7fefe819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefe8109df0 0x7fefe819fc40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 --2- 172.21.15.81:0/3596002512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fefe8103b60 0x7fefe819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.781+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 >> 172.21.15.81:0/3596002512 conn(0x7fefe807b850 msgr2=0x7fefe8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.782+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 shutdown_connections 2024-09-21T03:05:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:32.782+0000 7fefee392640 1 -- 172.21.15.81:0/3596002512 wait complete. 2024-09-21T03:05:33.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:32 smithi081 ceph-mon[30991]: pgmap v516: 97 pgs: 97 active+clean; 577 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:05:33.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:32 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3596002512' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:33.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:32 smithi164 ceph-mon[34236]: pgmap v516: 97 pgs: 97 active+clean; 577 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:05:33.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:32 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3596002512' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:33.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:32 smithi181 ceph-mon[34096]: pgmap v516: 97 pgs: 97 active+clean; 577 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:05:33.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:32 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3596002512' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:33.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T03:05:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:05:34.039 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:33 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/3596002512' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:34.039 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:33 smithi081 ceph-mon[30991]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:05:34.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:33 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/3596002512' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:34.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:33 smithi164 ceph-mon[34236]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 -- 172.21.15.81:0/2685074802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc102a80 msgr2=0x7efedc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 --2- 172.21.15.81:0/2685074802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc102a80 0x7efedc102e90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efecc009900 tx=0x7efecc02a400 comp rx=0 tx=0).stop 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 -- 172.21.15.81:0/2685074802 shutdown_connections 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 --2- 172.21.15.81:0/2685074802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efedc108d10 0x7efedc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 --2- 172.21.15.81:0/2685074802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efedc1083c0 0x7efedc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 --2- 172.21.15.81:0/2685074802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc102a80 0x7efedc102e90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 -- 172.21.15.81:0/2685074802 >> 172.21.15.81:0/2685074802 conn(0x7efedc079740 msgr2=0x7efedc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 -- 172.21.15.81:0/2685074802 shutdown_connections 2024-09-21T03:05:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.226+0000 7efee4752640 1 -- 172.21.15.81:0/2685074802 wait complete. 2024-09-21T03:05:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.227+0000 7efee4752640 1 Processor -- start 2024-09-21T03:05:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.227+0000 7efee4752640 1 -- start start 2024-09-21T03:05:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.227+0000 7efee4752640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efedc102a80 0x7efedc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.227+0000 7efee4752640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efedc1083c0 0x7efedc199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.227+0000 7efee4752640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc108d10 0x7efedc19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:34.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee4752640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efedc112890 con 0x7efedc108d10 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee4752640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efedc112710 con 0x7efedc102a80 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee4752640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 -- 0x7efedc112a10 con 0x7efedc1083c0 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc108d10 0x7efedc19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc108d10 0x7efedc19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44380/0 (socket says 172.21.15.81:44380) 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 -- 172.21.15.81:0/1226892855 learned_addr learned my addr 172.21.15.81:0/1226892855 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee1ced640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efedc1083c0 0x7efedc199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee24ee640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efedc102a80 0x7efedc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 -- 172.21.15.81:0/1226892855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efedc1083c0 msgr2=0x7efedc199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efedc1083c0 0x7efedc199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 -- 172.21.15.81:0/1226892855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efedc102a80 msgr2=0x7efedc1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efedc102a80 0x7efedc1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 -- 172.21.15.81:0/1226892855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc19f250 con 0x7efedc108d10 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee2cef640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc108d10 0x7efedc19eb20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efed400b970 tx=0x7efed400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efedb7fe640 1 -- 172.21.15.81:0/1226892855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4019070 con 0x7efedc108d10 2024-09-21T03:05:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.228+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc19f540 con 0x7efedc108d10 2024-09-21T03:05:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.229+0000 7efedb7fe640 1 -- 172.21.15.81:0/1226892855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efed4014440 con 0x7efedc108d10 2024-09-21T03:05:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.229+0000 7efedb7fe640 1 -- 172.21.15.81:0/1226892855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed40075d0 con 0x7efedc108d10 2024-09-21T03:05:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.229+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc06bb40 con 0x7efedc108d10 2024-09-21T03:05:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.230+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc103d00 con 0x7efedc108d10 2024-09-21T03:05:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.231+0000 7efedb7fe640 1 -- 172.21.15.81:0/1226892855 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7efed401c070 con 0x7efedc108d10 2024-09-21T03:05:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.232+0000 7efedb7fe640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efec40b6510 0x7efec40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:05:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.232+0000 7efee24ee640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efec40b6510 0x7efec40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:05:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.232+0000 7efedb7fe640 1 -- 172.21.15.81:0/1226892855 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8324+0+0 (secure 0 0 0) 0x7efed40e67f0 con 0x7efedc108d10 2024-09-21T03:05:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.232+0000 7efee24ee640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efec40b6510 0x7efec40b8a20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efecc0057c0 tx=0x7efecc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:05:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.236+0000 7efedb7fe640 1 -- 172.21.15.81:0/1226892855 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efed40b1400 con 0x7efedc108d10 2024-09-21T03:05:34.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:33 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/3596002512' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:34.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:33 smithi181 ceph-mon[34096]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:05:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.422+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7efedc06c670 con 0x7efedc108d10 2024-09-21T03:05:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.786+0000 7efedb7fe640 1 -- 172.21.15.81:0/1226892855 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v86) ==== 178+0+0 (secure 0 0 0) 0x7efed40b6340 con 0x7efedc108d10 2024-09-21T03:05:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2024-09-21T03:05:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.788+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efec40b6510 msgr2=0x7efec40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.788+0000 7efee4752640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efec40b6510 0x7efec40b8a20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efecc0057c0 tx=0x7efecc0058d0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.788+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc108d10 msgr2=0x7efedc19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:05:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.788+0000 7efee4752640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc108d10 0x7efedc19eb20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efed400b970 tx=0x7efed400be30 comp rx=0 tx=0).stop 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 shutdown_connections 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:6800/3007447899,v1:172.21.15.81:6801/3007447899] conn(0x7efec40b6510 0x7efec40b8a20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efedc1083c0 0x7efedc199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efedc108d10 0x7efedc19eb20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 --2- 172.21.15.81:0/1226892855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efedc102a80 0x7efedc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 >> 172.21.15.81:0/1226892855 conn(0x7efedc079740 msgr2=0x7efedc101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 shutdown_connections 2024-09-21T03:05:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T03:05:34.789+0000 7efee4752640 1 -- 172.21.15.81:0/1226892855 wait complete. 2024-09-21T03:05:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:34 smithi081 ceph-mon[30991]: pgmap v518: 33 pgs: 33 active+clean; 577 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:05:35.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:34 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1226892855' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:35.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:34 smithi164 ceph-mon[34236]: pgmap v518: 33 pgs: 33 active+clean; 577 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:05:35.181 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:34 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1226892855' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:35.248 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:34 smithi181 ceph-mon[34096]: pgmap v518: 33 pgs: 33 active+clean; 577 KiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:05:35.249 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:34 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1226892855' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:05:35.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:05:35.643 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:05:35.678 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:05:35.710 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T03:05:35.710 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:05:35.725 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:05:35.742 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:05:35.768 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T03:05:35.769 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T03:05:35.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a 2024-09-21T03:05:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:35 smithi164 ceph-mon[34236]: from='client.? 172.21.15.81:0/1226892855' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:35.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:35 smithi164 ceph-mon[34236]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:05:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:35 smithi181 ceph-mon[34096]: from='client.? 172.21.15.81:0/1226892855' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:35.999 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:35 smithi181 ceph-mon[34096]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:05:36.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:35 smithi081 ceph-mon[30991]: from='client.? 172.21.15.81:0/1226892855' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:05:36.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:35 smithi081 ceph-mon[30991]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:05:36.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:35 smithi081 systemd[1]: Stopping Ceph mon.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:36.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a[30987]: 2024-09-21T03:05:36.101+0000 7fe4dfdc9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:05:36.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a[30987]: 2024-09-21T03:05:36.101+0000 7fe4dfdc9640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T03:05:36.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:36 smithi081 podman[91651]: 2024-09-21 03:05:36.173721453 +0000 UTC m=+0.211814913 container died 4868ece53fa78f269a1a809b862b9f7c8eca2866832c35c063639c02a13416b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T03:05:37.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:36 smithi081 podman[91651]: 2024-09-21 03:05:36.79476667 +0000 UTC m=+0.832860118 container cleanup 4868ece53fa78f269a1a809b862b9f7c8eca2866832c35c063639c02a13416b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T03:05:37.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:36 smithi081 bash[91651]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a 2024-09-21T03:05:37.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 21 03:05:37 smithi081 podman[91663]: 2024-09-21 03:05:37.038234151 +0000 UTC m=+0.859474088 container remove 4868ece53fa78f269a1a809b862b9f7c8eca2866832c35c063639c02a13416b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:05:37.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T03:05:37.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:05:37.328 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T03:05:37.328 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T03:05:37.328 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.b 2024-09-21T03:05:37.655 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:37 smithi164 systemd[1]: Stopping Ceph mon.b for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:37.931 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-b[34232]: 2024-09-21T03:05:37.653+0000 7ff30f64a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:05:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-b[34232]: 2024-09-21T03:05:37.653+0000 7ff30f64a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T03:05:37.932 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:37 smithi164 podman[65298]: 2024-09-21 03:05:37.705384284 +0000 UTC m=+0.182790523 container died 86da62be435b19ce4690cb9b4ea97efd1481279534f59a0c6e578a2208315b4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T03:05:38.373 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:38 smithi164 podman[65298]: 2024-09-21 03:05:38.095492379 +0000 UTC m=+0.572898613 container cleanup 86da62be435b19ce4690cb9b4ea97efd1481279534f59a0c6e578a2208315b4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T03:05:38.373 INFO:journalctl@ceph.mon.b.smithi164.stdout:Sep 21 03:05:38 smithi164 bash[65298]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-b 2024-09-21T03:05:38.530 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T03:05:38.579 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:05:38.580 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T03:05:38.580 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T03:05:38.580 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.c 2024-09-21T03:05:38.910 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:38 smithi181 systemd[1]: Stopping Ceph mon.c for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:39.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-c[34092]: 2024-09-21T03:05:38.908+0000 7fccaea06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:05:39.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-c[34092]: 2024-09-21T03:05:38.908+0000 7fccaea06640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T03:05:39.187 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:38 smithi181 podman[65729]: 2024-09-21 03:05:38.970743734 +0000 UTC m=+0.194967462 container died 3737afef4436313025df1a758951d5f72620bbc18c963b8e472909a3ea71f68f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T03:05:39.443 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:39 smithi181 podman[65729]: 2024-09-21 03:05:39.326538692 +0000 UTC m=+0.550762420 container cleanup 3737afef4436313025df1a758951d5f72620bbc18c963b8e472909a3ea71f68f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T03:05:39.443 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:39 smithi181 bash[65729]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-c 2024-09-21T03:05:39.741 INFO:journalctl@ceph.mon.c.smithi181.stdout:Sep 21 03:05:39 smithi181 podman[65741]: 2024-09-21 03:05:39.611771898 +0000 UTC m=+0.639199471 container remove 3737afef4436313025df1a758951d5f72620bbc18c963b8e472909a3ea71f68f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mon-c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T03:05:39.757 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T03:05:39.801 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:05:39.802 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T03:05:39.802 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T03:05:39.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.x 2024-09-21T03:05:40.157 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 03:05:39 smithi081 systemd[1]: Stopping Ceph mgr.x for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:40.422 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 03:05:40 smithi081 podman[91772]: 2024-09-21 03:05:40.156113441 +0000 UTC m=+0.158795431 container died 6f2af48afde9e80815a33464a3cb1eaf7a40399ab1ef0d7dc3e0b3ba9672cd06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T03:05:41.055 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 03:05:40 smithi081 podman[91772]: 2024-09-21 03:05:40.701327187 +0000 UTC m=+0.704009169 container cleanup 6f2af48afde9e80815a33464a3cb1eaf7a40399ab1ef0d7dc3e0b3ba9672cd06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T03:05:41.055 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 03:05:40 smithi081 bash[91772]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x 2024-09-21T03:05:41.055 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 21 03:05:40 smithi081 podman[91784]: 2024-09-21 03:05:40.928392011 +0000 UTC m=+0.766336066 container remove 6f2af48afde9e80815a33464a3cb1eaf7a40399ab1ef0d7dc3e0b3ba9672cd06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T03:05:41.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T03:05:41.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:05:41.262 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T03:05:41.262 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T03:05:41.262 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.y 2024-09-21T03:05:41.597 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:41 smithi164 systemd[1]: Stopping Ceph mgr.y for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:41.931 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:41 smithi164 podman[65421]: 2024-09-21 03:05:41.596207101 +0000 UTC m=+0.144372518 container died 5e49aeb605654248a9c36ce7ebf0b8ded82fe6c3f18660b41714f0e0509fca8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T03:05:42.253 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:42 smithi164 podman[65421]: 2024-09-21 03:05:42.026013133 +0000 UTC m=+0.574178548 container cleanup 5e49aeb605654248a9c36ce7ebf0b8ded82fe6c3f18660b41714f0e0509fca8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T03:05:42.253 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:42 smithi164 bash[65421]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-y 2024-09-21T03:05:42.494 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T03:05:42.515 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:42 smithi164 podman[65436]: 2024-09-21 03:05:42.252696308 +0000 UTC m=+0.650724746 container remove 5e49aeb605654248a9c36ce7ebf0b8ded82fe6c3f18660b41714f0e0509fca8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:05:42.515 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:42 smithi164 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T03:05:42.515 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:42 smithi164 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-21T03:05:42.515 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:42 smithi164 systemd[1]: Stopped Ceph mgr.y for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T03:05:42.515 INFO:journalctl@ceph.mgr.y.smithi164.stdout:Sep 21 03:05:42 smithi164 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.y.service: Consumed 6.882s CPU time. 2024-09-21T03:05:42.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:05:42.528 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T03:05:42.528 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T03:05:42.528 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.z 2024-09-21T03:05:42.878 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:42 smithi181 systemd[1]: Stopping Ceph mgr.z for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:43.209 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:42 smithi181 podman[65863]: 2024-09-21 03:05:42.877509353 +0000 UTC m=+0.153753497 container stop 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:05:43.209 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:42 smithi181 podman[65863]: 2024-09-21 03:05:42.903434837 +0000 UTC m=+0.179678989 container died 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-21T03:05:43.485 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:43 smithi181 podman[65863]: 2024-09-21 03:05:43.299422681 +0000 UTC m=+0.575666858 container cleanup 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T03:05:43.485 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:43 smithi181 bash[65863]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z 2024-09-21T03:05:43.714 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T03:05:43.736 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:43 smithi181 podman[65875]: 2024-09-21 03:05:43.484411317 +0000 UTC m=+0.600950985 container remove 429eb4bc966715daf273459c896525d4805d1a97d2ffe0f2803cc0a7bf482937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-21T03:05:43.736 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:43 smithi181 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T03:05:43.736 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:43 smithi181 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.z.service: Failed with result 'exit-code'. 2024-09-21T03:05:43.736 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:43 smithi181 systemd[1]: Stopped Ceph mgr.z for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T03:05:43.736 INFO:journalctl@ceph.mgr.z.smithi181.stdout:Sep 21 03:05:43 smithi181 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mgr.z.service: Consumed 6.791s CPU time. 2024-09-21T03:05:43.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:05:43.750 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T03:05:43.750 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T03:05:43.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.0 2024-09-21T03:05:44.055 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:43 smithi081 systemd[1]: Stopping Ceph osd.0 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:44.555 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0[46420]: 2024-09-21T03:05:44.056+0000 7fd33c4bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:05:44.555 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0[46420]: 2024-09-21T03:05:44.056+0000 7fd33c4bd640 -1 osd.0 86 *** Got signal Terminated *** 2024-09-21T03:05:44.555 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0[46420]: 2024-09-21T03:05:44.056+0000 7fd33c4bd640 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:05:49.776 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:49 smithi081 podman[91906]: 2024-09-21 03:05:49.460762136 +0000 UTC m=+5.523554137 container died 7c84349b6475e05a5f3b964d360955aefb56ce92aefe686d422477598dfde24d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T03:05:50.055 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:49 smithi081 podman[91906]: 2024-09-21 03:05:49.966338548 +0000 UTC m=+6.029130592 container cleanup 7c84349b6475e05a5f3b964d360955aefb56ce92aefe686d422477598dfde24d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T03:05:50.055 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:49 smithi081 bash[91906]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0 2024-09-21T03:05:50.740 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:50 smithi081 podman[91923]: 2024-09-21 03:05:50.326800548 +0000 UTC m=+0.864682239 container remove 7c84349b6475e05a5f3b964d360955aefb56ce92aefe686d422477598dfde24d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:05:51.031 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:50 smithi081 podman[92009]: 2024-09-21 03:05:50.642628853 +0000 UTC m=+0.016205824 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:05:51.031 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:50 smithi081 podman[92009]: 2024-09-21 03:05:50.744329507 +0000 UTC m=+0.117906474 container create f8d80d4c9a5425f4da096e2057d9255fdb57f512f29d176e839aab5d573bf3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T03:05:51.031 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:51 smithi081 podman[92009]: 2024-09-21 03:05:51.030743728 +0000 UTC m=+0.404320684 container init f8d80d4c9a5425f4da096e2057d9255fdb57f512f29d176e839aab5d573bf3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:05:51.305 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:51 smithi081 podman[92009]: 2024-09-21 03:05:51.03430765 +0000 UTC m=+0.407884615 container start f8d80d4c9a5425f4da096e2057d9255fdb57f512f29d176e839aab5d573bf3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T03:05:51.305 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:51 smithi081 podman[92009]: 2024-09-21 03:05:51.130912902 +0000 UTC m=+0.504489861 container attach f8d80d4c9a5425f4da096e2057d9255fdb57f512f29d176e839aab5d573bf3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T03:05:51.305 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 21 03:05:51 smithi081 podman[92009]: 2024-09-21 03:05:51.228272744 +0000 UTC m=+0.601849713 container died f8d80d4c9a5425f4da096e2057d9255fdb57f512f29d176e839aab5d573bf3a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T03:05:51.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T03:05:51.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:05:51.953 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T03:05:51.953 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T03:05:51.953 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.1 2024-09-21T03:05:52.431 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:52 smithi164 systemd[1]: Stopping Ceph osd.1 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:05:52.931 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1[38131]: 2024-09-21T03:05:52.555+0000 7f6273839640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:05:52.931 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1[38131]: 2024-09-21T03:05:52.555+0000 7f6273839640 -1 osd.1 86 *** Got signal Terminated *** 2024-09-21T03:05:52.932 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1[38131]: 2024-09-21T03:05:52.555+0000 7f6273839640 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:05:58.349 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:58 smithi164 podman[65545]: 2024-09-21 03:05:58.089397195 +0000 UTC m=+5.942043866 container died 9ea75220ac3917f6314404e379d59893f44ec5c31e8a3688eac82fb7ce52e022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T03:05:58.681 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:58 smithi164 podman[65545]: 2024-09-21 03:05:58.455662077 +0000 UTC m=+6.308308751 container cleanup 9ea75220ac3917f6314404e379d59893f44ec5c31e8a3688eac82fb7ce52e022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T03:05:58.681 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:58 smithi164 bash[65545]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1 2024-09-21T03:05:59.086 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:58 smithi164 podman[65561]: 2024-09-21 03:05:58.756987254 +0000 UTC m=+0.664038828 container remove 9ea75220ac3917f6314404e379d59893f44ec5c31e8a3688eac82fb7ce52e022 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T03:05:59.361 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:59 smithi164 podman[65649]: 2024-09-21 03:05:58.988565904 +0000 UTC m=+0.016253735 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:05:59.362 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:59 smithi164 podman[65649]: 2024-09-21 03:05:59.0997243 +0000 UTC m=+0.127412124 container create 61a1203a383cd2cec2158ed0db7427738559fc676bb885b2cdfacac5045a9738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T03:05:59.682 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:59 smithi164 podman[65649]: 2024-09-21 03:05:59.361192344 +0000 UTC m=+0.388880166 container init 61a1203a383cd2cec2158ed0db7427738559fc676bb885b2cdfacac5045a9738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T03:05:59.682 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:59 smithi164 podman[65649]: 2024-09-21 03:05:59.364630151 +0000 UTC m=+0.392317984 container start 61a1203a383cd2cec2158ed0db7427738559fc676bb885b2cdfacac5045a9738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T03:05:59.682 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:59 smithi164 podman[65649]: 2024-09-21 03:05:59.477770735 +0000 UTC m=+0.505458572 container attach 61a1203a383cd2cec2158ed0db7427738559fc676bb885b2cdfacac5045a9738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T03:05:59.682 INFO:journalctl@ceph.osd.1.smithi164.stdout:Sep 21 03:05:59 smithi164 podman[65649]: 2024-09-21 03:05:59.555436708 +0000 UTC m=+0.583124543 container died 61a1203a383cd2cec2158ed0db7427738559fc676bb885b2cdfacac5045a9738 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T03:06:00.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T03:06:00.280 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:00.280 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T03:06:00.280 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T03:06:00.280 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.2 2024-09-21T03:06:00.621 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:00 smithi181 systemd[1]: Stopping Ceph osd.2 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:00.999 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2[38450]: 2024-09-21T03:06:00.618+0000 7f1670426640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:00.999 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2[38450]: 2024-09-21T03:06:00.618+0000 7f1670426640 -1 osd.2 86 *** Got signal Terminated *** 2024-09-21T03:06:00.999 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2[38450]: 2024-09-21T03:06:00.618+0000 7f1670426640 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:06.481 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:06 smithi181 podman[65988]: 2024-09-21 03:06:06.171811082 +0000 UTC m=+5.690931045 container died 39e0dfca9448044ab6d6c7fb08e7bf7dba48a2e9fd8f783f978ac17a05f62810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T03:06:06.748 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:06 smithi181 podman[65988]: 2024-09-21 03:06:06.57066381 +0000 UTC m=+6.089783762 container cleanup 39e0dfca9448044ab6d6c7fb08e7bf7dba48a2e9fd8f783f978ac17a05f62810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T03:06:06.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:06 smithi181 bash[65988]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2 2024-09-21T03:06:07.133 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:06 smithi181 podman[66003]: 2024-09-21 03:06:06.805539074 +0000 UTC m=+0.630352592 container remove 39e0dfca9448044ab6d6c7fb08e7bf7dba48a2e9fd8f783f978ac17a05f62810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:06:07.460 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:07 smithi181 podman[66094]: 2024-09-21 03:06:07.036111817 +0000 UTC m=+0.015974093 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:06:07.460 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:07 smithi181 podman[66094]: 2024-09-21 03:06:07.148403615 +0000 UTC m=+0.128265932 container create 16a8bfc53336094735b82ff0c113c82d5bf90b8c94a8f5f5a7160fe7e758dfe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:07.460 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:07 smithi181 podman[66094]: 2024-09-21 03:06:07.376172779 +0000 UTC m=+0.356035054 container init 16a8bfc53336094735b82ff0c113c82d5bf90b8c94a8f5f5a7160fe7e758dfe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:07.461 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:07 smithi181 podman[66094]: 2024-09-21 03:06:07.379444151 +0000 UTC m=+0.359306426 container start 16a8bfc53336094735b82ff0c113c82d5bf90b8c94a8f5f5a7160fe7e758dfe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:06:07.461 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:07 smithi181 podman[66094]: 2024-09-21 03:06:07.459432878 +0000 UTC m=+0.439295154 container attach 16a8bfc53336094735b82ff0c113c82d5bf90b8c94a8f5f5a7160fe7e758dfe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T03:06:07.749 INFO:journalctl@ceph.osd.2.smithi181.stdout:Sep 21 03:06:07 smithi181 podman[66094]: 2024-09-21 03:06:07.564769122 +0000 UTC m=+0.544631398 container died 16a8bfc53336094735b82ff0c113c82d5bf90b8c94a8f5f5a7160fe7e758dfe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T03:06:08.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T03:06:08.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:08.256 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T03:06:08.257 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T03:06:08.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.3 2024-09-21T03:06:08.555 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:08 smithi081 systemd[1]: Stopping Ceph osd.3 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:09.055 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:08 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3[52543]: 2024-09-21T03:06:08.755+0000 7f025212c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:09.055 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:08 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3[52543]: 2024-09-21T03:06:08.755+0000 7f025212c640 -1 osd.3 86 *** Got signal Terminated *** 2024-09-21T03:06:09.055 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:08 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3[52543]: 2024-09-21T03:06:08.755+0000 7f025212c640 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:11.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:10.798+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:12.248 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:11.774+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:13.248 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:12.771+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:14.142 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:13 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:13.809+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:14.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:13.818+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:14.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:14.006+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:14.457 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:14 smithi081 podman[92115]: 2024-09-21 03:06:14.141283752 +0000 UTC m=+5.692563703 container died 577853a4a5c0f26a77d14eacbe8596e33607537c2b15dd976b9991f35eb3267b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T03:06:14.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:14 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:14.264+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:14.799 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:14 smithi081 podman[92115]: 2024-09-21 03:06:14.664340952 +0000 UTC m=+6.215620904 container cleanup 577853a4a5c0f26a77d14eacbe8596e33607537c2b15dd976b9991f35eb3267b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T03:06:14.799 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:14 smithi081 bash[92115]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3 2024-09-21T03:06:15.055 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:14 smithi081 podman[92133]: 2024-09-21 03:06:14.941187356 +0000 UTC m=+0.793624541 container remove 577853a4a5c0f26a77d14eacbe8596e33607537c2b15dd976b9991f35eb3267b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T03:06:15.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:14 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:14.797+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:15.055 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:14 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:14.905+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:15.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:14.966+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:15.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:14.789+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:15.545 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:15 smithi081 podman[92229]: 2024-09-21 03:06:15.158782363 +0000 UTC m=+0.016429251 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:06:15.545 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:15 smithi081 podman[92229]: 2024-09-21 03:06:15.283702009 +0000 UTC m=+0.141348898 container create 1b2263cfdaead88eb1f5e3212bf5d339c1b993fa0da4131a73a9cdf3f5843810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T03:06:15.545 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:15 smithi081 podman[92229]: 2024-09-21 03:06:15.544583605 +0000 UTC m=+0.402230493 container init 1b2263cfdaead88eb1f5e3212bf5d339c1b993fa0da4131a73a9cdf3f5843810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:06:15.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:15 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:15.262+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:15.805 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:15 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:15.749+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:15.805 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:15 smithi081 podman[92229]: 2024-09-21 03:06:15.548097354 +0000 UTC m=+0.405744251 container start 1b2263cfdaead88eb1f5e3212bf5d339c1b993fa0da4131a73a9cdf3f5843810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T03:06:15.805 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:15 smithi081 podman[92229]: 2024-09-21 03:06:15.644774973 +0000 UTC m=+0.502421876 container attach 1b2263cfdaead88eb1f5e3212bf5d339c1b993fa0da4131a73a9cdf3f5843810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T03:06:15.805 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 21 03:06:15 smithi081 podman[92229]: 2024-09-21 03:06:15.738808468 +0000 UTC m=+0.596455355 container died 1b2263cfdaead88eb1f5e3212bf5d339c1b993fa0da4131a73a9cdf3f5843810 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:06:16.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:16 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:15.999+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:16.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:15.810+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:16.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:15 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:15.944+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:16.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T03:06:16.433 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:16.433 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T03:06:16.433 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T03:06:16.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.4 2024-09-21T03:06:16.681 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:16 smithi164 systemd[1]: Stopping Ceph osd.4 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:16.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:16 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:16.261+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:17.047 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:16 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:16.768+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:17.055 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:16 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:16.900+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:17.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:16 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:16.754+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:17.181 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:16 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T03:06:16.741+0000 7f5a34065640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:17.181 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:16 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T03:06:16.741+0000 7f5a34065640 -1 osd.4 86 *** Got signal Terminated *** 2024-09-21T03:06:17.181 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:16 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T03:06:16.741+0000 7f5a34065640 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:17.499 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:17 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:17.046+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:17.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:17 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:17.276+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:18.055 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:17 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:17.854+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:18.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:17 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:17.761+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:18.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:18 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:18.002+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:18.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:17 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:17.808+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:18.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:18 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:18.304+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:19.055 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:18 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:18.845+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:19.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:18 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:18.796+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:19.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:19 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:19.002+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:19.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:18 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:18.789+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:19.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:19 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:19.274+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:19.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:19 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:19.300+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:19.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:19 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:19.300+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:20.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:20 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:20.024+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:20.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:19 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:19.788+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:20.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:19 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:19.788+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:20.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:19 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:19.840+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:20.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:19 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:19.889+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:20.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:19 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:19.889+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:20.603 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:20 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:20.312+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:20.603 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:20 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:20.340+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:20.603 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:20 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:20.340+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:20.931 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:20 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T03:06:20.601+0000 7f5a30650640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:56.887818+0000 front 2024-09-21T03:05:56.887853+0000 (oldest deadline 2024-09-21T03:06:20.387999+0000) 2024-09-21T03:06:21.063 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:20 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:20.807+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:21.063 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:20 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:20.807+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:21.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:20 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:20.933+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:21.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:20 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:20.933+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:21.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:20 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:20.845+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:21.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:20 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:20.845+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:21.499 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:21 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:21.061+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:21.647 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:21 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:21.278+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:21.647 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:21 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:21.351+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:21.647 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:21 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:21.351+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:21.931 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:21 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4[44383]: 2024-09-21T03:06:21.645+0000 7f5a30650640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:56.887818+0000 front 2024-09-21T03:05:56.887853+0000 (oldest deadline 2024-09-21T03:06:20.387999+0000) 2024-09-21T03:06:21.999 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:21 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:21.517+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:21.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:21 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:21.764+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:21.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:21 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:21.764+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:22.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:21 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:21.948+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:22.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:21 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:21.948+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:22.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:21 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:21.839+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:22.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:21 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:21.839+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:22.431 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:22 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:22.323+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:22.431 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:22 smithi164 podman[65754]: 2024-09-21 03:06:22.153890857 +0000 UTC m=+5.520173413 container died 40fb26253c807a0ff35c4418336d559bd1e24c92c1679a1634acc5f24981d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:06:22.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:22 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:22.324+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:22.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:22 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:22.324+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:22.470 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:22 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:22.060+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:22.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:22 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:22.469+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:22.802 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:22 smithi164 podman[65754]: 2024-09-21 03:06:22.566894732 +0000 UTC m=+5.933177288 container cleanup 40fb26253c807a0ff35c4418336d559bd1e24c92c1679a1634acc5f24981d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T03:06:22.802 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:22 smithi164 bash[65754]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4 2024-09-21T03:06:23.181 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:22 smithi164 podman[65770]: 2024-09-21 03:06:22.801735676 +0000 UTC m=+0.649099284 container remove 40fb26253c807a0ff35c4418336d559bd1e24c92c1679a1634acc5f24981d953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:06:23.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:22 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:22.796+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:23.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:22 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:22.796+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:23.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:23 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:23.043+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:23.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:23 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:23.043+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.242307+0000 front 2024-09-21T03:05:57.242334+0000 (oldest deadline 2024-09-21T03:06:22.442514+0000) 2024-09-21T03:06:23.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:22 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:22.991+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:23.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:22 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:22.991+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:23.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:22 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:22.829+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:23.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:22 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:22.829+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:23.489 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:23 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:23.308+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:23.489 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:23 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:23.302+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:23.489 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:23 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:23.302+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:23.490 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:23 smithi164 podman[65855]: 2024-09-21 03:06:23.134422878 +0000 UTC m=+0.016463299 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:06:23.490 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:23 smithi164 podman[65855]: 2024-09-21 03:06:23.252787848 +0000 UTC m=+0.134828295 container create d49546fd43178251c328fd6088e0b7e12e34d39440984413b1c5c6c652074e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:06:23.490 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:23 smithi164 podman[65855]: 2024-09-21 03:06:23.488686166 +0000 UTC m=+0.370726587 container init d49546fd43178251c328fd6088e0b7e12e34d39440984413b1c5c6c652074e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T03:06:23.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:23 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:23.480+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:23.931 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:23 smithi164 podman[65855]: 2024-09-21 03:06:23.492205489 +0000 UTC m=+0.374245892 container start d49546fd43178251c328fd6088e0b7e12e34d39440984413b1c5c6c652074e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:06:23.932 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:23 smithi164 podman[65855]: 2024-09-21 03:06:23.580321483 +0000 UTC m=+0.462361886 container attach d49546fd43178251c328fd6088e0b7e12e34d39440984413b1c5c6c652074e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:06:23.932 INFO:journalctl@ceph.osd.4.smithi164.stdout:Sep 21 03:06:23 smithi164 podman[65855]: 2024-09-21 03:06:23.678934541 +0000 UTC m=+0.560974968 container died d49546fd43178251c328fd6088e0b7e12e34d39440984413b1c5c6c652074e5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:24.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:23 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:23.810+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:24.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:23 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:23.810+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:24.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:24.028+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:24.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:24.028+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.242307+0000 front 2024-09-21T03:05:57.242334+0000 (oldest deadline 2024-09-21T03:06:22.442514+0000) 2024-09-21T03:06:24.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:23.845+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:24.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:23.845+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:24.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:24 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:24.022+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:24.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:24 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:24.022+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:24.308 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T03:06:24.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:24.347 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T03:06:24.347 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T03:06:24.347 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.5 2024-09-21T03:06:24.559 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:24 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:24.351+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:24.559 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:24 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:24.343+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:24.559 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:24 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:24.343+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:24.749 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:24 smithi181 systemd[1]: Stopping Ceph osd.5 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:24.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:24.449+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:25.143 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:24 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:24.855+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:25.143 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:24 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:24.855+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:25.143 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:25 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:25.026+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:25.143 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:25 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:25.026+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:25.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:24.785+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:25.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:24.785+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:25.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:24.833+0000 7f589af48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:25.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:24.833+0000 7f589af48640 -1 osd.5 86 *** Got signal Terminated *** 2024-09-21T03:06:25.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:24 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:24.833+0000 7f589af48640 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:25.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:25 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:25.007+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:25.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:25 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:25.007+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.242307+0000 front 2024-09-21T03:05:57.242334+0000 (oldest deadline 2024-09-21T03:06:22.442514+0000) 2024-09-21T03:06:25.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:25 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:25.367+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:25.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:25 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:25.367+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:25.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:25 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:25.350+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:25.748 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:25 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:25.493+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:25.978 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:25 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:25.864+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:25.978 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:25 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:25.864+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:26.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:25 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:25.823+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:26.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:25 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:25.823+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:26.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:25 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:25.991+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:26.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:25 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:25.991+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.242307+0000 front 2024-09-21T03:05:57.242334+0000 (oldest deadline 2024-09-21T03:06:22.442514+0000) 2024-09-21T03:06:26.304 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:25 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:25.977+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:26.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:25 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:25.977+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:26.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:26.328+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:26.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:26.377+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:26.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:26 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:26.377+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:26.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:26.494+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:27.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:26.795+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:27.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:26.795+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:27.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:26.967+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:27.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:26.967+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.242307+0000 front 2024-09-21T03:05:57.242334+0000 (oldest deadline 2024-09-21T03:06:22.442514+0000) 2024-09-21T03:06:27.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:26 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:26.967+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:04.643672+0000 front 2024-09-21T03:06:04.643916+0000 (oldest deadline 2024-09-21T03:06:26.943773+0000) 2024-09-21T03:06:27.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:26 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:26.957+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:27.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:26 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:26.957+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:27.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:26 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:26.834+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:27.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:26 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:26.834+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:27.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:26 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:26.834+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:27.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:27 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:27.359+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:27.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:27 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:27.418+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:27.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:27 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:27.418+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:27.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:27 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:27.418+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:27.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:27 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:27.480+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:28.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:27 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:27.787+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:28.249 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:27 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:27.787+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:28.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:28 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:28.013+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:28.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:28 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:28.013+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.242307+0000 front 2024-09-21T03:05:57.242334+0000 (oldest deadline 2024-09-21T03:06:22.442514+0000) 2024-09-21T03:06:28.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:28 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:28.013+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:04.643672+0000 front 2024-09-21T03:06:04.643916+0000 (oldest deadline 2024-09-21T03:06:26.943773+0000) 2024-09-21T03:06:28.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:27 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:27.956+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:28.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:27 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:27.956+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:28.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:27 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:27.821+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:28.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:27 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:27.821+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:28.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:27 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:27.821+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:28.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:28 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:28.312+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:28.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:28 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:28.466+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:28.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:28 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:28.466+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:28.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:28 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:28.466+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:28.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:28 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:28.440+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:29.029 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:28 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:28.768+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:29.029 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:28 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:28.768+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:29.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:28.910+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:29.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:28.910+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:29.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:28.868+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:29.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:28.868+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:29.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:28.868+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:29.438 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:29 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:29.027+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:47.841063+0000 front 2024-09-21T03:05:47.841203+0000 (oldest deadline 2024-09-21T03:06:13.740975+0000) 2024-09-21T03:06:29.438 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:29 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:29.027+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.242307+0000 front 2024-09-21T03:05:57.242334+0000 (oldest deadline 2024-09-21T03:06:22.442514+0000) 2024-09-21T03:06:29.438 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:29 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5[45011]: 2024-09-21T03:06:29.027+0000 7f589352b640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:04.643672+0000 front 2024-09-21T03:06:04.643916+0000 (oldest deadline 2024-09-21T03:06:26.943773+0000) 2024-09-21T03:06:29.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:29 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:29.297+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:29.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:29 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:29.297+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:29.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:29 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:29.479+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:29.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:29 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:29.479+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:29.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:29 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:29.479+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:29.748 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:29 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:29.437+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:30.215 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:29 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:29.799+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:30.215 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:29 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:29.799+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:30.215 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:29 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:29.799+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:30.304 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:29 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:29.914+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:30.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:29 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:29.914+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:30.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:29 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:29.830+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:30.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:29 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:29.830+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:30.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:29 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:29.830+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:30.494 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:30 smithi181 podman[66207]: 2024-09-21 03:06:30.213668225 +0000 UTC m=+5.673766692 container died f34a0daf3a9f4ecfc8997dc22b4961d70864b4f33560a76ff2ca6dba1e3bfca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T03:06:30.494 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:30 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:30.403+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:30.494 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:30 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:30.403+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:30.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:30 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:30.269+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:30.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:30 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:30.269+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:30.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:30 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:30.506+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:30.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:30 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:30.506+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:30.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:30 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:30.506+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:30.749 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:30 smithi181 podman[66207]: 2024-09-21 03:06:30.604816198 +0000 UTC m=+6.064914667 container cleanup f34a0daf3a9f4ecfc8997dc22b4961d70864b4f33560a76ff2ca6dba1e3bfca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:06:30.749 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:30 smithi181 bash[66207]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5 2024-09-21T03:06:31.137 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:30 smithi181 podman[66222]: 2024-09-21 03:06:30.826952475 +0000 UTC m=+0.614576023 container remove f34a0daf3a9f4ecfc8997dc22b4961d70864b4f33560a76ff2ca6dba1e3bfca3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:06:31.137 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:30 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:30.765+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:31.137 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:30 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:30.765+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:31.137 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:30 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:30.765+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:31.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:30 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:30.877+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:31.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:30 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:30.877+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:31.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:30 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:30.877+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:31.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:30 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:30.924+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:31.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:30 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:30.924+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:31.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:30 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:30.924+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.410106+0000 front 2024-09-21T03:06:03.409821+0000 (oldest deadline 2024-09-21T03:06:30.410263+0000) 2024-09-21T03:06:31.439 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:31 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:31.360+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:31.439 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:31 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:31.360+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:31.439 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:31 smithi181 podman[66313]: 2024-09-21 03:06:31.136156604 +0000 UTC m=+0.095219547 container create 6d84c0dc1ae8fa01c29fa5bd6940633ace8369ba0df9f792c66192695de886d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:06:31.439 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:31 smithi181 podman[66313]: 2024-09-21 03:06:31.056771438 +0000 UTC m=+0.015834382 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:06:31.439 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:31 smithi181 podman[66313]: 2024-09-21 03:06:31.363628889 +0000 UTC m=+0.322691835 container init 6d84c0dc1ae8fa01c29fa5bd6940633ace8369ba0df9f792c66192695de886d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:31.439 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:31 smithi181 podman[66313]: 2024-09-21 03:06:31.366884778 +0000 UTC m=+0.325947719 container start 6d84c0dc1ae8fa01c29fa5bd6940633ace8369ba0df9f792c66192695de886d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-21T03:06:31.440 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:31 smithi181 podman[66313]: 2024-09-21 03:06:31.438587116 +0000 UTC m=+0.397650059 container attach 6d84c0dc1ae8fa01c29fa5bd6940633ace8369ba0df9f792c66192695de886d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T03:06:31.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:31 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:31.319+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:31.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:31 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:31.319+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:31.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:31 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:31.467+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:31.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:31 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:31.467+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:31.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:31 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:31.467+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:31.744 INFO:journalctl@ceph.osd.5.smithi181.stdout:Sep 21 03:06:31 smithi181 podman[66313]: 2024-09-21 03:06:31.557012228 +0000 UTC m=+0.516075170 container died 6d84c0dc1ae8fa01c29fa5bd6940633ace8369ba0df9f792c66192695de886d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T03:06:31.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:31 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:31.743+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:31.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:31 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:31.743+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:31.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:31 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:31.743+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:32.131 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T03:06:32.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:32.171 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T03:06:32.171 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T03:06:32.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.6 2024-09-21T03:06:32.198 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:31 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:31.882+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:32.198 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:31 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:31.882+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:32.199 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:31 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:31.882+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.410106+0000 front 2024-09-21T03:06:03.409821+0000 (oldest deadline 2024-09-21T03:06:30.410263+0000) 2024-09-21T03:06:32.199 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:31 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:31.865+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:32.199 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:31 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:31.865+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:32.199 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:31 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:31.865+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:32.495 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:32 smithi081 systemd[1]: Stopping Ceph osd.6 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:32.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:32 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:32.323+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:32.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:32 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:32.323+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:32.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:32 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:32.431+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:32.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:32 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:32.431+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:32.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:32 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:32.431+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:32.707 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:32 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:32.360+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:32.707 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:32 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:32.360+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:32.805 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:32.493+0000 7f0cb27b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:32.805 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:32.493+0000 7f0cb27b6640 -1 osd.6 86 *** Got signal Terminated *** 2024-09-21T03:06:32.805 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:32.493+0000 7f0cb27b6640 -1 osd.6 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:32.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:32 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:32.705+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:32.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:32 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:32.705+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:32.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:32 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:32.705+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:33.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:32.875+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:33.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:32.875+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:33.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:32.875+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.410106+0000 front 2024-09-21T03:06:03.409821+0000 (oldest deadline 2024-09-21T03:06:30.410263+0000) 2024-09-21T03:06:33.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:32.860+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:33.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:32.860+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:33.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:32.860+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:33.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:33 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:33.346+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:33.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:33 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:33.346+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:33.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:33 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:33.446+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:33.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:33 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:33.446+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:33.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:33 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:33.446+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:33.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:33 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:33.402+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:33.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:33 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:33.402+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:33.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:33 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:33.704+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:33.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:33 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:33.704+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:33.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:33 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:33.704+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:34.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:33 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:33.869+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:34.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:33 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:33.869+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:34.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:33 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:33.869+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:34.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:33 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:33.910+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:34.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:33 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:33.910+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:34.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:33 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:33.910+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.410106+0000 front 2024-09-21T03:06:03.409821+0000 (oldest deadline 2024-09-21T03:06:30.410263+0000) 2024-09-21T03:06:34.656 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:34 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:34.369+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:34.656 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:34 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:34.369+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:34.656 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:34 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:34.369+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:34.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:34 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:34.360+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:34.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:34 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:34.360+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:34.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:34 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:34.360+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:34.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:34 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:34.474+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:34.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:34 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:34.474+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:34.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:34 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:34.474+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:34.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:34 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:34.655+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:34.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:34 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:34.655+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:34.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:34 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:34.655+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:35.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:34 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:34.942+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:35.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:34 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:34.942+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:35.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:34 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:34.942+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.410106+0000 front 2024-09-21T03:06:03.409821+0000 (oldest deadline 2024-09-21T03:06:30.410263+0000) 2024-09-21T03:06:35.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:34 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:34.908+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:35.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:34 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:34.908+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:35.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:34 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:34.908+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:35.638 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:35 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:35.381+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:35.638 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:35 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:35.381+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:35.638 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:35 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:35.381+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:35.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:35 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:35.459+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:35.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:35 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:35.459+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:35.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:35 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:35.459+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:35.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:35 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:35.356+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:35.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:35 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:35.356+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:35.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:35 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:35.356+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:35.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:35 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:35.637+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:35.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:35 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:35.637+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:35.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:35 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:35.637+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:36.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:35 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:35.872+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:36.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:35 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:35.872+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:36.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:35 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:35.872+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:36.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:35 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:35.951+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:36.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:35 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:35.951+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:36.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:35 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:35.951+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.410106+0000 front 2024-09-21T03:06:03.409821+0000 (oldest deadline 2024-09-21T03:06:30.410263+0000) 2024-09-21T03:06:36.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:35 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:35.951+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:10.410730+0000 front 2024-09-21T03:06:10.410814+0000 (oldest deadline 2024-09-21T03:06:35.110760+0000) 2024-09-21T03:06:36.678 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:36 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:36.357+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:36.678 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:36 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:36.357+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:36.678 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:36 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:36.357+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:36.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:36.359+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:36.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:36.359+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:36.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:36.359+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:36.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:36.476+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:36.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:36.476+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:36.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:36.476+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:36.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:36 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:36.476+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:36.998 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:36 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:36.676+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:36.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:36 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:36.676+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:36.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:36 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:36.676+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:37.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:36.943+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.906915+0000 front 2024-09-21T03:05:48.906975+0000 (oldest deadline 2024-09-21T03:06:14.207051+0000) 2024-09-21T03:06:37.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:36.943+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.708102+0000 front 2024-09-21T03:05:54.708063+0000 (oldest deadline 2024-09-21T03:06:19.408056+0000) 2024-09-21T03:06:37.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:36.943+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.410106+0000 front 2024-09-21T03:06:03.409821+0000 (oldest deadline 2024-09-21T03:06:30.410263+0000) 2024-09-21T03:06:37.305 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6[58692]: 2024-09-21T03:06:36.943+0000 7f0caeda1640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:10.410730+0000 front 2024-09-21T03:06:10.410814+0000 (oldest deadline 2024-09-21T03:06:35.110760+0000) 2024-09-21T03:06:37.306 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:36.898+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:37.306 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:36.898+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:37.306 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:36.898+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:37.306 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:36 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:36.898+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:37.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:37.402+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:37.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:37.402+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:37.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:37.402+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:37.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:37.438+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:37.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:37.438+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:37.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:37.438+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:37.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:37.438+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:37.708 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:37 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:37.357+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:37.708 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:37 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:37.357+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:37.708 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:37 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:37.357+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:37.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:37 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:37.707+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:37.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:37 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:37.707+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:37.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:37 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:37.707+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:38.247 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:37 smithi081 podman[92334]: 2024-09-21 03:06:37.902958116 +0000 UTC m=+5.525724019 container stop 821aa6a8992a44c48b33d8cbbe0d0039dd1e51b1ee1187533bb64af9efaff19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T03:06:38.247 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:37 smithi081 podman[92334]: 2024-09-21 03:06:37.928893222 +0000 UTC m=+5.551659223 container died 821aa6a8992a44c48b33d8cbbe0d0039dd1e51b1ee1187533bb64af9efaff19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:06:38.247 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:37 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:37.903+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:38.247 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:37 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:37.903+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:38.247 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:37 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:37.903+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:38.247 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:37 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:37.903+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:38.555 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:38 smithi081 podman[92334]: 2024-09-21 03:06:38.427221348 +0000 UTC m=+6.049987292 container cleanup 821aa6a8992a44c48b33d8cbbe0d0039dd1e51b1ee1187533bb64af9efaff19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T03:06:38.555 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:38 smithi081 bash[92334]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6 2024-09-21T03:06:38.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:38 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:38.406+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:38.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:38 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:38.406+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:38.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:38 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:38.406+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:38.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:38 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:38.390+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:38.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:38 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:38.390+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:38.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:38 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:38.390+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:38.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:38 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:38.390+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:38.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:38.340+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:38.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:38.340+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:38.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:38.340+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:38.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:38.704+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:38.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:38.704+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:38.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:38 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:38.704+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:39.055 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:38 smithi081 podman[92350]: 2024-09-21 03:06:38.670299812 +0000 UTC m=+0.760238028 container remove 821aa6a8992a44c48b33d8cbbe0d0039dd1e51b1ee1187533bb64af9efaff19b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:39.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:38 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:38.885+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:39.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:38 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:38.885+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:39.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:38 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:38.885+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:39.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:38 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:38.885+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:39.391 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:39 smithi081 podman[92439]: 2024-09-21 03:06:39.07502881 +0000 UTC m=+0.102803225 container create 1c80abdbb580f653934448d698549b7f0fff01666f7c627c7834a8f3d70ebce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T03:06:39.391 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:39 smithi081 podman[92439]: 2024-09-21 03:06:38.988397096 +0000 UTC m=+0.016171458 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:06:39.391 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:39 smithi081 podman[92439]: 2024-09-21 03:06:39.306958959 +0000 UTC m=+0.334733324 container init 1c80abdbb580f653934448d698549b7f0fff01666f7c627c7834a8f3d70ebce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T03:06:39.391 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:39 smithi081 podman[92439]: 2024-09-21 03:06:39.310385531 +0000 UTC m=+0.338159886 container start 1c80abdbb580f653934448d698549b7f0fff01666f7c627c7834a8f3d70ebce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T03:06:39.391 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:39 smithi081 podman[92439]: 2024-09-21 03:06:39.390284061 +0000 UTC m=+0.418058413 container attach 1c80abdbb580f653934448d698549b7f0fff01666f7c627c7834a8f3d70ebce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:39.676 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:39 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:39.351+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:39.676 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:39 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:39.351+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:39.676 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:39 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:39.351+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:39.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:39 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:39.377+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:39.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:39 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:39.377+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:39.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:39 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:39.377+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:39.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:39 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:39.359+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:39.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:39 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:39.359+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:39.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:39 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:39.359+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:39.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:39 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:39.359+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:39.785 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 21 03:06:39 smithi081 podman[92439]: 2024-09-21 03:06:39.502056702 +0000 UTC m=+0.529831067 container died 1c80abdbb580f653934448d698549b7f0fff01666f7c627c7834a8f3d70ebce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:06:39.977 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:39 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:39.674+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:39.977 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:39 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:39.674+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:39.977 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:39 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:39.674+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:40.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:39 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:39.930+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:40.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:39 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:39.930+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:40.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:39 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:39.930+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:40.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:39 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:39.930+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:40.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T03:06:40.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:40.160 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T03:06:40.160 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T03:06:40.160 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.7 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:40.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:40.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:40.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:40.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:40 smithi164 systemd[1]: Stopping Ceph osd.7 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:40.338+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:40.338+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:40.338+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:40.488 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:40.486+0000 7f1e41b02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:40.489 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:40.486+0000 7f1e41b02640 -1 osd.7 86 *** Got signal Terminated *** 2024-09-21T03:06:40.489 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:40.486+0000 7f1e41b02640 -1 osd.7 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:40.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:40 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:40.303+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:40.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:40 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:40.303+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:40.705 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:40 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:40.303+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:40.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:40 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:40.703+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:40.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:40 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:40.703+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:40.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:40 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:40.703+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:41.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:40 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:40.979+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:41.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:40 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:40.979+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:41.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:40 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:40.979+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:41.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:40 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:40.979+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:41.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:41 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:41.363+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:41.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:41 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:41.363+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:41.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:41 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:41.363+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:41.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:41 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:41.363+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:41.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:41 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:41.324+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:41.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:41 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:41.324+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:41.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:41 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:41.324+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:41.706 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:41 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:41.301+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:41.706 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:41 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:41.301+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:41.706 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:41 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:41.301+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:41.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:41 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:41.705+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:41.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:41 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:41.705+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:41.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:41 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:41.705+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:42.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:41 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:41.987+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:42.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:41 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:41.987+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:42.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:41 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:41.987+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:42.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:41 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:41.987+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:42.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:42 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:42.332+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:42.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:42 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:42.332+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:42.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:42 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:42.332+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:42.677 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:42 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:42.332+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:42.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:42.347+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:42.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:42.347+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:42.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:42.347+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:42.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:42.361+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:42.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:42.361+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:42.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:42.361+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:42.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:42 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:42.361+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:42.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:42 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:42.676+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:42.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:42 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:42.676+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:42.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:42 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:42.676+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:43.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:43 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:43.030+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:43.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:43 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:43.030+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:43.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:43 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:43.030+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:43.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:43 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:43.030+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:43.662 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:43 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:43.368+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:43.662 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:43 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:43.368+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:43.662 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:43 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:43.368+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:43.662 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:43 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:43.368+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:43.681 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:43.302+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:43.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:43.302+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:43.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:43.302+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:43.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:43.356+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:43.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:43.356+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:43.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:43.356+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:43.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:43.356+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:43.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:43.356+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:43.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:43 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:43.661+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:43.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:43 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:43.661+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:43.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:43 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:43.661+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:44.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:44.047+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:44.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:44.047+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:44.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:44.047+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:44.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:44.047+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:44.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:44 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:44.047+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:44.630 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:44 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:44.353+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:44.630 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:44 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:44.353+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:44.630 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:44 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:44.353+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:44.630 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:44 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:44.353+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:44.342+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:44.342+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:44.342+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:44.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:44.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:44.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:44.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:44.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:44 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:44.394+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:44.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:44 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:44.629+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:44.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:44 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:44.629+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:44.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:44 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:44.629+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:45.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:45 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:45.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:45.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:45 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:45.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:45.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:45 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:45.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:45.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:45 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:45.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:45.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:45 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:45.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:45.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:45.304+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.314546+0000 front 2024-09-21T03:05:54.314493+0000 (oldest deadline 2024-09-21T03:06:18.414735+0000) 2024-09-21T03:06:45.743 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:45.304+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:03.116116+0000 front 2024-09-21T03:06:03.116262+0000 (oldest deadline 2024-09-21T03:06:28.916824+0000) 2024-09-21T03:06:45.743 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7[50940]: 2024-09-21T03:06:45.304+0000 7f1e3a0e5640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:08.917506+0000 front 2024-09-21T03:06:08.917565+0000 (oldest deadline 2024-09-21T03:06:34.217432+0000) 2024-09-21T03:06:45.744 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:45.371+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:45.744 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:45.371+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:45.744 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:45.371+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:45.744 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:45.371+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:45.744 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:45 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:45.371+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:45.581+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:45.581+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:45.581+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:45.581+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:45.380+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:45.380+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:45.380+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:45.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:45 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:45.380+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:46.163 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:45 smithi164 podman[65968]: 2024-09-21 03:06:45.875076169 +0000 UTC m=+5.514296157 container died 941afe368919d4b1958fae3b9b9836dd4f282be4d2fb3d4e25b88e22209438a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:06:46.431 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:46 smithi164 podman[65968]: 2024-09-21 03:06:46.244421545 +0000 UTC m=+5.883641545 container cleanup 941afe368919d4b1958fae3b9b9836dd4f282be4d2fb3d4e25b88e22209438a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T03:06:46.431 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:46 smithi164 bash[65968]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7 2024-09-21T03:06:46.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:46 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:46.404+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:46.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:46 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:46.404+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:46.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:46 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:46.404+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:46.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:46 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:46.404+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:46.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:46 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:46.404+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:46.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:46 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:46.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:46.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:46 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:46.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:46.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:46 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:46.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:46.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:46 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:46.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:46.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:46 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:46.090+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:46.358+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:46.358+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:46.358+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:46.358+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:46.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:46.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:46.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:46.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:46 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:46.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:46.909 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:46 smithi164 podman[65982]: 2024-09-21 03:06:46.554516764 +0000 UTC m=+0.674191085 container remove 941afe368919d4b1958fae3b9b9836dd4f282be4d2fb3d4e25b88e22209438a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T03:06:47.181 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:46 smithi164 podman[66074]: 2024-09-21 03:06:46.810977028 +0000 UTC m=+0.015864494 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:06:47.181 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:46 smithi164 podman[66074]: 2024-09-21 03:06:46.930348256 +0000 UTC m=+0.135235711 container create 8760e09e0e0eb5a0959edc9c524c53b9d55408fe81fcc7dac67d2a267d1aa442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T03:06:47.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:47 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:47.118+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:47.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:47 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:47.118+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:47.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:47 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:47.118+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:47.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:47 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:47.118+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:47.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:47 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:47.118+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:47 smithi164 podman[66074]: 2024-09-21 03:06:47.207775451 +0000 UTC m=+0.412662907 container init 8760e09e0e0eb5a0959edc9c524c53b9d55408fe81fcc7dac67d2a267d1aa442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:47 smithi164 podman[66074]: 2024-09-21 03:06:47.211139569 +0000 UTC m=+0.416027031 container start 8760e09e0e0eb5a0959edc9c524c53b9d55408fe81fcc7dac67d2a267d1aa442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:47 smithi164 podman[66074]: 2024-09-21 03:06:47.282804775 +0000 UTC m=+0.487692242 container attach 8760e09e0e0eb5a0959edc9c524c53b9d55408fe81fcc7dac67d2a267d1aa442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.7.smithi164.stdout:Sep 21 03:06:47 smithi164 podman[66074]: 2024-09-21 03:06:47.397956954 +0000 UTC m=+0.602844410 container died 8760e09e0e0eb5a0959edc9c524c53b9d55408fe81fcc7dac67d2a267d1aa442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:47 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:47.398+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:47 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:47.398+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:47 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:47.399+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:47 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:47.399+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:47.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:47 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:47.399+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:47.361+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:47.361+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:47.361+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:47.361+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:47.550+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:47.550+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:47.550+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:47.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:47 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:47.550+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:48.019 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T03:06:48.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:48.059 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T03:06:48.059 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T03:06:48.059 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.8 2024-09-21T03:06:48.387 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 systemd[1]: Stopping Ceph osd.8 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:48.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:48.119+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:48.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:48.119+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:48.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:48.119+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:48.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:48.119+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:48.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:48 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:48.119+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:48.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:48 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:48.414+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:48.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:48 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:48.414+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:48.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:48 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:48.414+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:48.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:48 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:48.414+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:48.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:48 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:48.414+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:48.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:48.585+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:48.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:48.585+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:48.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:48.585+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:48.585+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:48.385+0000 7f653e37a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:48.385+0000 7f653e37a640 -1 osd.8 86 *** Got signal Terminated *** 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:48.385+0000 7f653e37a640 -1 osd.8 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:48.405+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:48.405+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:48.405+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:48.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:48 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:48.405+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:49.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:49 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:49.131+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:49.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:49 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:49.131+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:49.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:49 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:49.131+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:49.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:49 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:49.131+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:49.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:49 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:49.131+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:49.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:49 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:49.451+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:49.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:49 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:49.451+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:49.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:49 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:49.451+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:49.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:49 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:49.451+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:49.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:49 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:49.451+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:49.449+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:49.449+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:49.449+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:49.449+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:49.591+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:49.591+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:49.591+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:49.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:49 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:49.591+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:50.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:50 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:50.099+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:50.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:50 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:50.099+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:50.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:50 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:50.099+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:50.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:50 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:50.099+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:50.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:50 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:50.099+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:50.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:50.568+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:50.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:50.568+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:50.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:50.568+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:50.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:50.568+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:50.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:50.453+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:50.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:50.453+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:50.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:50.453+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:50.750 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:50 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:50.453+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:50.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:50 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:50.439+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:50.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:50 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:50.439+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:50.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:50 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:50.439+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:50.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:50 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:50.439+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:50.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:50 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:50.439+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:51.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:51 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:51.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:51.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:51 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:51.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:51.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:51 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:51.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:51.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:51 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:51.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:51.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:51 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:51.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:51.931 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:51 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:51.475+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:51.931 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:51 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:51.475+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:51.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:51 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:51.475+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:51.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:51 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:51.475+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:51.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:51 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:51.475+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:51.501+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:51.501+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:51.501+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:51.501+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:51.599+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:51.599+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:51.599+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:51.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:51 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:51.599+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:52.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:52 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:52.114+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:52.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:52 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:52.114+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:52.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:52 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:52.114+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:52.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:52 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:52.114+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:52.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:52 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:52.114+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:52.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:52.466+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.303655+0000 front 2024-09-21T03:05:57.303858+0000 (oldest deadline 2024-09-21T03:06:20.803594+0000) 2024-09-21T03:06:52.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:52.466+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.504609+0000 front 2024-09-21T03:06:05.504639+0000 (oldest deadline 2024-09-21T03:06:29.604786+0000) 2024-09-21T03:06:52.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:52.466+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:09.605388+0000 front 2024-09-21T03:06:09.605404+0000 (oldest deadline 2024-09-21T03:06:34.305476+0000) 2024-09-21T03:06:52.749 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8[51589]: 2024-09-21T03:06:52.466+0000 7f653a965640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.708409+0000 front 2024-09-21T03:06:21.708327+0000 (oldest deadline 2024-09-21T03:06:42.208229+0000) 2024-09-21T03:06:52.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:52.639+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:52.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:52.639+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:52.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:52.639+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:52.750 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:52.639+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:52.750 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:52 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:52.639+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:06:52.833 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:52.500+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:52.833 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:52.500+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:52.833 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:52.500+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:52.833 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:52.500+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:52.833 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:52 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:52.500+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:53.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:53 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:53.121+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:53.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:53 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:53.121+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:53.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:53 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:53.121+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:53.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:53 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:53.121+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:53.556 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:53 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:53.121+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:53.556 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:53 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:53.121+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:06:53.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:53 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:53.498+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:53.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:53 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:53.498+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:53.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:53 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:53.498+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:53.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:53 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:53.498+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:53.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:53 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:53.498+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:53.999 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:53 smithi181 podman[66426]: 2024-09-21 03:06:53.801475243 +0000 UTC m=+5.533519557 container died ae9c5e4f0577e0255f70d372a40039a454acecca5031d755996ccc7ea098c057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T03:06:53.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:53 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:53.596+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:53.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:53 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:53.596+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:53.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:53 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:53.596+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:53.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:53 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:53.596+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:53.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:53 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:53.596+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:06:54.346 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:54 smithi181 podman[66426]: 2024-09-21 03:06:54.11165072 +0000 UTC m=+5.843695033 container cleanup ae9c5e4f0577e0255f70d372a40039a454acecca5031d755996ccc7ea098c057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T03:06:54.347 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:54 smithi181 bash[66426]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8 2024-09-21T03:06:54.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:54 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:54.081+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:54.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:54 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:54.081+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:54.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:54 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:54.081+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:54.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:54 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:54.081+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:54.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:54 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:54.081+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:54.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:54 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:54.081+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:06:54.644 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:54 smithi181 podman[66441]: 2024-09-21 03:06:54.346125277 +0000 UTC m=+0.540903276 container remove ae9c5e4f0577e0255f70d372a40039a454acecca5031d755996ccc7ea098c057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:06:54.901 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:54 smithi181 podman[66529]: 2024-09-21 03:06:54.664089607 +0000 UTC m=+0.105472324 container create 1df42899515ea4fb957cce3d5c6f951086cf628c6daf38001f55753c4859bd38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T03:06:54.901 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:54 smithi181 podman[66529]: 2024-09-21 03:06:54.574508651 +0000 UTC m=+0.015891322 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:06:54.901 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:54 smithi181 podman[66529]: 2024-09-21 03:06:54.90036182 +0000 UTC m=+0.341744512 container init 1df42899515ea4fb957cce3d5c6f951086cf628c6daf38001f55753c4859bd38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-21T03:06:54.901 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:54 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:54.643+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:54.902 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:54 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:54.643+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:54.902 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:54 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:54.643+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:54.902 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:54 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:54.643+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:54.902 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:54 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:54.643+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:06:54.931 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:54 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:54.470+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:54.931 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:54 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:54.470+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:54.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:54 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:54.470+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:54.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:54 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:54.470+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:54.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:54 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:54.470+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:54.932 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:54 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:54.470+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:06:55.249 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:54 smithi181 podman[66529]: 2024-09-21 03:06:54.903942673 +0000 UTC m=+0.345325345 container start 1df42899515ea4fb957cce3d5c6f951086cf628c6daf38001f55753c4859bd38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T03:06:55.249 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:55 smithi181 podman[66529]: 2024-09-21 03:06:54.999984731 +0000 UTC m=+0.441367408 container attach 1df42899515ea4fb957cce3d5c6f951086cf628c6daf38001f55753c4859bd38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:06:55.249 INFO:journalctl@ceph.osd.8.smithi181.stdout:Sep 21 03:06:55 smithi181 podman[66529]: 2024-09-21 03:06:55.102670844 +0000 UTC m=+0.544053520 container died 1df42899515ea4fb957cce3d5c6f951086cf628c6daf38001f55753c4859bd38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:06:55.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:55.052+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:55.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:55.052+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:55.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:55.052+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:55.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:55.052+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:55.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:55.052+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:55.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:55 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:55.052+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:06:55.673 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:55 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:55.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:55.674 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:55 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:55.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:55.674 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:55 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:55.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:55.674 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:55 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:55.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:55.674 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:55 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:55.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:06:55.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:55 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:55.429+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:55.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:55 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:55.429+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:55.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:55 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:55.429+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:55.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:55 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:55.429+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:55.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:55 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:55.429+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:55.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:55 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:55.429+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:06:55.689 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T03:06:55.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:06:55.727 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T03:06:55.727 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T03:06:55.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.9 2024-09-21T03:06:56.048 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:55 smithi081 systemd[1]: Stopping Ceph osd.9 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:06:56.048 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.046+0000 7f8a876b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.046+0000 7f8a876b7640 -1 osd.9 86 *** Got signal Terminated *** 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.046+0000 7f8a876b7640 -1 osd.9 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:56.305 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:56 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:56.078+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:06:56.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:56 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:56.379+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:56.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:56 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:56.379+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:56.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:56 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:56.379+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:56.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:56 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:56.379+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:56.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:56 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:56.379+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:56.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:56 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:56.380+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:06:56.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:56.613+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:56.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:56.613+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:56.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:56.613+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:56.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:56.613+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:56.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:56.613+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:06:57.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:57.125+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:57.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:57.125+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:57.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:57.125+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:57.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:57.125+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:57.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:57.125+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:57.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:57 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:57.125+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:06:57.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:57 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:57.355+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:57.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:57 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:57.355+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:57.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:57 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:57.355+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:57.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:57 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:57.355+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:57.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:57 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:57.355+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:57.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:57 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:57.355+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:06:57.998 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:57 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:57.630+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:57.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:57 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:57.630+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:57.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:57 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:57.630+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:57.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:57 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:57.630+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:57.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:57 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:57.630+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:06:58.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:58 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:58.166+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:58.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:58 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:58.166+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:58.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:58 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:58.166+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:58.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:58 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:58.166+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:58.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:58 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:58.166+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:58.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:58 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:58.166+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:06:58.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:58 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:58.378+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:58.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:58 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:58.378+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:58.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:58 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:58.378+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:58.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:58 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:58.378+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:58.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:58 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:58.378+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:58.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:58 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:58.378+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:06:58.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:58 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:58.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:58.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:58 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:58.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:58.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:58 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:58.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:58.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:58 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:58.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:58.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:58 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:58.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:06:59.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:59.200+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:06:59.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:59.200+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:06:59.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:59.200+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:06:59.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:59.200+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:06:59.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:59.200+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:06:59.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:06:59 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:06:59.200+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:06:59.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:59.331+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:06:59.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:59.331+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:06:59.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:59.331+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:06:59.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:59.331+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:06:59.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:59.331+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:06:59.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:59.331+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:06:59.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:06:59 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:06:59.331+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:06:59.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:59 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:59.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:06:59.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:59 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:59.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:06:59.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:59 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:59.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:06:59.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:59 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:59.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:06:59.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:06:59 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:06:59.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:00.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:00 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:07:00.216+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.599473+0000 front 2024-09-21T03:05:48.599416+0000 (oldest deadline 2024-09-21T03:06:13.299623+0000) 2024-09-21T03:07:00.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:00 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:07:00.216+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:54.400834+0000 front 2024-09-21T03:05:54.401027+0000 (oldest deadline 2024-09-21T03:06:20.300863+0000) 2024-09-21T03:07:00.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:00 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:07:00.216+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:00.301439+0000 front 2024-09-21T03:06:00.301349+0000 (oldest deadline 2024-09-21T03:06:26.201398+0000) 2024-09-21T03:07:00.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:00 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:07:00.216+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.502436+0000 front 2024-09-21T03:06:11.502463+0000 (oldest deadline 2024-09-21T03:06:36.202669+0000) 2024-09-21T03:07:00.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:00 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:07:00.216+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:21.304862+0000 front 2024-09-21T03:06:21.304991+0000 (oldest deadline 2024-09-21T03:06:43.505119+0000) 2024-09-21T03:07:00.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:00 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9[65040]: 2024-09-21T03:07:00.216+0000 7f8a7fc9a640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:26.807211+0000 front 2024-09-21T03:06:26.807126+0000 (oldest deadline 2024-09-21T03:06:52.707052+0000) 2024-09-21T03:07:00.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:00 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:00.314+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:00.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:00 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:00.314+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:00.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:00 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:00.314+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:00.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:00 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:00.314+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:00.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:00 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:00.314+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:00.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:00 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:00.314+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:00.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:00 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:00.314+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:00.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:00.640+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:00.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:00.640+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:00.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:00.640+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:00.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:00.640+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:00.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:00 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:00.640+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:01.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:01 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:01.316+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:01.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:01 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:01.316+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:01.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:01 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:01.316+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:01.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:01 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:01.316+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:01.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:01 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:01.316+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:01.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:01 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:01.316+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:01.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:01 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:01.316+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:01.740 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:01 smithi081 podman[92542]: 2024-09-21 03:07:01.471758011 +0000 UTC m=+5.547841701 container died 0069110a26c94a88c44be284835de85467a81e8e2877549202ef129a2ab288a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:07:01.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:01 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:01.614+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:01.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:01 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:01.614+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:01.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:01 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:01.614+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:01.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:01 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:01.614+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:01.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:01 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:01.614+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:01.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:01 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:01.614+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:02.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:01 smithi081 podman[92542]: 2024-09-21 03:07:01.913129342 +0000 UTC m=+5.989213077 container cleanup 0069110a26c94a88c44be284835de85467a81e8e2877549202ef129a2ab288a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:07:02.055 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:01 smithi081 bash[92542]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9 2024-09-21T03:07:02.555 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:02 smithi081 podman[92556]: 2024-09-21 03:07:02.15612492 +0000 UTC m=+0.681120616 container remove 0069110a26c94a88c44be284835de85467a81e8e2877549202ef129a2ab288a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T03:07:02.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:02 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:02.272+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:02.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:02 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:02.272+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:02.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:02 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:02.272+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:02.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:02 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:02.272+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:02.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:02 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:02.272+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:02.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:02 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:02.272+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:02.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:02 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:02.272+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:02.868 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:02 smithi081 podman[92643]: 2024-09-21 03:07:02.474027011 +0000 UTC m=+0.015832993 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:07:02.868 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:02 smithi081 podman[92643]: 2024-09-21 03:07:02.573773109 +0000 UTC m=+0.115579071 container create b208b9ff2db505ba5cd8d133a27681859768cc3a4e5d4c845c6843616177ba41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:07:02.868 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:02 smithi081 podman[92643]: 2024-09-21 03:07:02.800905534 +0000 UTC m=+0.342711508 container init b208b9ff2db505ba5cd8d133a27681859768cc3a4e5d4c845c6843616177ba41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T03:07:02.868 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:02 smithi081 podman[92643]: 2024-09-21 03:07:02.804446672 +0000 UTC m=+0.346252636 container start b208b9ff2db505ba5cd8d133a27681859768cc3a4e5d4c845c6843616177ba41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T03:07:02.869 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:02 smithi081 podman[92643]: 2024-09-21 03:07:02.867640768 +0000 UTC m=+0.409446750 container attach b208b9ff2db505ba5cd8d133a27681859768cc3a4e5d4c845c6843616177ba41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:07:02.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:02 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:02.587+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:02.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:02 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:02.587+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:02.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:02 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:02.587+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:02.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:02 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:02.587+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:02.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:02 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:02.587+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:02.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:02 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:02.587+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:03.262 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:02 smithi081 podman[92643]: 2024-09-21 03:07:02.986633904 +0000 UTC m=+0.528439877 container died b208b9ff2db505ba5cd8d133a27681859768cc3a4e5d4c845c6843616177ba41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:03.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T03:07:03.535 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:03 smithi081 podman[92666]: 2024-09-21 03:07:03.487390716 +0000 UTC m=+0.490797539 container remove b208b9ff2db505ba5cd8d133a27681859768cc3a4e5d4c845c6843616177ba41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:03.535 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:03 smithi081 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.9.service: Deactivated successfully. 2024-09-21T03:07:03.536 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:03 smithi081 systemd[1]: Stopped Ceph osd.9 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T03:07:03.536 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 21 03:07:03 smithi081 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.9.service: Consumed 38.553s CPU time. 2024-09-21T03:07:03.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:03.550 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T03:07:03.550 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T03:07:03.550 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.10 2024-09-21T03:07:03.578 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.246+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:03.578 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.246+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:03.578 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.246+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:03.578 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.246+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:03.578 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.246+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:03.578 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.246+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:03.578 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.246+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:03.848 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 systemd[1]: Stopping Ceph osd.10 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:03.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:03 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:03.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:03.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:03 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:03.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:03.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:03 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:03.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:03.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:03 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:03.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:03.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:03 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:03.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:03.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:03 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:03.633+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:04.181 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.845+0000 7f4b047da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:04.181 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.845+0000 7f4b047da640 -1 osd.10 86 *** Got signal Terminated *** 2024-09-21T03:07:04.182 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:03 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:03.845+0000 7f4b047da640 -1 osd.10 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:07:04.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:04 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:04.233+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:04.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:04 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:04.233+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:04.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:04 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:04.233+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:04.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:04 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:04.233+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:04.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:04 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:04.233+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:04.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:04 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:04.233+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:04.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:04 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:04.233+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:04.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:04.634+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:04.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:04.634+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:04.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:04.634+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:04.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:04.634+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:04.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:04.634+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:04.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:04.634+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:05.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:05 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:05.209+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:05.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:05 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:05.209+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:05.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:05 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:05.209+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:05.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:05 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:05.209+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:05.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:05 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:05.209+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:05.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:05 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:05.209+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:05.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:05 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:05.209+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:05.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:05 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:05.620+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:05.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:05 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:05.620+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:05.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:05 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:05.620+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:05.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:05 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:05.620+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:05.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:05 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:05.620+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:05.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:05 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:05.620+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:06.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:06 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:06.243+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:06.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:06 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:06.243+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:06.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:06 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:06.243+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:06.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:06 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:06.243+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:06.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:06 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:06.243+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:06.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:06 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:06.243+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:06.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:06 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:06.243+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:06.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:06 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:06.588+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:06.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:06 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:06.588+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:06.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:06 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:06.588+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:06.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:06 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:06.588+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:06.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:06 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:06.588+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:06.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:06 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:06.588+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:06.749 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:06 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:06.588+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:07.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:07 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:07.200+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:07.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:07 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:07.200+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:07.681 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:07 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:07.200+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:07.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:07 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:07.200+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:07.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:07 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:07.200+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:07.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:07 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:07.200+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:07.682 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:07 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:07.200+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:07.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:07.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:07.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:07.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:07.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:07.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:07.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:07.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:07.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:07.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:07.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:07.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:07.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:07 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:07.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:08.431 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:08.162+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:48.465196+0000 front 2024-09-21T03:05:48.465182+0000 (oldest deadline 2024-09-21T03:06:13.764975+0000) 2024-09-21T03:07:08.431 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:08.162+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:57.265868+0000 front 2024-09-21T03:05:57.265834+0000 (oldest deadline 2024-09-21T03:06:18.965791+0000) 2024-09-21T03:07:08.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:08.162+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.367577+0000 front 2024-09-21T03:06:05.367431+0000 (oldest deadline 2024-09-21T03:06:27.067548+0000) 2024-09-21T03:07:08.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:08.162+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-21T03:06:11.569421+0000 front 2024-09-21T03:06:11.569405+0000 (oldest deadline 2024-09-21T03:06:35.669235+0000) 2024-09-21T03:07:08.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:08.162+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:17.870562+0000 front 2024-09-21T03:06:17.870605+0000 (oldest deadline 2024-09-21T03:06:43.170655+0000) 2024-09-21T03:07:08.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:08.162+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:28.972475+0000 front 2024-09-21T03:06:28.972461+0000 (oldest deadline 2024-09-21T03:06:53.672291+0000) 2024-09-21T03:07:08.432 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:08 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10[57596]: 2024-09-21T03:07:08.162+0000 7f4afcdbd640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:34.173323+0000 front 2024-09-21T03:06:34.173293+0000 (oldest deadline 2024-09-21T03:06:58.873296+0000) 2024-09-21T03:07:08.900 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:08 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:08.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:08.900 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:08 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:08.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:08.901 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:08 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:08.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:08.901 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:08 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:08.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:08.901 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:08 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:08.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:08.901 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:08 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:08.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:08.901 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:08 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:08.551+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:09.531 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:09 smithi164 podman[66188]: 2024-09-21 03:07:09.262090197 +0000 UTC m=+5.515501565 container died 31ae8be22d41d2d7e3eb0359c9c967181a1c2819a5f6a5f3fb20577faf6d96d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T03:07:09.864 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:09 smithi164 podman[66188]: 2024-09-21 03:07:09.621132133 +0000 UTC m=+5.874543497 container cleanup 31ae8be22d41d2d7e3eb0359c9c967181a1c2819a5f6a5f3fb20577faf6d96d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:07:09.865 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:09 smithi164 bash[66188]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10 2024-09-21T03:07:09.998 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:09 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:09.548+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:09.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:09 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:09.548+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:09.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:09 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:09.548+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:09.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:09 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:09.548+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:09.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:09 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:09.548+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:09.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:09 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:09.548+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:09.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:09 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:09.548+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:10.181 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:09 smithi164 podman[66203]: 2024-09-21 03:07:09.863872878 +0000 UTC m=+0.601944622 container remove 31ae8be22d41d2d7e3eb0359c9c967181a1c2819a5f6a5f3fb20577faf6d96d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T03:07:10.492 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:10 smithi164 podman[66292]: 2024-09-21 03:07:10.093533998 +0000 UTC m=+0.015884289 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:07:10.493 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:10 smithi164 podman[66292]: 2024-09-21 03:07:10.198000967 +0000 UTC m=+0.120351249 container create 21d5d50fc14dc5f64469b003616ef7cb7afabb35ef7ede6dbc4b354bfe4348d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T03:07:10.493 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:10 smithi164 podman[66292]: 2024-09-21 03:07:10.417071951 +0000 UTC m=+0.339422240 container init 21d5d50fc14dc5f64469b003616ef7cb7afabb35ef7ede6dbc4b354bfe4348d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:07:10.493 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:10 smithi164 podman[66292]: 2024-09-21 03:07:10.420457727 +0000 UTC m=+0.342808015 container start 21d5d50fc14dc5f64469b003616ef7cb7afabb35ef7ede6dbc4b354bfe4348d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:10.493 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:10 smithi164 podman[66292]: 2024-09-21 03:07:10.492011668 +0000 UTC m=+0.414361950 container attach 21d5d50fc14dc5f64469b003616ef7cb7afabb35ef7ede6dbc4b354bfe4348d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:10.912 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:10 smithi164 podman[66292]: 2024-09-21 03:07:10.607047803 +0000 UTC m=+0.529398085 container died 21d5d50fc14dc5f64469b003616ef7cb7afabb35ef7ede6dbc4b354bfe4348d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T03:07:10.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:10.584+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:10.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:10.584+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:10.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:10.584+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:10.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:10.584+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:10.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:10.584+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:10.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:10.584+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:10.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:10 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:10.584+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:11.167 INFO:journalctl@ceph.osd.10.smithi164.stdout:Sep 21 03:07:11 smithi164 podman[66315]: 2024-09-21 03:07:11.153673892 +0000 UTC m=+0.540828971 container remove 21d5d50fc14dc5f64469b003616ef7cb7afabb35ef7ede6dbc4b354bfe4348d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T03:07:11.173 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T03:07:11.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:11.255 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T03:07:11.255 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T03:07:11.255 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.11 2024-09-21T03:07:11.567 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 systemd[1]: Stopping Ceph osd.11 for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.566+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:11.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.572+0000 7f2708dc5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:12.000 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.572+0000 7f2708dc5640 -1 osd.11 86 *** Got signal Terminated *** 2024-09-21T03:07:12.000 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:11 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:11.572+0000 7f2708dc5640 -1 osd.11 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:07:12.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:12.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:12.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:12.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:12.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:12.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:12.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:12.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:12.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:12.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:12.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:12.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:12.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:12 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:12.602+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:13.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:13.600+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:13.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:13.600+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:13.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:13.600+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:13.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:13.600+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:13.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:13.600+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:13.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:13.600+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:13.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:13 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:13.600+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:14.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:14.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:14.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:14.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:14.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:14.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:14.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:14.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:14.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:14.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:14.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:14.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:14.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:14 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:14.642+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:15.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:15.675+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-21T03:05:45.102103+0000 front 2024-09-21T03:05:45.102252+0000 (oldest deadline 2024-09-21T03:06:09.802030+0000) 2024-09-21T03:07:15.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:15.675+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6804 osd.1 since back 2024-09-21T03:05:55.003667+0000 front 2024-09-21T03:05:55.003804+0000 (oldest deadline 2024-09-21T03:06:19.103816+0000) 2024-09-21T03:07:15.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:15.675+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6804 osd.2 since back 2024-09-21T03:06:05.004882+0000 front 2024-09-21T03:06:05.004940+0000 (oldest deadline 2024-09-21T03:06:29.704948+0000) 2024-09-21T03:07:15.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:15.675+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6812 osd.4 since back 2024-09-21T03:06:19.106337+0000 front 2024-09-21T03:06:19.106418+0000 (oldest deadline 2024-09-21T03:06:45.006284+0000) 2024-09-21T03:07:15.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:15.675+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.181:6812 osd.5 since back 2024-09-21T03:06:27.807728+0000 front 2024-09-21T03:06:27.807689+0000 (oldest deadline 2024-09-21T03:06:52.507709+0000) 2024-09-21T03:07:15.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:15.675+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-21T03:06:35.309376+0000 front 2024-09-21T03:06:35.309398+0000 (oldest deadline 2024-09-21T03:07:01.209302+0000) 2024-09-21T03:07:15.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:15 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11[57759]: 2024-09-21T03:07:15.675+0000 7f27013a8640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.164:6820 osd.7 since back 2024-09-21T03:06:41.209807+0000 front 2024-09-21T03:06:41.209960+0000 (oldest deadline 2024-09-21T03:07:05.909749+0000) 2024-09-21T03:07:17.375 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:17 smithi181 podman[66642]: 2024-09-21 03:07:17.119017679 +0000 UTC m=+5.667131091 container died 36a499cfa9714d5ebcc541380ce2f79d5185bd702a5735f158280d65c6c5473e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:07:17.716 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:17 smithi181 podman[66642]: 2024-09-21 03:07:17.472674384 +0000 UTC m=+6.020787806 container cleanup 36a499cfa9714d5ebcc541380ce2f79d5185bd702a5735f158280d65c6c5473e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:17.716 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:17 smithi181 bash[66642]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11 2024-09-21T03:07:17.999 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:17 smithi181 podman[66657]: 2024-09-21 03:07:17.715614808 +0000 UTC m=+0.592780940 container remove 36a499cfa9714d5ebcc541380ce2f79d5185bd702a5735f158280d65c6c5473e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:18.311 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:18 smithi181 podman[66746]: 2024-09-21 03:07:18.032944454 +0000 UTC m=+0.102370098 container create 1ff541f776c6033375dc1fe3d4d572902ff92a47620710ec4c62e67b28750048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-21T03:07:18.311 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:18 smithi181 podman[66746]: 2024-09-21 03:07:17.946419482 +0000 UTC m=+0.015845138 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:07:18.311 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:18 smithi181 podman[66746]: 2024-09-21 03:07:18.235533061 +0000 UTC m=+0.304958709 container init 1ff541f776c6033375dc1fe3d4d572902ff92a47620710ec4c62e67b28750048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:07:18.311 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:18 smithi181 podman[66746]: 2024-09-21 03:07:18.238722872 +0000 UTC m=+0.308148521 container start 1ff541f776c6033375dc1fe3d4d572902ff92a47620710ec4c62e67b28750048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T03:07:18.311 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:18 smithi181 podman[66746]: 2024-09-21 03:07:18.310543068 +0000 UTC m=+0.379968724 container attach 1ff541f776c6033375dc1fe3d4d572902ff92a47620710ec4c62e67b28750048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:07:18.714 INFO:journalctl@ceph.osd.11.smithi181.stdout:Sep 21 03:07:18 smithi181 podman[66746]: 2024-09-21 03:07:18.426316733 +0000 UTC m=+0.495742381 container died 1ff541f776c6033375dc1fe3d4d572902ff92a47620710ec4c62e67b28750048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-21T03:07:18.995 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T03:07:19.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:19.035 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T03:07:19.035 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T03:07:19.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.a 2024-09-21T03:07:19.332 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 03:07:19 smithi081 systemd[1]: Stopping Ceph mds.a for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:19.805 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 03:07:19 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a[71410]: 2024-09-21T03:07:19.330+0000 7fc88b2e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:19.805 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 03:07:19 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a[71410]: 2024-09-21T03:07:19.330+0000 7fc88b2e3640 -1 mds.a *** got signal Terminated *** 2024-09-21T03:07:22.805 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 03:07:22 smithi081 podman[92746]: 2024-09-21 03:07:22.552435836 +0000 UTC m=+3.323598488 container died 34e6ee5b313aee38779d29a71217eb4e71986689edb6177e08b69d9289b307c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:07:23.193 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 03:07:22 smithi081 podman[92746]: 2024-09-21 03:07:22.974632111 +0000 UTC m=+3.745794756 container cleanup 34e6ee5b313aee38779d29a71217eb4e71986689edb6177e08b69d9289b307c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T03:07:23.194 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 21 03:07:22 smithi081 bash[92746]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-a 2024-09-21T03:07:23.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T03:07:23.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:23.445 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T03:07:23.445 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T03:07:23.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.d 2024-09-21T03:07:23.780 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 03:07:23 smithi081 systemd[1]: Stopping Ceph mds.d for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:24.055 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 03:07:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d[70302]: 2024-09-21T03:07:23.778+0000 7faf66e38640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:24.055 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 03:07:23 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d[70302]: 2024-09-21T03:07:23.778+0000 7faf66e38640 -1 mds.d *** got signal Terminated *** 2024-09-21T03:07:28.005 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 03:07:27 smithi081 podman[92878]: 2024-09-21 03:07:27.603205373 +0000 UTC m=+3.928038734 container died 9e701b94b302b6eef48d85fedb98cfa546c51861ab4005f4a1e3c9c4cef77999 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:28.305 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 03:07:28 smithi081 podman[92878]: 2024-09-21 03:07:28.087109458 +0000 UTC m=+4.411942809 container cleanup 9e701b94b302b6eef48d85fedb98cfa546c51861ab4005f4a1e3c9c4cef77999 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T03:07:28.305 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 21 03:07:28 smithi081 bash[92878]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-d 2024-09-21T03:07:28.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T03:07:28.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:28.595 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T03:07:28.595 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T03:07:28.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.g 2024-09-21T03:07:28.926 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 03:07:28 smithi081 systemd[1]: Stopping Ceph mds.g for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:29.305 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 03:07:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g[71058]: 2024-09-21T03:07:28.924+0000 7f8875272640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:29.305 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 03:07:28 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g[71058]: 2024-09-21T03:07:28.924+0000 7f8875272640 -1 mds.g *** got signal Terminated *** 2024-09-21T03:07:31.305 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 03:07:31 smithi081 podman[92999]: 2024-09-21 03:07:31.061626155 +0000 UTC m=+2.239703650 container died c956db1e1f3cc4a883c9cf4cc3e05b4b50d7bdb2c59e92e4fd1d7da07646d512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T03:07:31.805 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 03:07:31 smithi081 podman[92999]: 2024-09-21 03:07:31.516234224 +0000 UTC m=+2.694311714 container cleanup c956db1e1f3cc4a883c9cf4cc3e05b4b50d7bdb2c59e92e4fd1d7da07646d512 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T03:07:31.805 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 21 03:07:31 smithi081 bash[92999]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-g 2024-09-21T03:07:31.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T03:07:32.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:32.006 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T03:07:32.006 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T03:07:32.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.j 2024-09-21T03:07:32.555 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 03:07:32 smithi081 systemd[1]: Stopping Ceph mds.j for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:32.555 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 03:07:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j[69925]: 2024-09-21T03:07:32.302+0000 7fb4ce3b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:32.555 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 03:07:32 smithi081 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j[69925]: 2024-09-21T03:07:32.302+0000 7fb4ce3b0640 -1 mds.j *** got signal Terminated *** 2024-09-21T03:07:36.188 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 03:07:35 smithi081 podman[93119]: 2024-09-21 03:07:35.911431277 +0000 UTC m=+3.691609359 container died 909d0090824bc368dfeba950788950b08e6bcfb3f5536fad80d1df7dbc19b7f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:36.530 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 03:07:36 smithi081 podman[93119]: 2024-09-21 03:07:36.270125896 +0000 UTC m=+4.050303963 container cleanup 909d0090824bc368dfeba950788950b08e6bcfb3f5536fad80d1df7dbc19b7f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T03:07:36.530 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 21 03:07:36 smithi081 bash[93119]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-j 2024-09-21T03:07:36.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T03:07:36.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:36.678 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T03:07:36.678 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T03:07:36.678 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.b 2024-09-21T03:07:37.046 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:07:36 smithi164 systemd[1]: Stopping Ceph mds.b for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:37.299 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:07:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b[62742]: 2024-09-21T03:07:37.045+0000 7f4e4ba3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:37.299 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:07:37 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b[62742]: 2024-09-21T03:07:37.045+0000 7f4e4ba3a640 -1 mds.b *** got signal Terminated *** 2024-09-21T03:07:39.182 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:07:38 smithi164 podman[66395]: 2024-09-21 03:07:38.846055118 +0000 UTC m=+1.979313724 container died 5f7a3c84ad26ec74b31c89c1f260b7b64b01f7afcaa1636e41ce4ace520febf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T03:07:39.629 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:07:39 smithi164 podman[66395]: 2024-09-21 03:07:39.26156931 +0000 UTC m=+2.394827915 container cleanup 5f7a3c84ad26ec74b31c89c1f260b7b64b01f7afcaa1636e41ce4ace520febf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T03:07:39.629 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:07:39 smithi164 bash[66395]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b 2024-09-21T03:07:39.629 INFO:journalctl@ceph.mds.b.smithi164.stdout:Sep 21 03:07:39 smithi164 podman[66421]: 2024-09-21 03:07:39.43785227 +0000 UTC m=+0.590358510 container remove 5f7a3c84ad26ec74b31c89c1f260b7b64b01f7afcaa1636e41ce4ace520febf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:07:39.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T03:07:39.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:39.692 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T03:07:39.692 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T03:07:39.692 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.e 2024-09-21T03:07:39.931 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:07:39 smithi164 systemd[1]: Stopping Ceph mds.e for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:40.431 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:07:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e[62193]: 2024-09-21T03:07:40.023+0000 7f5fb4e6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:40.432 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:07:40 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e[62193]: 2024-09-21T03:07:40.023+0000 7f5fb4e6d640 -1 mds.e *** got signal Terminated *** 2024-09-21T03:07:43.108 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:07:42 smithi164 podman[66529]: 2024-09-21 03:07:42.847831053 +0000 UTC m=+2.938594191 container died 34763d1e37910ed947112afe6ad041429b93ec9643135bfe5b57a1e8554e4211 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:07:43.431 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:07:43 smithi164 podman[66529]: 2024-09-21 03:07:43.19866175 +0000 UTC m=+3.289424876 container cleanup 34763d1e37910ed947112afe6ad041429b93ec9643135bfe5b57a1e8554e4211 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T03:07:43.432 INFO:journalctl@ceph.mds.e.smithi164.stdout:Sep 21 03:07:43 smithi164 bash[66529]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-e 2024-09-21T03:07:43.626 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T03:07:43.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:43.660 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T03:07:43.660 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T03:07:43.660 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.h 2024-09-21T03:07:44.182 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:07:43 smithi164 systemd[1]: Stopping Ceph mds.h for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:44.182 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:07:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h[62473]: 2024-09-21T03:07:43.968+0000 7fe5e4be9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:44.182 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:07:43 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h[62473]: 2024-09-21T03:07:43.968+0000 7fe5e4be9640 -1 mds.h *** got signal Terminated *** 2024-09-21T03:07:47.152 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:07:46 smithi164 podman[66650]: 2024-09-21 03:07:46.847211167 +0000 UTC m=+2.972885237 container died ce2bdcf938d17ffbd6ae4fb33f139e292f8f82c37edb1294fd42724ebf9519a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:07:47.152 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:07:47 smithi164 podman[66650]: 2024-09-21 03:07:47.151796714 +0000 UTC m=+3.277470818 container cleanup ce2bdcf938d17ffbd6ae4fb33f139e292f8f82c37edb1294fd42724ebf9519a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:07:47.431 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:07:47 smithi164 bash[66650]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h 2024-09-21T03:07:47.431 INFO:journalctl@ceph.mds.h.smithi164.stdout:Sep 21 03:07:47 smithi164 podman[66663]: 2024-09-21 03:07:47.369729665 +0000 UTC m=+0.518733483 container remove ce2bdcf938d17ffbd6ae4fb33f139e292f8f82c37edb1294fd42724ebf9519a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:07:47.506 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T03:07:47.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:47.539 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T03:07:47.539 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T03:07:47.539 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.k 2024-09-21T03:07:47.774 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 03:07:47 smithi164 systemd[1]: Stopping Ceph mds.k for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:48.181 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 03:07:47 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k[61906]: 2024-09-21T03:07:47.864+0000 7f33e434b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:48.181 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 03:07:47 smithi164 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k[61906]: 2024-09-21T03:07:47.864+0000 7f33e434b640 -1 mds.k *** got signal Terminated *** 2024-09-21T03:07:52.181 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 03:07:51 smithi164 podman[66771]: 2024-09-21 03:07:51.877985866 +0000 UTC m=+4.111436483 container died 6791a4ffbc4aa7671cab87b5b60bd616384311fffe157493d01225b2c67eb12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:07:52.668 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 03:07:52 smithi164 podman[66771]: 2024-09-21 03:07:52.313608251 +0000 UTC m=+4.547058861 container cleanup 6791a4ffbc4aa7671cab87b5b60bd616384311fffe157493d01225b2c67eb12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:07:52.668 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 03:07:52 smithi164 bash[66771]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k 2024-09-21T03:07:52.669 INFO:journalctl@ceph.mds.k.smithi164.stdout:Sep 21 03:07:52 smithi164 podman[66785]: 2024-09-21 03:07:52.472794855 +0000 UTC m=+0.595473196 container remove 6791a4ffbc4aa7671cab87b5b60bd616384311fffe157493d01225b2c67eb12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T03:07:52.690 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T03:07:52.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:52.722 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T03:07:52.722 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T03:07:52.722 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.c 2024-09-21T03:07:52.999 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:07:52 smithi181 systemd[1]: Stopping Ceph mds.c for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:53.260 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:07:53 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c[62848]: 2024-09-21T03:07:53.048+0000 7f17efc4a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:53.260 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:07:53 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c[62848]: 2024-09-21T03:07:53.048+0000 7f17efc4a640 -1 mds.c *** got signal Terminated *** 2024-09-21T03:07:55.223 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:07:54 smithi181 podman[66849]: 2024-09-21 03:07:54.863132727 +0000 UTC m=+1.946206015 container died e50eaf792f765531330091200871a99bff954484cb860448eee194e099df3bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T03:07:55.499 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:07:55 smithi181 podman[66849]: 2024-09-21 03:07:55.313723376 +0000 UTC m=+2.396796664 container cleanup e50eaf792f765531330091200871a99bff954484cb860448eee194e099df3bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T03:07:55.499 INFO:journalctl@ceph.mds.c.smithi181.stdout:Sep 21 03:07:55 smithi181 bash[66849]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-c 2024-09-21T03:07:55.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T03:07:55.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:55.773 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T03:07:55.773 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T03:07:55.773 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.f 2024-09-21T03:07:56.249 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:07:55 smithi181 systemd[1]: Stopping Ceph mds.f for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:07:56.249 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:07:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f[62581]: 2024-09-21T03:07:56.084+0000 7f1d08a01640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:07:56.249 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:07:56 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f[62581]: 2024-09-21T03:07:56.084+0000 7f1d08a01640 -1 mds.f *** got signal Terminated *** 2024-09-21T03:07:59.110 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:07:58 smithi181 podman[66978]: 2024-09-21 03:07:58.851604737 +0000 UTC m=+2.860980001 container died dbb06427d56550ea34de83ee60fc2490acd5da99268fe04c85dad63fb57d4ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T03:07:59.475 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:07:59 smithi181 podman[66978]: 2024-09-21 03:07:59.16712657 +0000 UTC m=+3.176501822 container cleanup dbb06427d56550ea34de83ee60fc2490acd5da99268fe04c85dad63fb57d4ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T03:07:59.475 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:07:59 smithi181 bash[66978]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f 2024-09-21T03:07:59.475 INFO:journalctl@ceph.mds.f.smithi181.stdout:Sep 21 03:07:59 smithi181 podman[66990]: 2024-09-21 03:07:59.351698914 +0000 UTC m=+0.491285140 container remove dbb06427d56550ea34de83ee60fc2490acd5da99268fe04c85dad63fb57d4ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:07:59.490 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T03:07:59.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:07:59.524 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T03:07:59.524 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T03:07:59.524 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.i 2024-09-21T03:07:59.749 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:07:59 smithi181 systemd[1]: Stopping Ceph mds.i for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:08:00.249 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:07:59 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i[63120]: 2024-09-21T03:07:59.828+0000 7f4bb931e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:08:00.249 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:07:59 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i[63120]: 2024-09-21T03:07:59.828+0000 7f4bb931e640 -1 mds.i *** got signal Terminated *** 2024-09-21T03:08:03.249 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:08:02 smithi181 podman[67099]: 2024-09-21 03:08:02.858216651 +0000 UTC m=+3.104688030 container died 55aa1f22a1f8f4a28aa96c803d8d325a95ff099c8f1ebe8f757081e50fe27c0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T03:08:03.573 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:08:03 smithi181 podman[67099]: 2024-09-21 03:08:03.379040375 +0000 UTC m=+3.625511747 container cleanup 55aa1f22a1f8f4a28aa96c803d8d325a95ff099c8f1ebe8f757081e50fe27c0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:08:03.573 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:08:03 smithi181 bash[67099]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i 2024-09-21T03:08:03.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T03:08:03.839 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:08:03 smithi181 podman[67112]: 2024-09-21 03:08:03.572211886 +0000 UTC m=+0.704676600 container remove 55aa1f22a1f8f4a28aa96c803d8d325a95ff099c8f1ebe8f757081e50fe27c0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:08:03.839 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:08:03 smithi181 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.i.service: Deactivated successfully. 2024-09-21T03:08:03.839 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:08:03 smithi181 systemd[1]: Stopped Ceph mds.i for 0bfe3ac0-77c4-11ef-baf5-efdc52797490. 2024-09-21T03:08:03.839 INFO:journalctl@ceph.mds.i.smithi181.stdout:Sep 21 03:08:03 smithi181 systemd[1]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.i.service: Consumed 1.531s CPU time. 2024-09-21T03:08:03.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:08:03.850 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T03:08:03.850 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T03:08:03.850 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.l 2024-09-21T03:08:04.167 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 03:08:03 smithi181 systemd[1]: Stopping Ceph mds.l for 0bfe3ac0-77c4-11ef-baf5-efdc52797490... 2024-09-21T03:08:04.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 03:08:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l[62310]: 2024-09-21T03:08:04.165+0000 7f2b0a2c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:08:04.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 03:08:04 smithi181 ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l[62310]: 2024-09-21T03:08:04.166+0000 7f2b0a2c5640 -1 mds.l *** got signal Terminated *** 2024-09-21T03:08:06.499 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 03:08:06 smithi181 podman[67222]: 2024-09-21 03:08:06.117054126 +0000 UTC m=+2.041991821 container died 06691b4986b05eb39039bd7e1faea03eb30176d06cd6e2e86ad10c0be741009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:08:06.851 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 03:08:06 smithi181 podman[67222]: 2024-09-21 03:08:06.574650201 +0000 UTC m=+2.499587887 container cleanup 06691b4986b05eb39039bd7e1faea03eb30176d06cd6e2e86ad10c0be741009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T03:08:06.851 INFO:journalctl@ceph.mds.l.smithi181.stdout:Sep 21 03:08:06 smithi181 bash[67222]: ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490-mds-l 2024-09-21T03:08:07.014 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0bfe3ac0-77c4-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T03:08:07.046 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:08:07.046 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T03:08:07.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:08:07.248 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T03:08:09.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:08:10.060 INFO:teuthology.orchestra.run.smithi164.stdout:Deleting cluster with fsid: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T03:08:12.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:08:12.712 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T03:08:15.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:08:15.118 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:08:15.150 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:08:15.176 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T03:08:15.178 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi081/crash 2024-09-21T03:08:15.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:08:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:08:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:08:15.217 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi164/crash 2024-09-21T03:08:15.217 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:08:15.265 INFO:teuthology.orchestra.run.smithi164.stderr:tar: /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:08:15.265 INFO:teuthology.orchestra.run.smithi164.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:08:15.267 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi181/crash 2024-09-21T03:08:15.268 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:08:15.303 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:08:15.303 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:08:15.304 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T03:08:15.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T03:08:15.362 INFO:tasks.cephadm:Compressing logs... 2024-09-21T03:08:15.362 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:08:15.364 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:08:15.366 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:08:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T03:08:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:: No such file or directory 2024-09-21T03:08:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T03:08:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T03:08:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:08:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:08:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T03:08:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T03:08:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:08:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:: No such file or directory 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T03:08:15.392 INFO:teuthology.orchestra.run.smithi181.stderr: 82.9% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:08:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr: 82.8% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log: 95.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.d.log: 86.5% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr: 95.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T03:08:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T03:08:15.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T03:08:15.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:08:15.402 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T03:08:15.402 INFO:teuthology.orchestra.run.smithi181.stderr: 90.3% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:08:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T03:08:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.l.log: 86.5% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:08:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T03:08:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T03:08:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T03:08:15.404 INFO:teuthology.orchestra.run.smithi164.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T03:08:15.404 INFO:teuthology.orchestra.run.smithi164.stderr:: No such file or directory 2024-09-21T03:08:15.404 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose --/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.k.log: /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log: 83.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr: 95.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log: 86.5% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:08:15.405 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T03:08:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:08:15.407 INFO:teuthology.orchestra.run.smithi181.stderr: 92.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T03:08:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T03:08:15.408 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:08:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.x.log: 95.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T03:08:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T03:08:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T03:08:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.3.log: 90.9% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:08:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:08:15.409 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.log: 95.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T03:08:15.410 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.h.log: 92.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T03:08:15.410 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T03:08:15.410 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.b.log: 90.9% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:08:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/cephadm.log: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:08:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:08:15.423 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:08:15.445 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:08:15.452 INFO:teuthology.orchestra.run.smithi181.stderr: 92.6% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T03:08:15.463 INFO:teuthology.orchestra.run.smithi181.stderr: 94.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T03:08:15.471 INFO:teuthology.orchestra.run.smithi164.stderr: 92.7% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T03:08:15.482 INFO:teuthology.orchestra.run.smithi164.stderr: 94.2% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T03:08:15.485 INFO:teuthology.orchestra.run.smithi181.stderr: 92.8% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T03:08:15.622 INFO:teuthology.orchestra.run.smithi081.stderr: 90.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T03:08:15.691 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T03:08:15.706 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T03:08:15.754 INFO:teuthology.orchestra.run.smithi164.stderr: 92.8% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T03:08:16.303 INFO:teuthology.orchestra.run.smithi081.stderr: 90.5% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T03:08:18.994 INFO:teuthology.orchestra.run.smithi181.stderr: 93.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T03:08:19.229 INFO:teuthology.orchestra.run.smithi164.stderr: 93.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T03:08:19.324 INFO:teuthology.orchestra.run.smithi181.stderr: 93.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T03:08:19.964 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T03:08:20.075 INFO:teuthology.orchestra.run.smithi164.stderr: 93.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T03:08:20.539 INFO:teuthology.orchestra.run.smithi081.stderr: 93.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T03:08:20.975 INFO:teuthology.orchestra.run.smithi164.stderr: 93.1% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T03:08:20.978 INFO:teuthology.orchestra.run.smithi164.stderr: 92.9% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T03:08:20.979 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-21T03:08:20.980 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m5.599s 2024-09-21T03:08:20.980 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m19.794s 2024-09-21T03:08:20.980 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.698s 2024-09-21T03:08:22.102 INFO:teuthology.orchestra.run.smithi181.stderr: 93.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T03:08:22.104 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-21T03:08:22.104 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m6.723s 2024-09-21T03:08:22.104 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m18.665s 2024-09-21T03:08:22.104 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.662s 2024-09-21T03:08:22.365 INFO:teuthology.orchestra.run.smithi081.stderr: 93.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T03:08:22.483 INFO:teuthology.orchestra.run.smithi081.stderr: 93.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T03:08:22.650 INFO:teuthology.orchestra.run.smithi081.stderr: 93.0% -- replaced with /var/log/ceph/0bfe3ac0-77c4-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T03:08:23.233 INFO:teuthology.orchestra.run.smithi081.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T03:08:23.234 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T03:08:23.235 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m7.857s 2024-09-21T03:08:23.235 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m34.227s 2024-09-21T03:08:23.235 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m1.208s 2024-09-21T03:08:23.235 INFO:tasks.cephadm:Archiving logs... 2024-09-21T03:08:23.235 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi081/log 2024-09-21T03:08:23.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:08:27.422 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi164/log 2024-09-21T03:08:27.423 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:08:30.459 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi181/log 2024-09-21T03:08:30.460 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:08:33.406 INFO:tasks.cephadm:Removing cluster... 2024-09-21T03:08:33.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 --force 2024-09-21T03:08:33.609 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T03:08:33.955 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 --force 2024-09-21T03:08:34.159 INFO:teuthology.orchestra.run.smithi164.stdout:Deleting cluster with fsid: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T03:08:34.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0bfe3ac0-77c4-11ef-baf5-efdc52797490 --force 2024-09-21T03:08:34.684 INFO:teuthology.orchestra.run.smithi181.stdout:Deleting cluster with fsid: 0bfe3ac0-77c4-11ef-baf5-efdc52797490 2024-09-21T03:08:34.960 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T03:08:34.960 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:08:34.980 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:08:34.997 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:08:35.012 INFO:tasks.cephadm:Teardown complete 2024-09-21T03:08:35.012 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T03:08:35.021 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T03:08:35.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:08:35.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:08:35.039 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:08:35.150 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T03:08:35.165 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T03:08:35.165 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:08:35.168 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:08:35.170 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:08:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:08:35.184 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:08:35.184 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:08:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:08:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-21T03:08:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 -78us[ -82us] +/- 41ms 2024-09-21T03:08:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -8307ns[ -12us] +/- 51ms 2024-09-21T03:08:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +158us[ +158us] +/- 76ms 2024-09-21T03:08:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:08:35.190 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:08:35.190 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-21T03:08:35.190 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 -68us[ -78us] +/- 41ms 2024-09-21T03:08:35.190 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -9607ns[ -19us] +/- 51ms 2024-09-21T03:08:35.190 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +160us[ +151us] +/- 76ms 2024-09-21T03:08:35.191 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:08:35.191 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:08:35.191 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-21T03:08:35.191 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -78us[ -87us] +/- 41ms 2024-09-21T03:08:35.191 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 -19us[ -29us] +/- 51ms 2024-09-21T03:08:35.191 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +157us[ +157us] +/- 76ms 2024-09-21T03:08:35.191 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:08:35.192 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T03:08:35.201 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T03:08:35.201 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T03:08:35.210 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:08:35.311 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:08:35.380 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:08:35.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:08:35.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:35.476 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:08:35.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:35.505 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:08:35.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:35.532 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T03:08:35.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T03:08:35.560 INFO:teuthology.task.internal:Duration was 1507.013906 seconds 2024-09-21T03:08:35.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T03:08:35.570 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T03:08:35.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:08:35.573 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:08:35.575 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:08:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:08:35.613 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:08:35.614 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:08:35.971 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T03:08:35.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T03:08:35.971 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:08:35.991 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-09-21T03:08:35.992 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:08:36.041 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-21T03:08:36.041 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:08:36.062 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T03:08:36.062 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:08:36.064 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:08:36.084 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:08:36.129 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T03:08:36.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:08:36.132 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:08:36.152 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:08:36.756 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T03:08:36.767 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T03:08:36.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:08:36.792 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:08:36.821 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:08:36.847 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T03:08:36.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:08:36.861 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:08:36.863 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:08:36.882 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-21T03:08:36.886 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-09-21T03:08:36.911 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-21T03:08:36.943 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:08:36.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:36.958 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:08:36.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:36.973 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:08:36.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:36.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T03:08:37.007 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T03:08:37.008 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi081 2024-09-21T03:08:37.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:08:37.055 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi164 2024-09-21T03:08:37.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:08:37.091 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913441/remote/smithi181 2024-09-21T03:08:37.091 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:08:37.125 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T03:08:37.125 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:08:37.127 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:08:37.129 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:08:37.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T03:08:37.185 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T03:08:37.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T03:08:37.212 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T03:08:37.212 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:08:37.214 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:08:37.216 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:08:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:08 /home/ubuntu/cephtest 2024-09-21T03:08:37.230 INFO:teuthology.orchestra.run.smithi164.stdout: 265708 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:08 /home/ubuntu/cephtest 2024-09-21T03:08:37.231 INFO:teuthology.orchestra.run.smithi181.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:08 /home/ubuntu/cephtest 2024-09-21T03:08:37.232 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T03:08:37.303 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T03:08:37.326 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} duration: 1507.0139060020447 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T03:08:37.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:08:37.408 INFO:teuthology.run:pass